I just use the little arrows to the right of my main action bar and scroll down to action bar #2 when I'm not boxing....

Since the 1 through = keys are the ones I mainly use while boxing, those are the only ones I need to change really.