That's pretty much what I do as well. I loot by scrolling over to the other screen and even do some gathering quest. It doesn't turn out to be all that bad on high drop rates. However, I don't even attempt low drop rate quest.

I have a macro that auto accepts when I share quest or invite to group. I invite my slaves and hit the keybind. I don't really think there is anything to make you switch back less. I do it every time I play even for decursing. If there is... I'd like to know as well.

Also, I have been buying *some* greens from the auction house along with quest rewards, drops etc...