Something I'm experiencing as well and I believe it's due to a small amount of lag moving between screens.

Are you using both mouse buttons to move around in those windows? If so, as you move your mouse out of one screen, it's not telling the window that you've released both mouse buttons hence all you can do when you move it back is look around.

The only way I've found to get it sorted is to move your mouse into the affected window and quickly use the left mouse button to look around at any other angle to reset the camera.

It's a pain, I've not found a better way around it yet. I can't find the thread now but this was discussed recently - assuming you ARE having the same problem as me.