I get the same effect on a single box too.

If I use a CTRL+SHIFT+F1-F5 hotkey to PiP a window across, or if I happen to be holding down ctrl, alt or shift as I mouse-over to another window (I have focus-follows-mouse enabled in Windows) then that key becomes "stuck" until I bounce on it again.