Even if you have focus follows mouse on, it is your movement of the mouse that triggers the focus change, not anything automated. Still, this is a bit of a gray area I think.