I would guess this is a "feature" so that if you don't have your mouse over something, you can still interact, since it's supposed to be designed to help people with disabilities. I have /cleartarget in my follow key, so I don't personally see this behavior.