To be honest that is one of the reasons why i don't like multibox alliance.
It is probably because there are simply more alliance players than horde players so there are more of them following you around and annoying you.