As soon as you get in combat with a "player" or some guards follow is disabled for a few sec/mins i am fine being horde i barely see Alliance