If you're using casters....channeled spells break autofollow.
Melee character on follow....melee breaks autofollow.

Probably others, but i haven't had my coffee yet.