You're sure that it's not an action that intterupts the follow? Like by accident pressing WSAD or have them broadcasted while typing on the leader?