The fact that they are not ever all pointing in exactly the same direction will also tend to spread them out over time when you broadcast movement keys to them, particularly when strafing. I have also noticed the issue with occasional input lag to some characters when moving my slaves. I've not yet been able to pinpoint the cause or remedy.

Alge