Theres not much that i know of to fix this , you will just notice its consistent with the server latency, when you have higher latency they will drop follow a hell of a lot more, then when you have low.

When i am mounted i find i just keep an eye on my map and i can see them fall back a bit on zone changes so i know to stop let them catch up..