This is most likely to do with the algorithm that goes with follow.

Does it affect your gameplay at all?

Also, what is your latency to the server?