Be ready to press your follow key. Just don't spam the shit out of the button, it's a bug in the game itself.