This is a known issue, Blizzard said they will fix it, presumably in the next big patch. Basically, the follower will disconnect if whoever he's following stops moving. The short term workaround is to enable Vsync. It seems to do the trick most of the time for me.