I already know most, if not all locations where I will loose follow due to this invisible 'instancing'. I've memorized them, when I fly through the edge, I just press move forward on all chars, they get in the same zone, follow key, continue.

It isn't an issue, really.