I'm having the same problem sometimes (once or twice every few hours), but I doubt it has anyting to do with latency because my latency is usually between 30-40 with the occasional peaks to 60.

I haven't been to any cities yet, so I'm not sure what would happen there