The clients in the background will never follow properly because when minimized the game doesn't update frequently enough.