When I want to do this, I tap on of my formation keys.
It moves the clones just slightly and breaks the follow.
Then your main is free to move around without the clones.