The easiest way that I've found to do it is to leave the arrow keys off of the do not pass list. That way if you want them to stop following, or back up all you have to do is use the back arrow key. They will automatically back up and stop following so you can move your pally around.