assuming you have a mele main like a pally and a set of spell casters...
move you main back to the boss and press your follow key immdiately use the back arrow or backup key.
this should face your characters toward your main and then stop them so they can start casting again.