Is there a way to have autofollow after combat on 4 toons, but not on 1?

Im planning on running 4 DKs and 1 disc priest for fun. Is there a way to make the DKs autofollow the master after combat, but have the priest stay put?