If I recall, the giants have a HUGE movement range that breaks follow after only a few steps. You will have to move slowly and let your toons play catchup a lot to keep follow once you have it started. It was almost always easier to just move them to a general area and use the main to kill.