These may be stupid questions but:

1. Are you turning him to the side right away? Can't turn all the way around or else his tail will get the group, needs to be side so tail/breath are avoided.
2. Watch the fireballs on the ground. This is a PITA for cast groups because you have to stop and cast.

Those are the two major killers.