More speculation here. When you get polymorphed you often move around. If you alts haven't stopped following you they too will move, thus interrupting spell casts.
?