ah ok, thought you were just doing PVE not PVP.

Hmm the only thing I can think of is lag.. Do you experience any sort of lag on your main while your other character is casting a spell?