I get this a lot too, though usually mostly in battlegrounds since I'm not often flagged in the outside world, my server being a PvE server as it is.
And it only has any noticeable effect when there are 4 or more mages doing it.