Short Answer - Yes

Lack of resources, momentary pauses due to max processing/memory bandwidth etc can delay your next cast by a fraction of a second.

IDK about the rest of you, but me ele shamans are pretty crit dependent and some days the RNG does not like me.