That problem only happens if you need/want to recast all your totems again within 15 seconds of your previous cast of them.
But Nixi, don't forget to have a tremor totem in each layer of totems so you get them properly staggered.