Adding [combat] should prevent them from casting totems unless they're already in combat. I don't mind if they drop totems on the way into combat.