Oh, okay I think I understand -- you're adding a Toggle to the same Key Map and Mapped Key, but the Character Sets are unrelated? It'll end up loading the Warlocks key map for your paladins when you hit the key. It won't bother with the whole "but these guys aren't warlocks and shouldn't have the warlocks key map" thing because Toggle will turn it ON if it's OFF (i.e. from not being attached to the Character Set).

You will want a different Key Map or Mapped Key, or instead of sending to All, send to an Action Target Group that only has the right set in it