Hmm, turned to blacklist and it works,
I'm sure i tried it before, but i guess i forgot to remove the keys from the list.

i guess i'll go with the keymaps then, i'm not going back to blacklisting