Make sure you have the "Release modifiers when leaving client" box checked. Should fix that.

I use numlock as well and have never seen this.