Yeah.. exceptions would start getting truly tricky..

Possibly connect a 2nd keyboard (one of the costumizable ones) on a second driver for modifier keys?

Or how programmable is X-keys?