Ok, nailed it.

With broadcasting enabled, when I alt-tab (which only alt-tabs on the "Main" machine) it causes the alt keys to "stick" upon going back to the game. I have to tap it a few times to get mojo to realize it "released".