Unfortunately you have to use your mouse, there is no other possibility.
What you can do is mapping the mouse position to your alt-windows with keyclone or so, but you will still have to position and click the mouse...