Don't forget you have a limited GPU resource pool. And at some point, IO is going to be an issue.

The same has been said about Virtualization. It is WONDERFUL for some applications. Gaming is not one of them. (Yet?).