Just off the top of my head it may be the $50 video card on an otherwise nice system. I'm running a similar set up with a HD4870 and have very few issues running five clients on one machine.