Whats the processor load on each of the CPUs when running 4 and how much of your ram is being used by all 4 clients? Screenshot of your taskmgr would help.