I'm still very new at this, having just started yesterday, but I noticed a sizable performance improvement by turning off "Focus follows mouse". It's a big enough difference that the additional click into the window to make it active is much faster.

That being said, I'm running all five clients on one machine, so I'm sure that's going to be part of it. But with that feature turned off, I'm getting pretty decent performance.