5 clients on Vista will go over 4GB easily. 32-bit Windows will cap you at 4GB total, including for example video memory.

Ideally I would get 64-bit Windows, 8GB, AND the video upgrade (and still keeping the planned quad-core upgrade). More memory won't do jack for you until you swap out the OS though, as you already have more than it can talk to.