Junction and hardlink your WoW installs (you should be using more than one anyway).

This will minimize HDD activity which is probably causing your slow load times.

I have 2.990GHz C2D, 8800GT, 4GB RAM (and I barely hit 2GB in use when playing), and XP with 5 hardlinked junctioned installs. Shatt loads smooth as butter.