XP 64 driver support can be very poor at times, if you want 64 bit then go Vista as all drivers are released in 32-bit and 64-bit flavors at the same time.

Going to Linux will do more to hurt your performance then it will help by adding 2 more gigs of ram.