If you're currently running out of RAM, then yes.
If you're not currently running out of RAM, then no.

You will most likely see an increase in performance because you've got some crazy setup using 5GB of RAM. Are you even sure your system can handle 32GB of RAM?