Check with HP before buying a new PSU.
Some proprietary desktops use non-standard cases and other components, which cannot be replaced with off-the-shelf components.
As d0z3rr said, you might be better off saving a bit to build a new PC (or have one built for you at a local shop).