Remove this from your macro and it won't auto-deny:
/script StaticPopup_Hide("PARTY_INVITE");
However, it will leave the invite popup opened.

Similar behavior [s]occurs with[/s] might occur with:
/script StaticPopup_Hide("QUEST_ACCEPT");