Ok, found the issue, classes with pets have their default keybinds set to the same as what my assist was set to, I had set assist as 1. Changing the pet keybinds fixed the issue.
Thanks for the help