I have not raided as a boxer but I can imagine one big hurdle is convincing others to let you do it. Once you do that, then there will possibly be issues with loot drops (i.e., IME folks often don't like to let one person get items for more than one toon)- although, I am not sure if that matters much these days.

There will likely be some limitation to what can be accomplished. Although, I am sure some boxers will likely progress as far as any solo toon can, but I doubt most will.

Regardless, if you get far enough with your team I am sure you won't mind taking a break from boxing and doing some raids solo. Especially if you have different classes to play.