In my experience it's the opposite. Can't count the amount of BG's I've lost because a bunch of quest geared bums follow me around gawking instead of defending or doing something useful. I'll run around and wipe all the enemy off a point, capture it, then 30 seconds after I leave it gets recaptured.

As a boxer all you need is 2-3 rogues that know how to defend a point without dying and you can do pretty well.