Keep at it.

Until you have a fair amount of honor gear, you cannot be sure of the true potential of the team.
And the Conquest Bow/Crossbow/Gun, will be a rather large upgrade when you get it.
Once you have the tools, and you've played a bunch of games to learn what works and what needs to be changed...
Then you can decide the viability of the team.

Battlegrounds will place you a tier of gear behind the current best (arena/ratedBG's).
But with full Honor gear, you should be rather dominant in a lot of BG's.
Maybe not so much in the confines of a tower, but I'd imagine an AB style game (or AV between objectives) the Hunters would rock.

There are quite a few players out there with massive Resiliency.
I'd strongly consider paying if need be, to run 2's with your Hunters.
Conquest points cap each week is the most important thing.