I think you would lose too much exp. The class quests have been the biggest exp givers for me.