Remember, you're losing a ton of +hit/+expertise/etc. that help your DPS immensely in heroics/raids. If it's just normal 5-mans, nothing will live long enough to notice a difference, IMO.