Ok, so the cpu changed is very noticeable. Ty for that suggestion. Also, after carefully watching and checking stats. It seems that they ONLY thing hanging up per switch is the Render. For what ever reason it drops to 50% on one of the slots during the swap.

Even after setting it BACK up in game, the render will still drop back down after i swap out then back to the slot.