You specifically mentioned the face several times as that being the main difference. Are you ranking up in Dark side points? That makes my chars face/eyes darker, and gives that dirty look around the mouth.

(you can disable this in settings so dark side doesn't affect your appearance)