Make sure you've unchecked the player not online and push the setting change to all WoW instances.