No you're not going crazy.

I've seen this when I was levelling with my fiance. Her druid would get a few XP more than me, which didn't seem much at the time but over a few levels it meant she was ahead by a fair margin, even thought we were killing the same mobs, handing in the same quests etc.

No idea why it does it