I had someone whispering me as well once in Netherstorm while I was farming scryer rep.
A guildmate helped me understand what was being said, in essence I was being told off for interrupting their farming and they did not believe me that I wasnt one of them or able to understand that they were saying when I replied in English.

Funny stuff. At the end of the day, every gold farmer will understand that we are not in the same boat though - when you log off or do something non-farming related. =]