I have noticed this on my main as well. I think its something weird with having a toon on follow. I noticed lately (I'm not a keyclone user and I was not using any dual-boxing software at the time) the same thing you are experiencing - AFK on my alts, not AFK on my main.