Also, do you have a macro to a spell bound to the 1 key on your new window?

If it is just the default auto-attack still, then it probably won't do anything because your toon will likely be too far away from a mob

Are you using a focus based system for follow?