When you have click-to-move enabled, its camera style setting takes precedence when using IWT or /follow.

The setting is found in Interface -> Mouse, and I'm guessing you have it set on never adjust. Fix it!