The first thing I do for my followers, is to unbind every singel keybinding in wow, and just bind those that I would use. This solves most of the problems. If you need to chat with your followers, just bind another key for chatting with them and problem solved

There is also a nice mod called "twoboxtoolkit" that makes your followers resend their whispers to a channel. This is very useful for monitoring whispers.