You can have two follow you. One is the bodyguard from the barracks. You can then ask any of the others to go on patrol and they will follow and fight as well, but only in your garrison. If you leave, they despawn.