Don't pass movement to your secondary characters. Use /follow for them instead.