We would each have our own mouse and keyboard.

I'd want something like two virtual machines set up which only recognise one of the keyboards each.