Try adding enties to your host file for all your local machines. I had a very similar problem, detailed elsewhere, a few months ago and tracked it down to a reverse DNS lookup on the connecting node name timing out for some inadequately explored reason.

Entries in the host file for all local machines fixed it.