you are thinking right

your usb is functionning as a second network card.
you will have to get either a small switch or.. if you will only get a second computer and not more, a twisted UTP cable. (with a normal cable between the computers you won't get them to talk to each other)
on the "server" you will have to "bridge" the network cards, but that shouldn't be too much of a hastle.