I do assume you have set affinity cores?

If not all clients use core 1 wich should explain the strange behaviour.