I posted some extra theory on this a couple of weeks ago which might help:

[Other] How to set affinity manually for 8 cores