Only time I ever see that behavior is when using some other software that mucks with the mouse positioning, like remote desktop apps (TeamViewer, InputDirector, etc.). I've been grabbing the Ancient Mana nodes and haven't run into this at all.