That is the default behavior...

But you can disable/change that in your character sets.
Click on the character set.
Then on the slot number.
Check "and only when I use the above hotkey".

That way, only the hotkey will switch regions, not clicking on the region.