this might seem obvious, but your settings are saved to disk when you hit 'ok' or 'apply'.
hitting the 'x' in the upper right won't save the information (it's the same as cancel)