When 'Keep window open when it loses focus' option is changed in drop-down mode, it's applied from next launch, not immediately. version: git master
The manual also states it is used for the initial state of the toggle button.