Hm, was thinking that it could be related to my Large Text setting under Accessibility.
Firefox shows another strange behavior here:
If geometry is large enough (meaning that it is almost taking whole screen) and you close it and start it again, it will shortly come up with same geometry before jumping into full screen. A double click on the title bar make Firefox come back to desired geometry.