@arctrus, I haven’t noticed my system doing that. But you might try using pavucontrol instead of alsamixer and see if you can lock the values you want using that tool.
Note that fedora has at least 2 volume controls to be concerned with.
The device volume control you show
The system volume control (at the upper right of the screen)
and possibly a third on the headphones themselves.
It seems all have some affect on sound output and each may need adjusted to attain the desired results.