Almost.
I did not try dnf downgrade in my case since I knew exactly what I wanted to reinstall and chose not to allow it to be managed automatically by dnf (and I seldom use a downgrade so had even forgotten the command was available)
I just tested and found that the command
dnf downgrade \*nvidia\* --exclude nvidia-gpu-firmware --allowerasing would do the same.
Thanks for the reminder. 