I did some more magic now. I followed this and there are 2 extra steps:
https://rpmfusion.org/Howto/NVIDIA
grubby --update-kernel=ALL --args='nvidia-drm.modeset=1'
And: WaylandEnable=false in /etc/gdm/custom.conf
That did the trick for me now. Probaby the latter is more important.