You can find out what modules are active with something like dnf module list --installed
Similar commands can be used to disable/remove the modular package that is interfering.
It seems the only issue you have is the modular conflict, and that seems caused by installing nvidia drivers from some source other than rpmfusion.
Installing the proper driver version is, as you indicated, done with a simple dnf install akmod-nvidia which pulls in everything else needed as a dependency.
You will need to remove the drivers installed directly from nvidia.com before installing from rpmfusion to avoid possible conflicts.
Here is one thread with a similar issue