Display lagging severely with Nvidia Quadro P1000 on a 4k monitor

This is happening on my newly installed Fedora 34, with Gnome 40 and Wayland by default.

I installed the drivers using RPM. They appear to be installed fine, Nvidia X Server Settings allows me to see all the info without any issues.

Running lsmod |grep nouveau show nothing, so it’s not loaded.

When using my external monitor on 4k, it lags terribly, it’s unusable. On 1920X1080, single display, lags badly, but less.

And strangely, when using mirror display on 1920x1080 (internal and external LCDs), it works fine, albeit blurry since it’s not the native resolution.

Anyone has any ideas?