Monitor Flickering with Messy colors when using HDMI to Display Port adapter

Hi! I recently installed Fedora with KDE plasma for the first time.

I currently have two monitors connected to my pc. One main one using an HDMI cable and a second one That has an HDMI cable into a Display port adapter. My GPU only has one HDMI port and three Display Ports so i need to use an adapter to use both my monitors simultaneously. Unfortunately, the second monitor flickers and has really weird colors. As seen here:

Then I tried swapping to the second display port and the colors were slightly less messed up:
Imgur
This was not an issue when I was using windows so I hope it can be fixed!

GPU(Just in case): NVIDIA GeForce RTX 4070 SUPER

Have you installed the nvidia driver as instructed here?
The default driver that is provided by fedora is nouveau (open source and reverse engineered) and is sadly lacking in performance on many nvidia GPUs. The nvidia driver provides much better performance.