Displaylink making my monitor run on 10fps

Hello, I downloaded the Displaylink drivers to test them out with my external monitor because I wanted to buy a docking station and lots of those still use Displaylink. However, when connecting my monitor to my MacBook directly via HDMI, it was laggy and running using Displaylink. After uninstalling, it was fine again. I use the Sway window manager. How can I fix this?