I got it working!
I searched for the Broadcom whatever and found other people also had similar issue, so I figured it must be a non-free or something driver there was also a person asking in the ask fedora page how to download broadcom-wl driver so I downloaded that, did a reboot and now it works in full speed
sudo dnf install broadcom-wl