I found the solution:
sudo grubby --update-kernel=ALL --args="pcie_aspm=off"
This disables PCIe ASPM. Apparently the kernel was turning it on? Because according to dmesg my laptop doesn’t support ASPM so it should be disabled.
dmesg | grep aspm -i
[ 0.000000] Command line: <boot volumes> rhgb quiet intel_iommu=on pcie_aspm=off
[ 0.066562] Kernel command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.0.5-200.fc36.x86_64 root=UUID=<> ro rootflags=subvol=root rd.luks.uuid=<> rhgb quiet intel_iommu=on pcie_aspm=off
[ 0.066761] PCIe ASPM is disabled
[ 0.157331] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 0.379810] acpi PNP0A08:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 0.379983] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration