This is possibly an issue with the upstream driver for the touch bar display. As temporary workaround it can be prevented from being loaded with modprobe.blacklist=adpdrm in the kernel command line.
For example (for Fedora 41) via
sudo grubby --update-kernel=/boot/vmlinuz-6.14.2-400.asahi.fc41.aarch64+16k --args="modprobe.blacklist=adpdrm"
and Fedora 42
sudo grubby --update-kernel=/boot/vmlinuz-6.14.2-400.asahi.fc42.aarch64+16k --args="modprobe.blacklist=adpdrm"