I’m having the exact same issue, found your thread while Googling around.
Fedora Linux 41
Kernel: 6.11.8-300.fc41.x86_64
AMD Ryzen 5 4600U
Found the following related in the journal, makes sense why switching to Xorg should fix it (but is not really a fix in my opinion)
dec 02 14:13:17 my-laptop gnome-shell[49178]: (EE) failed to read Wayland events: Broken pipe
dec 02 14:13:17 my-laptop unknown[47619]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop kgx[53564]: Lost connection to Wayland compositor.
dec 02 14:13:17 my-laptop xdg-desktop-por[48096]: Lost connection to Wayland compositor.
dec 02 14:13:17 my-laptop unknown[47586]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop unknown[47560]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop gnome-software[47695]: Lost connection to Wayland compositor.
dec 02 14:13:17 my-laptop gsd-wacom[47647]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop xdg-desktop-por[48122]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop unknown[47572]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop gsd-media-keys[47574]: Error reading events from display: Broken pipe
dec 02 14:13:17 my-laptop systemd[47221]: org.gnome.SettingsDaemon.Power.service: Main process exited, code=exited, status=1/FAILURE
dec 02 14:13:17 my-laptop systemd[47221]: org.gnome.SettingsDaemon.Color.service: Main process exited, code=exited, status=1/FAILURE
dec 02 14:13:17 my-laptop systemd[47221]: org.gnome.SettingsDaemon.Keyboard.service: Main process exited, code=exited, status=1/FAILURE
dec 02 14:13:17 my-laptop systemd[47221]: org.gnome.SettingsDaemon.MediaKeys.service: Main process exited, code=exited, status=1/FAILURE