Boot stuck at job dev-disk-by-uuid (no limit) with btrfs multi-drive setup

Ask Fedora
,
1

Hi
After every two or three reboots I face this problem. In the boot screen I stuck at this point so that I must reboot my system to get it work.

The complete error is:

Job dev-disk-by-uuid-5cc459bb-cd95-48b7-8fa2-e72ea854bc12.device/start running  (5min / no limit)

I have two NVMe and I used default Anacando partitioning setup (after selecting both drives).

$ lsblk
NAME        MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
zram0       252:0    0     8G  0 disk [SWAP]
nvme1n1     259:0    0 476.9G  0 disk 
└─nvme1n1p1 259:1    0 476.9G  0 part 
nvme0n1     259:2    0 476.9G  0 disk 
├─nvme0n1p1 259:3    0   600M  0 part /boot/efi
├─nvme0n1p2 259:4    0     1G  0 part /boot
└─nvme0n1p3 259:5    0 475.4G  0 part /home
                                      /

And fstab is as following:

$ cat /etc/fstab
UUID=5cc459bb-cd95-48b7-8fa2-e72ea854bc12 /                       btrfs   subvol=root,compress=zstd:1 0 0
UUID=95613f08-00c0-4721-8dba-a6dafc736a09 /boot                   ext4    defaults        1 2
UUID=96A5-C478          /boot/efi               vfat    umask=0077,shortname=winnt 0 2
UUID=5cc459bb-cd95-48b7-8fa2-e72ea854bc12 /home                   btrfs   subvol=home,compress=zstd:1 0 0

To be honest I don’t know how btrfs handle multiple drives using sub-volume, but a really interesting thing is that in my /dev/disk/by-uuid, one time I got this:

lrwxrwxrwx. 1 root root 15 Jun 20 17:49 5cc459bb-cd95-48b7-8fa2-e72ea854bc12 -> ../../nvme0n1p3
lrwxrwxrwx. 1 root root 15 Jun 20 17:49 95613f08-00c0-4721-8dba-a6dafc736a09 -> ../../nvme0n1p2
lrwxrwxrwx. 1 root root 15 Jun 20 17:49 96A5-C478 -> ../../nvme0n1p1

And another time I got this:

lrwxrwxrwx. 1 root root 15 Jun 20 17:49 5cc459bb-cd95-48b7-8fa2-e72ea854bc12 -> ../../nvme1n1p1
lrwxrwxrwx. 1 root root 15 Jun 20 17:49 95613f08-00c0-4721-8dba-a6dafc736a09 -> ../../nvme0n1p2
lrwxrwxrwx. 1 root root 15 Jun 20 17:49 96A5-C478 -> ../../nvme0n1p1

Anyone has any clue what does cause this problem?

2

Sounds like a bug, but it might be tedious to figure it out.

Can you paste the output of these two commands? Bracket the paste at the top and bottom with three single quotes (key with the tilde character on a standard U.S. English keyboard), ```

$ sudo fpaste --sysinfo --printonly
$ sudo fpaste --btrfsinfo --printonly

Alternatively, ping cmurf on IRC #fedora channel, or Matrix and refer to this Ask Fedora URL, and remove --printonly and post the resulting URLs instead. Info: the URLs will expire in 24 hours, hence pasting the full output into this forum rather than the URL.

The way it’s supposed to work:

  1. Anaconda, when you choose two drives as destinations, will make a large partition on each drive, and do a default mkfs.btrfs with both devices, i.e. mkfs.btrfs /dev/nvme1n1p1 /dev/nvme0n1p3 which results in single btrfs file system across two drives with data profile “single” and metadata profile “raid 1”. This means a single copy of your data across both drives, and two copies of metadata (the file system itself) across two drives. Since the two NVMe drives have the same performance profile, this is fine. Btrfs allocation will favor the least full device, so in this case it initially favors nvme1n1p1 because it’s bigger, but then in effect it will alternate allocation between the two drives to balance out the unallocated space.

  2. There is a udev rule, /usr/lib/udev/rules.d/64-btrfs.rules that’s supposed to wait indefinitely for all Btrfs member devices to show up before the btrfs volume is considered ready for the mount command. i.e. the mount command should only be attempted after all devices are present, but there should also not be a meaningful delay once all devices are ready.

The problem could be here, but I’m not sure if there’s any change in this udev rule, or in systemd-udevd that might relate to this.

  1. Most all of Btrfs code is actually in the kernel. The udev rule is calling btrfs-progs (user space tools) btrfs device ready which in turn calls kernel ioctl BTRFS_IOC_DEVICES_READY - and the kernel should only say it’s ready when all devices appear.

I’m suspicious the problem is here.

OK so how do we figure this out? One is you can punt and just reinstall with a single NVMe device for the Fedora installation. And the 2nd NVMe device you can format and mount somewhere convenient - like /home/$user/videos or whatever. i.e. instead of taking advantage of Btrfs pooling with multiple devices, make them separate devices and mount them where you’ll use the extra space the most. This is a valid punt because it’s easy to do and now you don’t have to do any troubleshooting.

But if you want to help fix this bug, we have to get into some nitty gritty and find out why it’s happening before it can be fixed.

3

When I set up a test VM, 2 device Btrfs, automatic partitioning installation, and remove the device that has the 2nd btrfs device - I get an indefinite hang as expected. But when I do:

# virsh attach-disk uefivm /var/lib/libvirt/images/test2 vdb --cache unsafe

The system immediately boots. So the kernel is definitely “polling” for devices ready and as soon as the 2nd device appears, udev proceeds with mount. This is the correct behavior.

Somehow we have to find out why this isn’t happening in your case. Whether it’s a kernel regression (simple to test, try this with 5.17.5 maybe a dozen times and see if it happens or not), or is the device really intermittant?

I have seen some churn in NVMe kernel code lately so I wonder if we just need more pass/fail data with different kernels and see if that’s the source of the issue - without going too deep down a rabbit hole.

4

Have same problem:

  • Two NVME drives
  • Chose auto partition before installation, BTRFS
  • Random stuck on boot on dev-disk-by-uuid: Job dev-disk-by-uuid-9c52374b-7623-4f3d-9a5d-f2056a81c79e.device/start running
  • Same with 5.18 kernel, but I have even more another issues with it

fstab:

UUID=9c52374b-7623-4f3d-9a5d-f2056a81c79e /                       btrfs   subvol=root,compress=zstd:1 0 0
UUID=916f8f55-115a-49c7-9ca6-9d3737d5b4f7 /boot                   ext4    defaults        1 2
UUID=C44C-303B          /boot/efi               vfat    umask=0077,shortname=winnt 0 2
UUID=9c52374b-7623-4f3d-9a5d-f2056a81c79e /home                   btrfs   subvol=home,compress=zstd:1 0 0

sysinfo:

=== fpaste 0.4.2.0 System Information ===
* OS Release (cat /etc/*-release | uniq):
     Fedora release 36 (Thirty Six)
     NAME="Fedora Linux"
     VERSION="36 (Workstation Edition)"
     ID=fedora
     VERSION_ID=36
     VERSION_CODENAME=""
     PLATFORM_ID="platform:f36"
     PRETTY_NAME="Fedora Linux 36 (Workstation Edition)"
     ANSI_COLOR="0;38;2;60;110;180"
     LOGO=fedora-logo-icon
     CPE_NAME="cpe:/o:fedoraproject:fedora:36"
     HOME_URL="https://fedoraproject.org/"
     DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f36/system-administrators-guide/"
     SUPPORT_URL="https://discussion.fedoraproject.org/"
     BUG_REPORT_URL="https://bugzilla.redhat.com/"
     REDHAT_BUGZILLA_PRODUCT="Fedora"
     REDHAT_BUGZILLA_PRODUCT_VERSION=36
     REDHAT_SUPPORT_PRODUCT="Fedora"
     REDHAT_SUPPORT_PRODUCT_VERSION=36
     PRIVACY_POLICY_URL="https://fedoraproject.org/wiki/Legal:PrivacyPolicy"
     VARIANT="Workstation Edition"
     VARIANT_ID=workstation
     Fedora release 36 (Thirty Six)
     
* Kernel (uname -r ; cat /proc/cmdline):
     5.17.14-300.fc36.x86_64
     BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.17.14-300.fc36.x86_64 root=UUID=9c52374b-7623-4f3d-9a5d-f2056a81c79e ro rootflags=subvol=root rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init rhgb quiet
     
* Desktop(s) Running (ps -eo comm= | grep -E '(gnome-session|startkde|startactive|xfce.?-session|fluxbox|blackbox|hackedbox|ratpoison|enlightenment|icewm-session|od-session|wmaker|wmx|openbox-lxde|openbox-gnome-session|openbox-kde-session|mwm|e16|fvwm|xmonad|sugar-session|mate-session|lxqt-session|cinnamon|lxdm-session)' ):
     gnome-session-b
     gnome-session-c
     gnome-session-b
     
* Desktop(s) Installed (ls -m /usr/share/xsessions/ | sed 's/\.desktop//g' ):
     gnome-classic, gnome-classic-xorg, gnome,
     gnome-xorg
     
* SELinux Status (sestatus):
     SELinux status:                 enabled
     SELinuxfs mount:                /sys/fs/selinux
     SELinux root directory:         /etc/selinux
     Loaded policy name:             targeted
     Current mode:                   enforcing
     Mode from config file:          enforcing
     Policy MLS status:              enabled
     Policy deny_unknown status:     allowed
     Memory protection checking:     actual (secure)
     Max kernel policy version:      33
     
* SELinux Errors (selinuxenabled && journalctl --since yesterday |grep avc: | grep -Eo comm="[^ ]+" | sort |uniq -c |sort -rn):
         120 comm="gdb"
          14 comm="NetworkManager"
           6 comm="qemu-system-x86"
     
* CPU Model (grep 'model name' /proc/cpuinfo | awk -F: '{print $2}' | uniq -c |
     sed -re 's/^ +//' ):
     12  AMD Ryzen 5 5600H with Radeon Graphics
     
* 64-bit Support (grep -q ' lm ' /proc/cpuinfo && echo Yes || echo No):
     Yes
     
* Hardware Virtualization Support (grep -Eq '(vmx|svm)' /proc/cpuinfo && echo Yes || echo No):
     Yes
     
* Load average (uptime):
      12:19:18 up 53 min,  1 user,  load average: 0.41, 0.54, 0.57
     
* Memory usage (free -m):
                    total        used        free      shared  buff/cache   available
     Mem:           15235        3736        1020         208       10478       10959
     Swap:           8191           0        8191
     
* Top 5 CPU hogs (ps axuScnh | awk '$2!=30346' | sort -rnk3 | head -5):
         1000    2684 13.9  2.2 5923996 352508 ?      Ssl  11:27   7:15 gnome-shell
         1000    5074  6.3  2.6 34224832 406072 ?     SLl  11:27   3:18 brave
         1000    5301  6.0  1.4 1179165040 226432 ?   Sl   11:27   3:06 brave
         1000   29620  5.8  1.3 1183416952 203192 ?   Sl   12:17   0:06 brave
         1000   12465  5.7  1.6 1183445104 264676 ?   Sl   11:37   2:22 brave
     
* Top 5 Memory hogs (ps axuScnh | sort -rnk4 | head -5):
         1000    3561  2.9  3.6 1735172 571376 ?      Sl   11:27   1:33 gnome-software
         1000    5074  6.3  2.6 34224832 406072 ?     SLl  11:27   3:18 brave
         1000    2684 13.9  2.2 5923996 352508 ?      Ssl  11:27   7:15 gnome-shell
            0    1723  0.7  2.2 1024828 345392 ?      Ssl  11:26   0:25 packagekitd
         1000   12465  5.7  1.6 1183445104 264676 ?   Sl   11:37   2:22 brave
     
* Disk space usage (df -hT):
     Filesystem     Type      Size  Used Avail Use% Mounted on
     devtmpfs       devtmpfs  4.0M     0  4.0M   0% /dev
     tmpfs          tmpfs     7.5G     0  7.5G   0% /dev/shm
     tmpfs          tmpfs     3.0G  2.3M  3.0G   1% /run
     /dev/nvme0n1p3 btrfs     953G  530G  421G  56% /
     /dev/nvme0n1p3 btrfs     953G  530G  421G  56% /home
     /dev/nvme0n1p2 ext4      974M  307M  600M  34% /boot
     /dev/nvme0n1p1 vfat      599M   21M  579M   4% /boot/efi
     tmpfs          tmpfs     7.5G  272K  7.5G   1% /tmp
     tmpfs          tmpfs     1.5G   12M  1.5G   1% /run/user/1000
     
* Block devices (blkid):
     /dev/nvme0n1p3: LABEL="fedora_localhost-live" UUID="9c52374b-7623-4f3d-9a5d-f2056a81c79e" UUID_SUB="1e9e93b6-7444-4807-a251-4ed0c1e09341" BLOCK_SIZE="4096" TYPE="btrfs" PARTUUID="a0199a7f-544d-4b8f-b9ef-b0f3d6f71e07"
     /dev/nvme0n1p1: UUID="C44C-303B" BLOCK_SIZE="512" TYPE="vfat" PARTLABEL="EFI System Partition" PARTUUID="43583475-4d3d-445b-a748-6d3c6c062bec"
     /dev/nvme0n1p2: UUID="916f8f55-115a-49c7-9ca6-9d3737d5b4f7" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="bbe74274-be63-4bd3-ac30-367f148e3267"
     /dev/nvme1n1p1: LABEL="fedora_localhost-live" UUID="9c52374b-7623-4f3d-9a5d-f2056a81c79e" UUID_SUB="aa9d4adf-1abd-4652-8ff5-78138b9579d1" BLOCK_SIZE="4096" TYPE="btrfs" PARTUUID="44ae203f-981a-4c1f-afe8-495ed6f1a635"
     /dev/zram0: LABEL="zram0" UUID="5f4e841f-1630-4421-9e92-80c67344cd4b" TYPE="swap"
     
* PCI devices (lspci -nn):
     00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex [1022:1630]
     00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU [1022:1631]
     00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
     00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1633]
     00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
     00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:02.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:02.4 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
     00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
     00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
     00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51)
     00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
     00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 0 [1022:166a]
     00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 1 [1022:166b]
     00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 2 [1022:166c]
     00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 3 [1022:166d]
     00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 4 [1022:166e]
     00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 5 [1022:166f]
     00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 6 [1022:1670]
     00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 7 [1022:1671]
     01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA104M [GeForce RTX 3070 Mobile / Max-Q] [10de:24dd] (rev a1)
     01:00.1 Audio device [0403]: NVIDIA Corporation GA104 High Definition Audio Controller [10de:228b] (rev a1)
     02:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Black SN750 / PC SN730 NVMe SSD [15b7:5006]
     03:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
     04:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6 AX200 [8086:2723] (rev 1a)
     05:00.0 Non-Volatile memory controller [0108]: ADATA Technology Co., Ltd. XPG SX8200 Pro PCIe Gen3x4 M.2 2280 Solid State Drive [1cc1:8201] (rev 03)
     06:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [1002:1638] (rev c6)
     06:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df]
     06:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639]
     06:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639]
     06:00.5 Multimedia controller [0480]: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor [1022:15e2] (rev 01)
     06:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3]
     07:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
     07:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
     
* USB devices (lsusb):
     Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 003 Device 003: ID 8087:0029 Intel Corp. AX200 Bluetooth
     Bus 003 Device 002: ID 046d:c31c Logitech, Inc. Keyboard K120
     Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     Bus 002 Device 002: ID 05e3:0620 Genesys Logic, Inc. GL3523 Hub
     Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 001 Device 003: ID 048d:c101 Integrated Technology Express, Inc. ITE Device(8910)
     Bus 001 Device 005: ID 046d:c547 Logitech, Inc. USB Receiver
     Bus 001 Device 002: ID 05e3:0610 Genesys Logic, Inc. Hub
     Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     
* DRM Information (journalctl -k -b | grep -o 'kernel:.*drm.*$' | cut -d ' ' -f 2- ):
     Command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.17.14-300.fc36.x86_64 root=UUID=9c52374b-7623-4f3d-9a5d-f2056a81c79e ro rootflags=subvol=root rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init rhgb quiet
     The simpledrm driver will not be probed
     Kernel command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.17.14-300.fc36.x86_64 root=UUID=9c52374b-7623-4f3d-9a5d-f2056a81c79e ro rootflags=subvol=root rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init rhgb quiet
     blacklisting initcall simpledrm_platform_driver_init
     ACPI: bus type drm_connector registered
     initcall simpledrm_platform_driver_init blacklisted
     [drm] amdgpu kernel modesetting enabled.
     [drm] initializing kernel modesetting (RENOIR 0x1002:0x1638 0x17AA:0x3A4F 0xC6).
     [drm] register mmio base: 0xD1500000
     [drm] register mmio size: 524288
     [drm] add ip block number 0 <soc15_common>
     [drm] add ip block number 1 <gmc_v9_0>
     [drm] add ip block number 2 <vega10_ih>
     [drm] add ip block number 3 <psp>
     [drm] add ip block number 4 <smu>
     [drm] add ip block number 5 <dm>
     [drm] add ip block number 6 <gfx_v9_0>
     [drm] add ip block number 7 <sdma_v4_0>
     [drm] add ip block number 8 <vcn_v2_0>
     [drm] add ip block number 9 <jpeg_v2_0>
     [drm] VCN decode is enabled in VM mode
     [drm] VCN encode is enabled in VM mode
     [drm] JPEG decode is enabled in VM mode
     [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
     [drm] Detected VRAM RAM=512M, BAR=512M
     [drm] RAM width 128bits DDR4
     [drm] amdgpu: 512M of VRAM memory ready
     [drm] amdgpu: 3072M of GTT memory ready.
     [drm] GART: num cpu pages 262144, num gpu pages 262144
     [drm] PCIE GART of 1024M enabled.
     [drm] PTB located at 0x000000F400900000
     [drm] Loading DMUB firmware via PSP: version=0x01010020
     [drm] Found VCN firmware Version ENC: 1.17 DEC: 5 VEP: 0 Revision: 2
     [drm] reserve 0x400000 from 0xf41f800000 for PSP TMR
     [drm] Display Core initialized with v3.2.167!
     [drm] DMUB hardware initialized: version=0x01010020
     [drm] kiq ring mec 2 pipe 1 q 0
     [drm] VCN decode and encode initialized successfully(under DPG Mode).
     [drm] JPEG decode initialized successfully.
     [drm] Initialized amdgpu 3.44.0 20150101 for 0000:06:00.0 on minor 0
     fbcon: amdgpudrmfb (fb0) is primary device
     amdgpu 0000:06:00.0: [drm] fb0: amdgpudrmfb frame buffer device
     [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
     [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 1
     
* Xorg modules (grep LoadModule /var/log/Xorg.0.log ~/.local/share/xorg/Xorg.0.log | cut -d \" -f 2 | xargs):
     
     
* GL Support (glxinfo | grep -E "OpenGL version|OpenGL renderer"):
     OpenGL renderer string: AMD RENOIR (LLVM 14.0.0, DRM 3.44, 5.17.14-300.fc36.x86_64)
     OpenGL version string: 4.6 (Compatibility Profile) Mesa 22.1.2
     
* Xorg errors (without results: "grep '^\[.*(EE)' /var/log/Xorg.0.log ~/.local/share/xorg/Xorg.0.log | cut -d ':' -f 2- "):
     N/A

* Kernel buffer tail (dmesg | tail):
     [   97.100185] wlp4s0: deauthenticating from d8:0d:17:66:5f:37 by local choice (Reason: 3=DEAUTH_LEAVING)
     [   97.131862] Generic FE-GE Realtek PHY r8169-0-300:00: attached PHY driver (mii_bus:phy_addr=r8169-0-300:00, irq=MAC)
     [   97.298595] r8169 0000:03:00.0 eno1: Link is Down
     [   98.973587] wlp4s0: authenticate with d8:0d:17:66:5f:37
     [   98.987857] wlp4s0: send auth to d8:0d:17:66:5f:37 (try 1/3)
     [   99.019289] wlp4s0: authenticated
     [   99.019846] wlp4s0: associate with d8:0d:17:66:5f:37 (try 1/3)
     [   99.027193] wlp4s0: RX AssocResp from d8:0d:17:66:5f:37 (capab=0x911 status=0 aid=2)
     [   99.060244] wlp4s0: associated
     [   99.065340] wlp4s0: Limiting TX power to 20 (20 - 0) dBm as advertised by d8:0d:17:66:5f:37
     
* Last few reboots (last -x -n10 reboot runlevel):
     runlevel (to lvl 5)   5.17.14-300.fc36 Thu Jun 23 11:26   still running
     reboot   system boot  5.17.14-300.fc36 Thu Jun 23 11:26   still running
     runlevel (to lvl 5)   5.17.14-300.fc36 Wed Jun 22 23:50 - 00:01  (00:10)
     reboot   system boot  5.17.14-300.fc36 Wed Jun 22 23:50 - 00:01  (00:10)
     runlevel (to lvl 5)   5.17.14-300.fc36 Wed Jun 22 22:32 - 23:50  (01:17)
     reboot   system boot  5.17.14-300.fc36 Wed Jun 22 22:32 - 23:50  (01:17)
     runlevel (to lvl 5)   5.17.14-300.fc36 Wed Jun 22 22:28 - 22:32  (00:03)
     reboot   system boot  5.17.14-300.fc36 Wed Jun 22 22:28 - 22:32  (00:03)
     runlevel (to lvl 5)   5.17.14-300.fc36 Wed Jun 22 20:43 - 22:28  (01:45)
     reboot   system boot  5.17.14-300.fc36 Wed Jun 22 20:43 - 22:28  (01:45)
     
     wtmp begins Tue Jun 14 07:23:40 2022
     
* DNF Repositories (dnf repolist):
     repo id                         repo name
     code                            Visual Studio Code
     fedora                          Fedora 36 - x86_64
     fedora-cisco-openh264           Fedora 36 openh264 (From Cisco) - x86_64
     fedora-modular                  Fedora Modular 36 - x86_64
     google-chrome                   google-chrome
     phracek-PyCharm                 Copr repo for PyCharm owned by phracek
     rpmfusion-free                  RPM Fusion for Fedora 36 - Free
     rpmfusion-free-updates          RPM Fusion for Fedora 36 - Free - Updates
     rpmfusion-nonfree               RPM Fusion for Fedora 36 - Nonfree
     rpmfusion-nonfree-nvidia-driver RPM Fusion for Fedora 36 - Nonfree - NVIDIA Driver
     rpmfusion-nonfree-steam         RPM Fusion for Fedora 36 - Nonfree - Steam
     rpmfusion-nonfree-updates       RPM Fusion for Fedora 36 - Nonfree - Updates
     rpmsphere                       RPM Sphere - Basearch
     rpmsphere-noarch                RPM Sphere - Noarch
     updates                         Fedora 36 - x86_64 - Updates
     updates-modular                 Fedora Modular 36 - x86_64 - Updates
     virtualbox                      Fedora 36 - x86_64 - VirtualBox
     
* DNF Extras (dnf -C list extras):
     Last metadata expiration check: 0:27:49 ago on Thu 23 Jun 2022 11:51:32 MSK.
     Extra Packages
     expressvpn.x86_64                            3.25.0.13-1           @@commandline
     kmod-nvidia-5.17.13-300.fc36.x86_64.x86_64   3:510.68.02-2.fc36    @@commandline
     kmod-nvidia-5.17.14-300.fc36.x86_64.x86_64   3:510.68.02-2.fc36    @@commandline
     kmod-nvidia-5.18.5-200.fc36.x86_64.x86_64    3:510.68.02-2.fc36    @@commandline
     
* Last 20 packages installed (rpm -qa --nodigest --nosignature --last | head -20):
     qt5-qtbase-devel-5.15.3-3.fc36.x86_64         Thu 23 Jun 2022 11:48:16 MSK
     google-roboto-mono-fonts-3.000-0.1.20220620git.fc36.noarch Thu 23 Jun 2022 11:48:16 MSK
     qt5-qtbase-gui-5.15.3-3.fc36.x86_64           Thu 23 Jun 2022 11:48:15 MSK
     qt5-qtbase-common-5.15.3-3.fc36.noarch        Thu 23 Jun 2022 11:48:15 MSK
     qt5-qtbase-5.15.3-3.fc36.x86_64               Thu 23 Jun 2022 11:48:15 MSK
     kf5-syntax-highlighting-5.94.0-1.fc36.x86_64  Thu 23 Jun 2022 11:48:15 MSK
     kf5-filesystem-5.94.0-1.fc36.x86_64           Thu 23 Jun 2022 11:48:15 MSK
     xorg-x11-drv-nvidia-cuda-510.68.02-2.fc36.x86_64 Wed 22 Jun 2022 20:40:58 MSK
     kernel-devel-matched-5.18.5-200.fc36.x86_64   Wed 22 Jun 2022 20:40:58 MSK
     akmods-0.5.7-8.fc36.noarch                    Wed 22 Jun 2022 20:40:58 MSK
     akmod-nvidia-510.68.02-2.fc36.x86_64          Wed 22 Jun 2022 20:40:58 MSK
     kernel-devel-5.18.5-200.fc36.x86_64           Wed 22 Jun 2022 20:40:48 MSK
     rpmdevtools-9.6-1.fc36.noarch                 Wed 22 Jun 2022 20:40:41 MSK
     rpm-build-4.17.0-10.fc36.x86_64               Wed 22 Jun 2022 20:40:41 MSK
     python3-rpmautospec-0.2.6-1.fc36.noarch       Wed 22 Jun 2022 20:40:41 MSK
     python3-requests-gssapi-1.2.3-4.fc36.noarch   Wed 22 Jun 2022 20:40:41 MSK
     python3-pygit2-1.7.1-3.fc36.x86_64            Wed 22 Jun 2022 20:40:41 MSK
     python3-koji-1.29.0-1.fc36.noarch             Wed 22 Jun 2022 20:40:41 MSK
     python3-gssapi-1.7.2-2.fc36.x86_64            Wed 22 Jun 2022 20:40:41 MSK
     python3-decorator-5.1.1-2.fc36.noarch         Wed 22 Jun 2022 20:40:41 MSK
     
* EFI boot manager output (efibootmgr -v):
     BootCurrent: 0001
     Timeout: 0 seconds
     BootOrder: 0001,0004,2002,2001,2003
     Boot0001* Fedora	HD(1,GPT,43583475-4d3d-445b-a748-6d3c6c062bec,0x800,0x12c000)/File(\EFI\fedora\shimx64.efi)
     Boot0002* EFI PXE 0 for IPv4 (84-A9-38-6A-64-56) 	PciRoot(0x0)/Pci(0x2,0x1)/Pci(0x0,0x0)/MAC(84a9386a6456,0)/IPv4(0.0.0.00.0.0.0,0,0)RC
     Boot0003* EFI PXE 0 for IPv6 (84-A9-38-6A-64-56) 	PciRoot(0x0)/Pci(0x2,0x1)/Pci(0x0,0x0)/MAC(84a9386a6456,0)/IPv6([::]:<->[::]:,0,0)RC
     Boot0004* Fedora	HD(1,GPT,43583475-4d3d-445b-a748-6d3c6c062bec,0x800,0x12c000)/File(\EFI\fedora\shim.efi)RC
     Boot2001* EFI USB Device	RC
     Boot2002* EFI DVD/CDROM	RC
     Boot2003* EFI Network	RC
5

btrfsinfo:

=== fpaste 0.4.2.0 System Information ===
* Kernel (uname -r ; cat /proc/cmdline):
     5.17.14-300.fc36.x86_64
     BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.17.14-300.fc36.x86_64 root=UUID=9c52374b-7623-4f3d-9a5d-f2056a81c79e ro rootflags=subvol=root rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init rhgb quiet
     
* btrfs-progs (rpm -q btrfs-progs):
     btrfs-progs-5.18-1.fc36.x86_64
     
* btrfs mounts (grep btrfs /proc/mounts):
     /dev/nvme0n1p3 / btrfs rw,seclabel,relatime,compress=zstd:1,ssd,space_cache=v2,subvolid=257,subvol=/root 0 0
     /dev/nvme0n1p3 /home btrfs rw,seclabel,relatime,compress=zstd:1,ssd,space_cache=v2,subvolid=256,subvol=/home 0 0
     
* block devices (lsblk -o NAME,FSTYPE,SIZE,FSUSE%,MOUNTPOINT,UUID,MIN-IO,SCHED,DISC-GRAN,MODEL):
     NAME        FSTYPE   SIZE FSUSE% MOUNTPOINT UUID                                 MIN-IO SCHED DISC-GRAN MODEL
     zram0                  8G        [SWAP]                                            4096              4K 
     nvme0n1            476.9G                                                           512 none       512B WDC PC SN730 SDBPNTY-512G-1101
     ├─nvme0n1p1 vfat     600M     3% /boot/efi  C44C-303B                               512 none       512B 
     ├─nvme0n1p2 ext4       1G    32% /boot      916f8f55-115a-49c7-9ca6-9d3737d5b4f7    512 none       512B 
     └─nvme0n1p3 btrfs  475.4G    56% /home      9c52374b-7623-4f3d-9a5d-f2056a81c79e    512 none       512B 
     nvme1n1            476.9G                                                           512 none       512B ADATA SX8200PNP
     └─nvme1n1p1 btrfs  476.9G                   9c52374b-7623-4f3d-9a5d-f2056a81c79e    512 none       512B 
     
* Kernel messages (journalctl -k -o short-monotonic --no-hostname | grep "Linux version\| ata\|Btrfs\|BTRFS\|] hd\| scsi\| sd\| sdhci\| mmc\| nvme\| usb\| vd"):
     [    0.000000] kernel: Linux version 5.17.14-300.fc36.x86_64 (mockbuild@bkernel02.iad2.fedoraproject.org) (gcc (GCC) 12.1.1 20220507 (Red Hat 12.1.1-1), GNU ld version 2.37-27.fc36) #1 SMP PREEMPT Thu Jun 9 13:41:46 UTC 2022
     [    0.267122] kernel: usbcore: registered new interface driver usbfs
     [    0.267122] kernel: usbcore: registered new interface driver hub
     [    0.267122] kernel: usbcore: registered new device driver usb
     [    0.667226] kernel: scsi host0: ahci
     [    0.667278] kernel: ata1: SATA max UDMA/133 abar m2048@0xd1101000 port 0xd1101100 irq 34
     [    0.667525] kernel: scsi host1: ahci
     [    0.667545] kernel: ata2: SATA max UDMA/133 abar m2048@0xd1100000 port 0xd1100100 irq 36
     [    0.668114] kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.17
     [    0.668116] kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.668117] kernel: usb usb1: Product: xHCI Host Controller
     [    0.668118] kernel: usb usb1: Manufacturer: Linux 5.17.14-300.fc36.x86_64 xhci-hcd
     [    0.668119] kernel: usb usb1: SerialNumber: 0000:06:00.3
     [    0.668334] kernel: usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
     [    0.668344] kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.17
     [    0.668345] kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.668346] kernel: usb usb2: Product: xHCI Host Controller
     [    0.668346] kernel: usb usb2: Manufacturer: Linux 5.17.14-300.fc36.x86_64 xhci-hcd
     [    0.668347] kernel: usb usb2: SerialNumber: 0000:06:00.3
     [    0.668848] kernel: usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.17
     [    0.668849] kernel: usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.668850] kernel: usb usb3: Product: xHCI Host Controller
     [    0.668851] kernel: usb usb3: Manufacturer: Linux 5.17.14-300.fc36.x86_64 xhci-hcd
     [    0.668851] kernel: usb usb3: SerialNumber: 0000:06:00.4
     [    0.669061] kernel: usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
     [    0.669071] kernel: usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.17
     [    0.669072] kernel: usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.669073] kernel: usb usb4: Product: xHCI Host Controller
     [    0.669074] kernel: usb usb4: Manufacturer: Linux 5.17.14-300.fc36.x86_64 xhci-hcd
     [    0.669074] kernel: usb usb4: SerialNumber: 0000:06:00.4
     [    0.669221] kernel: usbcore: registered new interface driver usbserial_generic
     [    0.669223] kernel: usbserial: USB Serial support registered for generic
     [    0.672306] kernel: usbcore: registered new interface driver usbhid
     [    0.672306] kernel: usbhid: USB HID core driver
     [    0.692450] kernel: Btrfs loaded, crc32c=crc32c-generic, zoned=yes, fsverity=yes
     [    0.912084] kernel: usb 1-2: new high-speed USB device number 2 using xhci_hcd
     [    0.912110] kernel: usb 3-2: new low-speed USB device number 2 using xhci_hcd
     [    0.974489] kernel: ata1: SATA link down (SStatus 0 SControl 300)
     [    0.974487] kernel: ata2: SATA link down (SStatus 0 SControl 300)
     [    1.047233] kernel: usb 1-2: New USB device found, idVendor=05e3, idProduct=0610, bcdDevice=71.00
     [    1.047237] kernel: usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.047238] kernel: usb 1-2: Product: USB2.1 Hub
     [    1.047240] kernel: usb 1-2: Manufacturer: GenesysLogic
     [    1.059158] kernel: usb 3-2: New USB device found, idVendor=046d, idProduct=c31c, bcdDevice=49.20
     [    1.059161] kernel: usb 3-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.059163] kernel: usb 3-2: Product: USB Keyboard
     [    1.059164] kernel: usb 3-2: Manufacturer: Logitech
     [    1.162804] kernel: usb 2-2: new SuperSpeed USB device number 2 using xhci_hcd
     [    1.185170] kernel: usb 2-2: New USB device found, idVendor=05e3, idProduct=0620, bcdDevice=71.00
     [    1.185179] kernel: usb 2-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.185183] kernel: usb 2-2: Product: USB3.2 Hub
     [    1.185185] kernel: usb 2-2: Manufacturer: GenesysLogic
     [    1.213254] kernel: usb: port power management may be unreliable
     [    1.220391] kernel: hid-generic 0003:046D:C31C.0001: input,hidraw0: USB HID v1.10 Keyboard [Logitech USB Keyboard] on usb-0000:06:00.4-2/input0
     [    1.287507] kernel: hid-generic 0003:046D:C31C.0002: input,hidraw1: USB HID v1.10 Device [Logitech USB Keyboard] on usb-0000:06:00.4-2/input1
     [    1.296095] kernel: usb 1-4: new full-speed USB device number 3 using xhci_hcd
     [    1.402078] kernel: usb 3-4: new full-speed USB device number 3 using xhci_hcd
     [    1.469371] kernel: usb 1-4: New USB device found, idVendor=048d, idProduct=c101, bcdDevice= 7.00
     [    1.469374] kernel: usb 1-4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.469375] kernel: usb 1-4: Product: ITE Device(8910)
     [    1.469376] kernel: usb 1-4: Manufacturer: ITE Tech. Inc.
     [    1.527855] kernel: usb 1-2.1: new full-speed USB device number 4 using xhci_hcd
     [    1.544105] kernel: hid-generic 0003:048D:C101.0003: input,hiddev96,hidraw2: USB HID v1.10 Keyboard [ITE Tech. Inc. ITE Device(8910)] on usb-0000:06:00.3-4/input0
     [    1.556099] kernel: usb 3-4: New USB device found, idVendor=8087, idProduct=0029, bcdDevice= 0.01
     [    1.556103] kernel: usb 3-4: New USB device strings: Mfr=0, Product=0, SerialNumber=0
     [    1.649364] kernel: usb 1-2.1: New USB device found, idVendor=046d, idProduct=c547, bcdDevice= 4.00
     [    1.649368] kernel: usb 1-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.649369] kernel: usb 1-2.1: Product: USB Receiver
     [    1.649371] kernel: usb 1-2.1: Manufacturer: Logitech
     [    1.766260] kernel: hid-generic 0003:046D:C547.0004: input,hidraw3: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:06:00.3-2.1/input0
     [    1.822079] kernel: hid-generic 0003:046D:C547.0005: input,hidraw4: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:06:00.3-2.1/input1
     [    1.824514] kernel: hid-generic 0003:046D:C547.0006: hiddev97,hidraw5: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:06:00.3-2.1/input2
     [    1.848026] kernel: nvme nvme0: pci function 0000:02:00.0
     [    1.848096] kernel: nvme nvme1: pci function 0000:05:00.0
     [    1.857499] kernel: nvme nvme0: 16/0/0 default/read/poll queues
     [    1.859234] kernel: nvme nvme1: 15/0/0 default/read/poll queues
     [    1.861216] kernel:  nvme0n1: p1 p2 p3
     [    1.863318] kernel:  nvme1n1: p1
     [    1.944070] kernel: BTRFS: device label fedora_localhost-live devid 2 transid 70331 /dev/nvme1n1p1 scanned by systemd-udevd (422)
     [    1.945355] kernel: BTRFS: device label fedora_localhost-live devid 1 transid 70331 /dev/nvme0n1p3 scanned by systemd-udevd (417)
     [    3.161651] kernel: amdgpu 0000:06:00.0: amdgpu: ring sdma0 uses VM inv eng 0 on hub 1
     [    3.240863] kernel: BTRFS info (device nvme0n1p3): flagging fs with big metadata feature
     [    3.240868] kernel: BTRFS info (device nvme0n1p3): using free space tree
     [    3.240869] kernel: BTRFS info (device nvme0n1p3): has skinny extents
     [    3.325529] kernel: BTRFS info (device nvme0n1p3): enabling ssd optimizations
     [    4.577012] kernel: BTRFS info (device nvme0n1p3): use zstd compression, level 1
     [    4.577014] kernel: BTRFS info (device nvme0n1p3): using free space tree
     [    5.010240] kernel: usbcore: registered new interface driver btusb
     [   66.023746] kernel: usb 1-2.1: USB disconnect, device number 4
     [   67.403850] kernel: usb 1-2.1: new full-speed USB device number 5 using xhci_hcd
     [   67.525500] kernel: usb 1-2.1: New USB device found, idVendor=046d, idProduct=c547, bcdDevice= 4.00
     [   67.525505] kernel: usb 1-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [   67.525506] kernel: usb 1-2.1: Product: USB Receiver
     [   67.525507] kernel: usb 1-2.1: Manufacturer: Logitech
     [   67.631795] kernel: hid-generic 0003:046D:C547.0008: input,hidraw3: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:06:00.3-2.1/input0
     [   67.688056] kernel: hid-generic 0003:046D:C547.0009: input,hidraw4: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:06:00.3-2.1/input1
     [   67.690617] kernel: hid-generic 0003:046D:C547.000A: hiddev97,hidraw5: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:06:00.3-2.1/input2
     
* btrfs usage (btrfs filesystem usage -T /):
     Overall:
         Device size:		 952.29GiB
         Device allocated:		 557.02GiB
         Device unallocated:		 395.27GiB
         Device missing:		     0.00B
         Used:			 528.73GiB
         Free (estimated):		 420.97GiB	(min: 223.34GiB)
         Free (statfs, df):		 420.97GiB
         Data ratio:			      1.00
         Metadata ratio:		      2.00
         Global reserve:		 512.00MiB	(used: 0.00B)
         Multiple profiles:		        no
     
                       Data      Metadata System              
     Id Path           single    RAID1    RAID1    Unallocated
     -- -------------- --------- -------- -------- -----------
      1 /dev/nvme0n1p3 274.01GiB  3.00GiB  8.00MiB   198.34GiB
      2 /dev/nvme1n1p1 277.00GiB  3.00GiB  8.00MiB   196.93GiB
     -- -------------- --------- -------- -------- -----------
        Total          551.01GiB  3.00GiB  8.00MiB   395.27GiB
        Used           525.30GiB  1.71GiB 80.00KiB            
     
* FSUUID (findmnt -n -o UUID $(stat -c '%m' "/")):
     9c52374b-7623-4f3d-9a5d-f2056a81c79e
     
* btrfs allocations (FSUUID=$(findmnt -n -o UUID $(stat -c '%m' "/")); grep -R . /sys/fs/btrfs/"$FSUUID"/allocation/ | sed "s/^.*allocation//"):
     /metadata/raid1/used_bytes:1837236224
     /metadata/raid1/total_bytes:3221225472
     /metadata/disk_used:3674472448
     /metadata/bytes_pinned:983040
     /metadata/bytes_used:1837236224
     /metadata/disk_total:6442450944
     /metadata/total_bytes:3221225472
     /metadata/bytes_reserved:1277952
     /metadata/bytes_readonly:131072
     /metadata/bytes_zone_unusable:0
     /metadata/bytes_may_use:760610816
     /metadata/flags:4
     /system/raid1/used_bytes:81920
     /system/raid1/total_bytes:8388608
     /system/disk_used:163840
     /system/bytes_pinned:0
     /system/bytes_used:81920
     /system/disk_total:16777216
     /system/total_bytes:8388608
     /system/bytes_reserved:0
     /system/bytes_readonly:0
     /system/bytes_zone_unusable:0
     /system/bytes_may_use:0
     /system/flags:2
     /global_rsv_reserved:536870912
     /data/disk_used:564041818112
     /data/bytes_pinned:0
     /data/bytes_used:564041818112
     /data/single/used_bytes:564041818112
     /data/single/total_bytes:591640133632
     /data/disk_total:591640133632
     /data/total_bytes:591640133632
     /data/bytes_reserved:864256
     /data/bytes_readonly:131072
     /data/bytes_zone_unusable:0
     /data/bytes_may_use:532480
     /data/flags:1
     /global_rsv_size:536870912
     
* btrfs features (FSUUID=$(findmnt -n -o UUID $(stat -c '%m' "/")); grep -R . /sys/fs/btrfs/"$FSUUID"/features/ | sed "s/^.*features//"):
     /mixed_backref:1
     /free_space_tree:1
     /no_holes:1
     /compress_zstd:1
     /skinny_metadata:1
     /extended_iref:1
     
* btrfs checksum (FSUUID=$(findmnt -n -o UUID $(stat -c '%m' "/")); cat /sys/fs/btrfs/"$FSUUID"/checksum):
     crc32c (crc32c-intel)
6

This shows in the working case that the kernel nvme driver finds both nvme drives pretty much at the same time. I wonder if this happens in the failure case too?

We need a way to get to a prompt. Like a systemd timeout for all devices after say 15 seconds. If we can get to a prompt, we can get dmesg out. And we need to see if the kernel has seen both of the nvme drives yet or not.

In my testing with a VM, with a 2 disk default installation, then remove the drive with the single partition btrfs volume - I get this same hang as reported, but when I hot add the missing drive, the system immediately resumes booting as I expect. So we really need to establish if both NVMe are present. If not, why not?

7

I have 3 ssd’s and originally I set two up as raid 1 and did the install with / and /var on the raid drives and /home on the third drive. I didn’t do an auto partition at install. I never encountered that problem in my setup but the two drives in the raid array were from different mfg and bought at different times, so one was faster, maybe it was just always ahead of the other.
In any case I have now the three drives set up as different btrfs volumes with their own subvol’s / then /var then /home which will not work correctly with Silverblue, so now I have to use Workstation.

8

This is my sudo fpaste --btrfsinfo --printonly report. The thing that is strange to me is this line:

     [    1.813990] kernel: nvme nvme1: missing or invalid SUBNQN field.

And this is the whole report:

=== fpaste 0.4.2.0 System Information ===
* Kernel (uname -r ; cat /proc/cmdline):
     5.18.5-200.fc36.x86_64
     BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.18.5-200.fc36.x86_64 root=UUID=5cc459bb-cd95-48b7-8fa2-e72ea854bc12 ro rootflags=subvol=root rhgb quiet rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init
     
* btrfs-progs (rpm -q btrfs-progs):
     btrfs-progs-5.18-1.fc36.x86_64
     
* btrfs mounts (grep btrfs /proc/mounts):
     /dev/nvme0n1p3 / btrfs rw,seclabel,relatime,compress=zstd:1,ssd,space_cache=v2,subvolid=257,subvol=/root 0 0
     /dev/nvme0n1p3 /home btrfs rw,seclabel,relatime,compress=zstd:1,ssd,space_cache=v2,subvolid=256,subvol=/home 0 0
     /dev/nvme0n1p3 /var/lib/docker/btrfs btrfs rw,seclabel,relatime,compress=zstd:1,ssd,space_cache=v2,subvolid=257,subvol=/root 0 0
     
* block devices (lsblk -o NAME,FSTYPE,SIZE,FSUSE%,MOUNTPOINT,UUID,MIN-IO,SCHED,DISC-GRAN,MODEL):
     NAME        FSTYPE   SIZE FSUSE% MOUNTPOINT            UUID                                 MIN-IO SCHED DISC-GRAN MODEL
     zram0                  8G        [SWAP]                                                       4096              4K 
     nvme1n1            476.9G                                                                      512 none       512B GIGABYTE GP-GSM2NE3512GNTD
     └─nvme1n1p1 btrfs  476.9G                              5cc459bb-cd95-48b7-8fa2-e72ea854bc12    512 none       512B 
     nvme0n1            476.9G                                                                      512 none       512B SKHynix_HFS512GDE9X084N
     ├─nvme0n1p1 vfat     600M     2% /boot/efi             96A5-C478                               512 none       512B 
     ├─nvme0n1p2 ext4       1G    32% /boot                 95613f08-00c0-4721-8dba-a6dafc736a09    512 none       512B 
     └─nvme0n1p3 btrfs  475.4G    30% /var/lib/docker/btrfs 5cc459bb-cd95-48b7-8fa2-e72ea854bc12    512 none       512B 
     
* Kernel messages (journalctl -k -o short-monotonic --no-hostname | grep "Linux version\| ata\|Btrfs\|BTRFS\|] hd\| scsi\| sd\| sdhci\| mmc\| nvme\| usb\| vd"):
     [    0.000000] kernel: Linux version 5.18.5-200.fc36.x86_64 (mockbuild@bkernel01.iad2.fedoraproject.org) (gcc (GCC) 12.1.1 20220507 (Red Hat 12.1.1-1), GNU ld version 2.37-27.fc36) #1 SMP PREEMPT_DYNAMIC Thu Jun 16 14:51:11 UTC 2022
     [    0.258438] kernel: usbcore: registered new interface driver usbfs
     [    0.258438] kernel: usbcore: registered new interface driver hub
     [    0.258438] kernel: usbcore: registered new device driver usb
     [    0.757348] kernel: scsi host0: ahci
     [    0.757399] kernel: ata1: SATA max UDMA/133 abar m2048@0xd1101000 port 0xd1101100 irq 34
     [    0.757657] kernel: scsi host1: ahci
     [    0.757686] kernel: ata2: SATA max UDMA/133 abar m2048@0xd1100000 port 0xd1100100 irq 36
     [    0.758495] kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.18
     [    0.758497] kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.758498] kernel: usb usb1: Product: xHCI Host Controller
     [    0.758499] kernel: usb usb1: Manufacturer: Linux 5.18.5-200.fc36.x86_64 xhci-hcd
     [    0.758501] kernel: usb usb1: SerialNumber: 0000:06:00.3
     [    0.758751] kernel: usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
     [    0.758767] kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.18
     [    0.758768] kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.758769] kernel: usb usb2: Product: xHCI Host Controller
     [    0.758770] kernel: usb usb2: Manufacturer: Linux 5.18.5-200.fc36.x86_64 xhci-hcd
     [    0.758770] kernel: usb usb2: SerialNumber: 0000:06:00.3
     [    0.759440] kernel: usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.18
     [    0.759442] kernel: usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.759443] kernel: usb usb3: Product: xHCI Host Controller
     [    0.759444] kernel: usb usb3: Manufacturer: Linux 5.18.5-200.fc36.x86_64 xhci-hcd
     [    0.759444] kernel: usb usb3: SerialNumber: 0000:06:00.4
     [    0.759685] kernel: usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
     [    0.759719] kernel: usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.18
     [    0.759721] kernel: usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
     [    0.759723] kernel: usb usb4: Product: xHCI Host Controller
     [    0.759724] kernel: usb usb4: Manufacturer: Linux 5.18.5-200.fc36.x86_64 xhci-hcd
     [    0.759724] kernel: usb usb4: SerialNumber: 0000:06:00.4
     [    0.759918] kernel: usbcore: registered new interface driver usbserial_generic
     [    0.759922] kernel: usbserial: USB Serial support registered for generic
     [    0.765460] kernel: usbcore: registered new interface driver usbhid
     [    0.765461] kernel: usbhid: USB HID core driver
     [    0.805533] kernel: Btrfs loaded, crc32c=crc32c-generic, zoned=yes, fsverity=yes
     [    1.003012] kernel: usb 3-2: new high-speed USB device number 2 using xhci_hcd
     [    1.003032] kernel: usb 1-2: new high-speed USB device number 2 using xhci_hcd
     [    1.069600] kernel: ata2: SATA link down (SStatus 0 SControl 300)
     [    1.069600] kernel: ata1: SATA link down (SStatus 0 SControl 300)
     [    1.135732] kernel: usb 3-2: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=85.36
     [    1.135737] kernel: usb 3-2: New USB device strings: Mfr=0, Product=1, SerialNumber=0
     [    1.135739] kernel: usb 3-2: Product: USB2.0 Hub
     [    1.138142] kernel: usb 1-2: New USB device found, idVendor=05e3, idProduct=0610, bcdDevice=71.00
     [    1.138144] kernel: usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.138145] kernel: usb 1-2: Product: USB2.1 Hub
     [    1.138146] kernel: usb 1-2: Manufacturer: GenesysLogic
     [    1.252005] kernel: usb 2-2: new SuperSpeed USB device number 2 using xhci_hcd
     [    1.270149] kernel: usb 2-2: New USB device found, idVendor=05e3, idProduct=0620, bcdDevice=71.00
     [    1.270154] kernel: usb 2-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.270156] kernel: usb 2-2: Product: USB3.2 Hub
     [    1.270158] kernel: usb 2-2: Manufacturer: GenesysLogic
     [    1.293837] kernel: usb 3-3: new full-speed USB device number 3 using xhci_hcd
     [    1.303718] kernel: usb: port power management may be unreliable
     [    1.379733] kernel: usb 1-4: new full-speed USB device number 3 using xhci_hcd
     [    1.443467] kernel: usb 3-3: New USB device found, idVendor=048d, idProduct=c965, bcdDevice= 1.00
     [    1.443471] kernel: usb 3-3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.443473] kernel: usb 3-3: Product: ITE Device(8295)
     [    1.443475] kernel: usb 3-3: Manufacturer: ITE Tech. Inc.
     [    1.488712] kernel: usb 3-2.1: new full-speed USB device number 4 using xhci_hcd
     [    1.508888] kernel: hid-generic 0003:048D:C965.0001: input,hiddev96,hidraw0: USB HID v1.10 Keyboard [ITE Tech. Inc. ITE Device(8295)] on usb-0000:06:00.4-3/input0
     [    1.512551] kernel: hid-generic 0003:048D:C965.0002: hiddev97,hidraw1: USB HID v1.10 Device [ITE Tech. Inc. ITE Device(8295)] on usb-0000:06:00.4-3/input1
     [    1.556512] kernel: usb 1-4: New USB device found, idVendor=048d, idProduct=c101, bcdDevice= 7.00
     [    1.556515] kernel: usb 1-4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.556517] kernel: usb 1-4: Product: ITE Device(8910)
     [    1.556518] kernel: usb 1-4: Manufacturer: ITE Tech. Inc.
     [    1.584458] kernel: usb 3-2.1: New USB device found, idVendor=25a7, idProduct=fa23, bcdDevice= 2.41
     [    1.584460] kernel: usb 3-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.584461] kernel: usb 3-2.1: Product: 2.4G Receiver
     [    1.584462] kernel: usb 3-2.1: Manufacturer: Compx
     [    1.631954] kernel: hid-generic 0003:048D:C101.0003: input,hiddev98,hidraw2: USB HID v1.10 Keyboard [ITE Tech. Inc. ITE Device(8910)] on usb-0000:06:00.3-4/input0
     [    1.682725] kernel: usb 3-4: new full-speed USB device number 5 using xhci_hcd
     [    1.712886] kernel: hid-generic 0003:25A7:FA23.0004: input,hidraw3: USB HID v1.10 Keyboard [Compx 2.4G Receiver] on usb-0000:06:00.4-2.1/input0
     [    1.769942] kernel: hid-generic 0003:25A7:FA23.0005: input,hiddev99,hidraw4: USB HID v1.10 Mouse [Compx 2.4G Receiver] on usb-0000:06:00.4-2.1/input1
     [    1.800247] kernel: nvme nvme0: pci function 0000:02:00.0
     [    1.800312] kernel: nvme nvme1: pci function 0000:05:00.0
     [    1.813990] kernel: nvme nvme1: missing or invalid SUBNQN field.
     [    1.821465] kernel: usb 3-4: New USB device found, idVendor=0bda, idProduct=4852, bcdDevice= 0.00
     [    1.821468] kernel: usb 3-4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
     [    1.821469] kernel: usb 3-4: Product: Bluetooth Radio
     [    1.821470] kernel: usb 3-4: Manufacturer: Realtek
     [    1.821471] kernel: usb 3-4: SerialNumber: 00e04c000001
     [    1.843476] kernel: nvme nvme1: allocated 128 MiB host memory buffer.
     [    1.847885] kernel: nvme nvme1: 8/0/0 default/read/poll queues
     [    1.850117] kernel:  nvme1n1: p1
     [    1.873735] kernel: usb 3-2.4: new low-speed USB device number 6 using xhci_hcd
     [    1.875959] kernel: nvme nvme0: 16/0/0 default/read/poll queues
     [    1.885824] kernel:  nvme0n1: p1 p2 p3
     [    1.926836] kernel: BTRFS: device label fedora_localhost-live devid 2 transid 17926 /dev/nvme1n1p1 scanned by systemd-udevd (448)
     [    1.929464] kernel: BTRFS: device label fedora_localhost-live devid 1 transid 17926 /dev/nvme0n1p3 scanned by systemd-udevd (456)
     [    1.970523] kernel: usb 3-2.4: New USB device found, idVendor=1c4f, idProduct=0002, bcdDevice= 1.50
     [    1.970526] kernel: usb 3-2.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
     [    1.970528] kernel: usb 3-2.4: Product: USB Keyboard
     [    1.970529] kernel: usb 3-2.4: Manufacturer: SIGMACHIP
     [    2.097869] kernel: hid-generic 0003:1C4F:0002.0007: input,hidraw6: USB HID v1.10 Keyboard [SIGMACHIP USB Keyboard] on usb-0000:06:00.4-2.4/input0
     [    2.153849] kernel: hid-generic 0003:1C4F:0002.0008: input,hidraw7: USB HID v1.10 Device [SIGMACHIP USB Keyboard] on usb-0000:06:00.4-2.4/input1
     [    3.168205] kernel: amdgpu 0000:06:00.0: amdgpu: ring sdma0 uses VM inv eng 0 on hub 1
     [    3.248472] kernel: BTRFS info (device nvme0n1p3): flagging fs with big metadata feature
     [    3.248477] kernel: BTRFS info (device nvme0n1p3): using free space tree
     [    3.248478] kernel: BTRFS info (device nvme0n1p3): has skinny extents
     [    3.298744] kernel: BTRFS info (device nvme0n1p3): enabling ssd optimizations
     [    4.729181] kernel: BTRFS info (device nvme0n1p3: state M): use zstd compression, level 1
     [    4.729184] kernel: BTRFS info (device nvme0n1p3: state M): using free space tree
     [    5.324185] kernel: usbcore: registered new interface driver btusb
     
* btrfs usage (btrfs filesystem usage -T /):
     Overall:
         Device size:		 952.29GiB
         Device allocated:		 313.02GiB
         Device unallocated:		 639.27GiB
         Device missing:		     0.00B
         Used:			 287.27GiB
         Free (estimated):		 663.75GiB	(min: 344.12GiB)
         Free (statfs, df):		 663.75GiB
         Data ratio:			      1.00
         Metadata ratio:		      2.00
         Global reserve:		 489.47MiB	(used: 0.00B)
         Multiple profiles:		        no
     
                       Data      Metadata System              
     Id Path           single    RAID1    RAID1    Unallocated
     -- -------------- --------- -------- -------- -----------
      1 /dev/nvme0n1p3 150.01GiB  3.00GiB  8.00MiB   322.34GiB
      2 /dev/nvme1n1p1 157.00GiB  3.00GiB  8.00MiB   316.93GiB
     -- -------------- --------- -------- -------- -----------
        Total          307.01GiB  3.00GiB  8.00MiB   639.27GiB
        Used           282.52GiB  2.37GiB 64.00KiB            
     
* FSUUID (findmnt -n -o UUID $(stat -c '%m' "/")):
     5cc459bb-cd95-48b7-8fa2-e72ea854bc12
     
* btrfs allocations (FSUUID=$(findmnt -n -o UUID $(stat -c '%m' "/")); grep -R . /sys/fs/btrfs/"$FSUUID"/allocation/ | sed "s/^.*allocation//"):
     /metadata/raid1/used_bytes:2548891648
     /metadata/raid1/total_bytes:3221225472
     /metadata/disk_used:5097783296
     /metadata/bytes_pinned:98304
     /metadata/bytes_used:2548891648
     /metadata/disk_total:6442450944
     /metadata/total_bytes:3221225472
     /metadata/bytes_reserved:278528
     /metadata/bytes_readonly:131072
     /metadata/bytes_zone_unusable:0
     /metadata/bytes_may_use:561086464
     /metadata/flags:4
     /system/raid1/used_bytes:65536
     /system/raid1/total_bytes:8388608
     /system/disk_used:131072
     /system/bytes_pinned:0
     /system/bytes_used:65536
     /system/disk_total:16777216
     /system/total_bytes:8388608
     /system/bytes_reserved:0
     /system/bytes_readonly:0
     /system/bytes_zone_unusable:0
     /system/bytes_may_use:0
     /system/flags:2
     /global_rsv_reserved:513245184
     /data/disk_used:303358320640
     /data/bytes_pinned:0
     /data/bytes_used:303358320640
     /data/single/used_bytes:303358320640
     /data/single/total_bytes:329647128576
     /data/disk_total:329647128576
     /data/total_bytes:329647128576
     /data/bytes_reserved:8192
     /data/bytes_readonly:0
     /data/bytes_zone_unusable:0
     /data/bytes_may_use:868352
     /data/flags:1
     /global_rsv_size:513245184
     
* btrfs features (FSUUID=$(findmnt -n -o UUID $(stat -c '%m' "/")); grep -R . /sys/fs/btrfs/"$FSUUID"/features/ | sed "s/^.*features//"):
     /mixed_backref:1
     /free_space_tree:1
     /no_holes:1
     /compress_zstd:1
     /skinny_metadata:1
     /extended_iref:1
     
* btrfs checksum (FSUUID=$(findmnt -n -o UUID $(stat -c '%m' "/")); cat /sys/fs/btrfs/"$FSUUID"/checksum):
     crc32c (crc32c-intel)
9 
=== fpaste 0.4.2.0 System Information ===
* OS Release (cat /etc/*-release | uniq):
     Fedora release 36 (Thirty Six)
     NAME="Fedora Linux"
     VERSION="36 (Workstation Edition)"
     ID=fedora
     VERSION_ID=36
     VERSION_CODENAME=""
     PLATFORM_ID="platform:f36"
     PRETTY_NAME="Fedora Linux 36 (Workstation Edition)"
     ANSI_COLOR="0;38;2;60;110;180"
     LOGO=fedora-logo-icon
     CPE_NAME="cpe:/o:fedoraproject:fedora:36"
     HOME_URL="https://fedoraproject.org/"
     DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f36/system-administrators-guide/"
     SUPPORT_URL="https://discussion.fedoraproject.org/"
     BUG_REPORT_URL="https://bugzilla.redhat.com/"
     REDHAT_BUGZILLA_PRODUCT="Fedora"
     REDHAT_BUGZILLA_PRODUCT_VERSION=36
     REDHAT_SUPPORT_PRODUCT="Fedora"
     REDHAT_SUPPORT_PRODUCT_VERSION=36
     PRIVACY_POLICY_URL="https://fedoraproject.org/wiki/Legal:PrivacyPolicy"
     VARIANT="Workstation Edition"
     VARIANT_ID=workstation
     Fedora release 36 (Thirty Six)
     
* Kernel (uname -r ; cat /proc/cmdline):
     5.18.5-200.fc36.x86_64
     BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.18.5-200.fc36.x86_64 root=UUID=5cc459bb-cd95-48b7-8fa2-e72ea854bc12 ro rootflags=subvol=root rhgb quiet rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init
     
* Desktop(s) Running (ps -eo comm= | grep -E '(gnome-session|startkde|startactive|xfce.?-session|fluxbox|blackbox|hackedbox|ratpoison|enlightenment|icewm-session|od-session|wmaker|wmx|openbox-lxde|openbox-gnome-session|openbox-kde-session|mwm|e16|fvwm|xmonad|sugar-session|mate-session|lxqt-session|cinnamon|lxdm-session)' ):
     gnome-session-b
     gnome-session-c
     gnome-session-b
     
* Desktop(s) Installed (ls -m /usr/share/xsessions/ | sed 's/\.desktop//g' ):
     gnome-classic, gnome-classic-xorg, gnome,
     gnome-xorg
     
* SELinux Status (sestatus):
     SELinux status:                 enabled
     SELinuxfs mount:                /sys/fs/selinux
     SELinux root directory:         /etc/selinux
     Loaded policy name:             targeted
     Current mode:                   enforcing
     Mode from config file:          enforcing
     Policy MLS status:              enabled
     Policy deny_unknown status:     allowed
     Memory protection checking:     actual (secure)
     Max kernel policy version:      33
     
* SELinux Errors (without results: "selinuxenabled && journalctl --since yesterday |grep avc: | grep -Eo comm="[^ ]+" | sort |uniq -c |sort -rn"):
     N/A

* CPU Model (grep 'model name' /proc/cpuinfo | awk -F: '{print $2}' | uniq -c |
     sed -re 's/^ +//' ):
     16  AMD Ryzen 7 5800H with Radeon Graphics
     
* 64-bit Support (grep -q ' lm ' /proc/cpuinfo && echo Yes || echo No):
     Yes
     
* Hardware Virtualization Support (grep -Eq '(vmx|svm)' /proc/cpuinfo && echo Yes || echo No):
     Yes
     
* Load average (uptime):
      16:41:39 up 22 min,  1 user,  load average: 0.50, 0.66, 0.61
     
* Memory usage (free -m):
                    total        used        free      shared  buff/cache   available
     Mem:           13720        2848        7090          18        3780       10567
     Swap:           8191           0        8191
     
* Top 5 CPU hogs (ps axuScnh | awk '$2!=6722' | sort -rnk3 | head -5):
         1000    2392 34.8  1.2 27050304 175808 tty2  Sl+  16:19   7:52 Xorg
         1000    4381 18.0  4.3 4375708 606956 ?      Sl   16:20   3:53 firefox
         1000    5248  8.6  1.8 2908616 262864 ?      Sl   16:20   1:48 Isolated Web Co
         1000    2736  4.1  2.1 7207740 301300 ?      Ssl  16:19   0:56 gnome-shell
         1000    2353  1.2  0.1  23548 15148 ?        Ss   16:19   0:16 systemd
     
* Top 5 Memory hogs (ps axuScnh | sort -rnk4 | head -5):
         1000    4381 18.0  4.3 4375708 606956 ?      Sl   16:20   3:53 firefox
         1000    2736  4.1  2.1 7207740 301300 ?      Ssl  16:19   0:56 gnome-shell
         1000    5248  8.6  1.8 2908616 262864 ?      Sl   16:20   1:48 Isolated Web Co
            0    1963  0.1  1.5 706160 222820 ?       Ssl  16:18   0:02 packagekitd
         1000    5287  0.2  1.2 2825244 170616 ?      Sl   16:20   0:03 Isolated Web Co
     
* Disk space usage (df -hT):
     Filesystem     Type      Size  Used Avail Use% Mounted on
     devtmpfs       devtmpfs  4.0M     0  4.0M   0% /dev
     tmpfs          tmpfs     6.7G  4.9M  6.7G   1% /dev/shm
     tmpfs          tmpfs     2.7G  2.4M  2.7G   1% /run
     /dev/nvme0n1p3 btrfs     953G  288G  664G  31% /
     /dev/nvme0n1p3 btrfs     953G  288G  664G  31% /home
     tmpfs          tmpfs     6.7G   72K  6.7G   1% /tmp
     /dev/nvme0n1p2 ext4      974M  307M  600M  34% /boot
     /dev/nvme0n1p1 vfat      599M   14M  585M   3% /boot/efi
     tmpfs          tmpfs     1.4G  200K  1.4G   1% /run/user/1000
     
* Block devices (blkid):
     /dev/nvme0n1p3: LABEL="fedora_localhost-live" UUID="5cc459bb-cd95-48b7-8fa2-e72ea854bc12" UUID_SUB="3fbf970c-e3aa-4e71-9132-ac7e4a3dbbce" BLOCK_SIZE="4096" TYPE="btrfs" PARTUUID="4dd4079b-ebe8-4804-ad2f-79519c0623b1"
     /dev/nvme0n1p1: UUID="96A5-C478" BLOCK_SIZE="512" TYPE="vfat" PARTLABEL="EFI System Partition" PARTUUID="4d29f1c2-94eb-456b-a222-c0a89755f90d"
     /dev/nvme0n1p2: UUID="95613f08-00c0-4721-8dba-a6dafc736a09" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="8856189d-8873-4551-b2eb-76eba7c96f9b"
     /dev/nvme1n1p1: LABEL="fedora_localhost-live" UUID="5cc459bb-cd95-48b7-8fa2-e72ea854bc12" UUID_SUB="1b57c3ed-d3f2-4abf-8e7b-ae3f87ca6e18" BLOCK_SIZE="4096" TYPE="btrfs" PARTUUID="8b6c6a07-a8ca-4329-a4fb-064df742b5d1"
     /dev/zram0: LABEL="zram0" UUID="dd59d7d9-9a62-4346-97e7-11ecff38c700" TYPE="swap"
     
* PCI devices (lspci -nn):
     00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex [1022:1630]
     00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU [1022:1631]
     00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
     00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1633]
     00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
     00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:02.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:02.4 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
     00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
     00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
     00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
     00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51)
     00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
     00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 0 [1022:166a]
     00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 1 [1022:166b]
     00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 2 [1022:166c]
     00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 3 [1022:166d]
     00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 4 [1022:166e]
     00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 5 [1022:166f]
     00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 6 [1022:1670]
     00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 7 [1022:1671]
     01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA107BM [GeForce RTX 3050 Ti Mobile] [10de:25e0] (rev a1)
     01:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:2291] (rev a1)
     02:00.0 Non-Volatile memory controller [0108]: SK hynix Gold P31 SSD [1c5c:174a]
     03:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
     04:00.0 Network controller [0280]: Realtek Semiconductor Co., Ltd. RTL8852AE 802.11ax PCIe Wireless Network Adapter [10ec:8852]
     05:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation PS5013 E13 NVMe Controller [1987:5013] (rev 01)
     06:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [1002:1638] (rev c5)
     06:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df]
     06:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639]
     06:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639]
     06:00.5 Multimedia controller [0480]: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor [1022:15e2] (rev 01)
     06:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3]
     07:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
     07:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
     
* USB devices (lsusb):
     Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 003 Device 005: ID 0bda:4852 Realtek Semiconductor Corp. Bluetooth Radio
     Bus 003 Device 003: ID 048d:c965 Integrated Technology Express, Inc. ITE Device(8295)
     Bus 003 Device 006: ID 1c4f:0002 SiGma Micro Keyboard TRACER Gamma Ivory
     Bus 003 Device 004: ID 25a7:fa23 Areson Technology Corp 2.4G Receiver
     Bus 003 Device 002: ID 05e3:0608 Genesys Logic, Inc. Hub
     Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     Bus 002 Device 002: ID 05e3:0620 Genesys Logic, Inc. GL3523 Hub
     Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 001 Device 003: ID 048d:c101 Integrated Technology Express, Inc. ITE Device(8910)
     Bus 001 Device 002: ID 05e3:0610 Genesys Logic, Inc. Hub
     Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     
* DRM Information (journalctl -k -b | grep -o 'kernel:.*drm.*$' | cut -d ' ' -f 2- ):
     Command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.18.5-200.fc36.x86_64 root=UUID=5cc459bb-cd95-48b7-8fa2-e72ea854bc12 ro rootflags=subvol=root rhgb quiet rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init
     The simpledrm driver will not be probed
     Kernel command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-5.18.5-200.fc36.x86_64 root=UUID=5cc459bb-cd95-48b7-8fa2-e72ea854bc12 ro rootflags=subvol=root rhgb quiet rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 initcall_blacklist=simpledrm_platform_driver_init
     blacklisting initcall simpledrm_platform_driver_init
     ACPI: bus type drm_connector registered
     initcall simpledrm_platform_driver_init blacklisted
     [drm] amdgpu kernel modesetting enabled.
     [drm] initializing kernel modesetting (RENOIR 0x1002:0x1638 0x17AA:0x3AAC 0xC5).
     [drm] register mmio base: 0xD1500000
     [drm] register mmio size: 524288
     [drm] add ip block number 0 <soc15_common>
     [drm] add ip block number 1 <gmc_v9_0>
     [drm] add ip block number 2 <vega10_ih>
     [drm] add ip block number 3 <psp>
     [drm] add ip block number 4 <smu>
     [drm] add ip block number 5 <dm>
     [drm] add ip block number 6 <gfx_v9_0>
     [drm] add ip block number 7 <sdma_v4_0>
     [drm] add ip block number 8 <vcn_v2_0>
     [drm] add ip block number 9 <jpeg_v2_0>
     [drm] VCN decode is enabled in VM mode
     [drm] VCN encode is enabled in VM mode
     [drm] JPEG decode is enabled in VM mode
     [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
     [drm] Detected VRAM RAM=2048M, BAR=2048M
     [drm] RAM width 128bits DDR4
     [drm] amdgpu: 2048M of VRAM memory ready
     [drm] amdgpu: 3072M of GTT memory ready.
     [drm] GART: num cpu pages 262144, num gpu pages 262144
     [drm] PCIE GART of 1024M enabled.
     [drm] PTB located at 0x000000F400900000
     [drm] Loading DMUB firmware via PSP: version=0x01010020
     [drm] Found VCN firmware Version ENC: 1.17 DEC: 5 VEP: 0 Revision: 2
     [drm] reserve 0x400000 from 0xf47f800000 for PSP TMR
     [drm] Display Core initialized with v3.2.177!
     [drm] DMUB hardware initialized: version=0x01010020
     [drm] kiq ring mec 2 pipe 1 q 0
     [drm] VCN decode and encode initialized successfully(under DPG Mode).
     [drm] JPEG decode initialized successfully.
     [drm] Initialized amdgpu 3.46.0 20150101 for 0000:06:00.0 on minor 0
     fbcon: amdgpudrmfb (fb0) is primary device
     amdgpu 0000:06:00.0: [drm] fb0: amdgpudrmfb frame buffer device
     [drm] DSC precompute is not needed.
     [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
     [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 1
     
* Xorg modules (grep LoadModule /var/log/Xorg.0.log ~/.local/share/xorg/Xorg.0.log | cut -d \" -f 2 | xargs):
     
     
* GL Support (glxinfo | grep -E "OpenGL version|OpenGL renderer"):
     OpenGL renderer string: AMD RENOIR (LLVM 14.0.0, DRM 3.46, 5.18.5-200.fc36.x86_64)
     OpenGL version string: 4.6 (Compatibility Profile) Mesa 22.1.2
     
* Xorg errors (without results: "grep '^\[.*(EE)' /var/log/Xorg.0.log ~/.local/share/xorg/Xorg.0.log | cut -d ':' -f 2- "):
     N/A

* Kernel buffer tail (dmesg | tail):
     [ 1285.163099] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1285.163103] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1305.170824] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1305.170828] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1305.175106] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1305.175109] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1334.173824] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1334.173829] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1334.178320] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     [ 1334.178324] rtw89_8852ae 0000:04:00.0: c2h class 1 func 2 not support
     
* Last few reboots (last -x -n10 reboot runlevel):
     runlevel (to lvl 5)   5.18.5-200.fc36. Fri Jun 24 16:18   still running
     reboot   system boot  5.18.5-200.fc36. Fri Jun 24 16:18   still running
     runlevel (to lvl 5)   5.18.5-200.fc36. Fri Jun 24 10:12 - 16:17  (06:04)
     reboot   system boot  5.18.5-200.fc36. Fri Jun 24 10:12 - 16:17  (06:04)
     runlevel (to lvl 5)   5.18.5-200.fc36. Thu Jun 23 10:41 - 01:22  (14:40)
     reboot   system boot  5.18.5-200.fc36. Thu Jun 23 10:41 - 01:22  (14:40)
     reboot   system boot  5.18.5-200.fc36. Wed Jun 22 23:49 - 23:49  (00:00)
     runlevel (to lvl 5)   5.18.5-200.fc36. Wed Jun 22 14:22 - 23:48  (09:26)
     reboot   system boot  5.18.5-200.fc36. Wed Jun 22 14:22 - 23:48  (09:26)
     runlevel (to lvl 5)   5.18.5-200.fc36. Tue Jun 21 12:32 - 01:53  (13:21)
     
     wtmp begins Wed Jun  8 06:32:07 2022
     
* DNF Repositories (dnf repolist):
     repo id                         repo name
     code                            Visual Studio Code
     docker-ce-stable                Docker CE Stable - x86_64
     fedora                          Fedora 36 - x86_64
     fedora-cisco-openh264           Fedora 36 openh264 (From Cisco) - x86_64
     fedora-modular                  Fedora Modular 36 - x86_64
     google-chrome                   google-chrome
     phracek-PyCharm                 Copr repo for PyCharm owned by phracek
     pritunl                         Pritunl Stable Repository
     rpmfusion-free                  RPM Fusion for Fedora 36 - Free
     rpmfusion-free-updates          RPM Fusion for Fedora 36 - Free - Updates
     rpmfusion-nonfree               RPM Fusion for Fedora 36 - Nonfree
     rpmfusion-nonfree-nvidia-driver RPM Fusion for Fedora 36 - Nonfree - NVIDIA Driver
     rpmfusion-nonfree-steam         RPM Fusion for Fedora 36 - Nonfree - Steam
     rpmfusion-nonfree-updates       RPM Fusion for Fedora 36 - Nonfree - Updates
     updates                         Fedora 36 - x86_64 - Updates
     updates-modular                 Fedora Modular 36 - x86_64 - Updates
     
* DNF Extras (dnf -C list extras):
     Last metadata expiration check: 1:43:22 ago on Fri 24 Jun 2022 02:58:18 PM +0430.
     Extra Packages
     dbeaver-ce.x86_64                              22.1.0-stable       @@commandline
     kmod-VirtualBox-5.17.14-300.fc36.x86_64.x86_64 6.1.34-3.fc36       @@commandline
     kmod-VirtualBox-5.18.5-200.fc36.x86_64.x86_64  6.1.34-3.fc36       @@commandline
     kmod-nvidia-5.17.13-300.fc36.x86_64.x86_64     3:510.68.02-2.fc36  @@commandline
     kmod-nvidia-5.17.14-300.fc36.x86_64.x86_64     3:510.68.02-2.fc36  @@commandline
     kmod-nvidia-5.18.5-200.fc36.x86_64.x86_64      3:510.68.02-2.fc36  @@commandline
     onlyoffice-desktopeditors.x86_64               7.1.0-215           @@commandline
     surfshark-release.x86_64                       1.0.0-3             @@commandline
     
* Last 20 packages installed (rpm -qa --nodigest --nosignature --last | head -20):
     power-profiles-daemon-0.11.1-1.fc36.x86_64    Fri 24 Jun 2022 02:06:44 PM +0430
     rhythmbox-3.4.6-1.fc36.x86_64                 Fri 24 Jun 2022 11:19:56 AM +0430
     libproxy-webkitgtk4-0.4.18-1.fc36.x86_64      Fri 24 Jun 2022 11:19:56 AM +0430
     libproxy-0.4.18-1.fc36.x86_64                 Fri 24 Jun 2022 11:19:56 AM +0430
     libproxy-0.4.18-1.fc36.i686                   Fri 24 Jun 2022 11:19:56 AM +0430
     libdmapsharing4-3.9.10-5.fc36.x86_64          Fri 24 Jun 2022 11:19:56 AM +0430
     gnutls-utils-3.7.6-3.fc36.x86_64              Fri 24 Jun 2022 11:19:56 AM +0430
     gnutls-dane-3.7.6-3.fc36.x86_64               Fri 24 Jun 2022 11:19:56 AM +0430
     gnutls-3.7.6-3.fc36.x86_64                    Fri 24 Jun 2022 11:19:56 AM +0430
     gnutls-3.7.6-3.fc36.i686                      Fri 24 Jun 2022 11:19:56 AM +0430
     gnome-calendar-42.2-1.fc36.x86_64             Fri 24 Jun 2022 11:19:56 AM +0430
     qt5-qtbase-gui-5.15.3-3.fc36.x86_64           Thu 23 Jun 2022 08:00:39 PM +0430
     qt5-qtbase-common-5.15.3-3.fc36.noarch        Thu 23 Jun 2022 08:00:39 PM +0430
     qt5-qtbase-5.15.3-3.fc36.x86_64               Thu 23 Jun 2022 08:00:39 PM +0430
     firefox-101.0.1-6.fc36.x86_64                 Wed 22 Jun 2022 11:48:29 PM +0430
     dnsmasq-2.86-9.fc36.x86_64                    Wed 22 Jun 2022 11:48:29 PM +0430
     podman-4.1.1-1.fc36.x86_64                    Wed 22 Jun 2022 11:48:28 PM +0430
     mediawriter-5.0.2-1.fc36.x86_64               Wed 22 Jun 2022 11:48:28 PM +0430
     ibus-typing-booster-2.16.3-1.fc36.noarch      Wed 22 Jun 2022 11:48:28 PM +0430
     xen-licenses-4.16.1-2.fc36.x86_64             Wed 22 Jun 2022 11:48:27 PM +0430
     
* EFI boot manager output (efibootmgr -v):
     BootCurrent: 0005
     Timeout: 0 seconds
     BootOrder: 0005,0000,2002,2001,2003
     Boot0000* Fedora	HD(1,GPT,4d29f1c2-94eb-456b-a222-c0a89755f90d,0x800,0x12c000)/File(\EFI\fedora\shim.efi)RC
     Boot0001* EFI PXE 0 for IPv4 (90-2E-16-3F-ED-06) 	PciRoot(0x0)/Pci(0x2,0x1)/Pci(0x0,0x0)/MAC(902e163fed06,0)/IPv4(0.0.0.00.0.0.0,0,0)RC
     Boot0002* EFI PXE 0 for IPv6 (90-2E-16-3F-ED-06) 	PciRoot(0x0)/Pci(0x2,0x1)/Pci(0x0,0x0)/MAC(902e163fed06,0)/IPv6([::]:<->[::]:,0,0)RC
     Boot0004* EFI PXE 0 for IPv6 (90-2E-16-3F-ED-06) 	PciRoot(0x0)/Pci(0x2,0x1)/Pci(0x0,0x0)/MAC(902e163fed06,0)/IPv6([::]:<->[::]:,0,0)RC
     Boot0005* Fedora	HD(1,GPT,4d29f1c2-94eb-456b-a222-c0a89755f90d,0x800,0x12c000)/File(\EFI\fedora\shimx64.efi)
     Boot0007* EFI USB Device (USB     Flash Disk)	UsbWwid(58f,6387,0,683DF7A)/HD(1,MBR,0x355f486a,0x2000,0x1dc2000)RC
     Boot2001* EFI USB Device	RC
     Boot2002* EFI DVD/CDROM	RC
     Boot2003* EFI Network	RC
10

After installing kernel 5.17.5, I stuck in the same situation after forth reboot.

11

Hi, just asking here, but would the fact that your nvme0n1p3 is using the same exact label and UUID as nvme1p1, not be some of the problem you are trying to undo?

just asking.

12

Nope, this is normal with btrfs multiple device file systems. The UUID applies to the file system, so each block device making up the file system will show this same UUID and label, per libblkid. There is a device specific UUID that blkid shows as UUID_SUB, and is unique per block device.

13

Yeah I see this discussed in this thread, not sure if it’s related to the problem though.

https://www.spinics.net/lists/kernel/msg4106109.html

I have a crude idea how to get the info we need, but it’s pretty ugly.

  1. Modify the GRUB menu entry, such that the linux line no longer has rhgb quiet and instead has rd.break=pre-mount

This will get you into a very rudimentary shell. and it’s a bit weird. So I’ll try to be really verbose.

  1. Mount the “/boot” volume, you can use the blkid command if you aren’t sure what the device node is, you’ll use that instead of what’s in the example below. / doesn’t exist here, so you’ll mount it to /sysroot
    mount /dev/nvme0n1p2 /sysroot

  2. Dump kernel messages to a file on this boot file system. Yes you’ll end up with a bunch of small files cluttering up your /boot dir, but you can clean this up later, and they are small so even if you forget it’s not that big of a deal, they also won’t interfere with anything else.
    dmesg>/sysroot/dmesg1.txt

  3. reboot

  4. Repeat 1 through 4, but of course you want to do dmesg2.txt then dmesg3.txt and so on until you have 5 of them.

Then put them up somewhere you’re OK sharing the files, can be anything including even a time limited pastebin, or paste.centos.org which maxes out at 24 hours. We can all look at those and see if anything stands out, like for example 3 of 5 show both nvme devices appearing at the same time, but 2 of 5 don’t show one at all (or some kind of error).

And we will go from there.

Optional but recommended: If you are feeling adventurous you can consider using the most recent Rawhide kernel on either Fedora 35 or Fedora 36. The advantage is if the problem still happens, it means it’s definitely not fixed yet in upstream kernel development. If the problem doesn’t happen, chances are it is fixed, and good chance I can track down the fix, and see where it’s at in the stable backports process - if it’s a safe fix we should be able to get it into a Fedora 5.18 series kernel pretty quickly.

To do this, go here:
https://koji.fedoraproject.org/koji/packageinfo?packageID=8

Find the most recent fc37 kernel with a green check on the right, which right now is kernel-5.19.0-0.rc3.20220624git92f20ff72066.30.fc37 and you can click on that. Now find the section for x86_64 arch kernels. And download three files:

kernel-5.19.0…
kernel-core-5.19.0…
kernel-modules-5.19.0…

You can install just by:

cd ~/Downloads
sudo dnf install *rpm
14

I installed mentioned kernel version and I didn’t face any problem after 15 reboots. I think the problem solved in the new kernel.

Is there any necessity to dump kernel messages anymore?

15

I don’t think so.

I’m not seeing anything obvious in 5.18.7 or 5.18.8 that might fix this. Is the drive a Samsung X5 by any chance? There’s a quirk added to 5.18.8 for it that might relate. Note that most of the rawhide kernels do run slower due to debug options, that’s normal.

One strategy is to periodically (weekly?) do sudo dnf update kernel*,kernel-* --enablerepo=updates-testing to grab the latest stable kernel (currently 5.18 series). Or you can head to koji and grab one of the 5.19 kernels, usually a new rc is built on Mondays, does not have the gitxxxxxx reference in the name, and has debug options disabled. So that could be a good option until 5.18 has a backport of the fix.

16

Actually there are a lot of NVMe fixes in 5.19 including multiple sets of quirks. Good chance the quirks end up being backported because they do fairly innocuous things like this one example: git.infradead.org Git - nvme.git/commit where it works around drive firmware bugs.

17

No, I think

$ sudo lshw -class disk -class storage
  *-nvme                    
       description: NVMe device
       product: SKHynix_HFS512GDE9X084N
       vendor: SK hynix
       physical id: 0
       bus info: pci@0000:02:00.0
       logical name: /dev/nvme0
       version: 41010C22
       serial: CJA5N775913405S36
       width: 64 bits
       clock: 33MHz
       capabilities: nvme pm msi msix pciexpress nvm_express bus_master cap_list
       configuration: driver=nvme latency=0 nqn=nqn.2021-05.com.skhynix:nvme:nvm-subsystem-sn-CJA5N775913405S36 state=live
       resources: irq:58 memory:d1900000-d1903fff memory:d1905000-d1905fff memory:d1904000-d1904fff
     *-namespace:0
          description: NVMe disk
          physical id: 0
          logical name: hwmon3
     *-namespace:1
          description: NVMe disk
          physical id: 2
          logical name: /dev/ng0n1
     *-namespace:2
          description: NVMe disk
          physical id: 1
          bus info: nvme@0:1
          logical name: /dev/nvme0n1
          size: 476GiB (512GB)
          capabilities: gpt-1.00 partitioned partitioned:gpt
          configuration: guid=bda3c02a-5ae3-4027-87ef-8edd97393c89 logicalsectorsize=512 sectorsize=512 wwid=eui.ace42e00159bbf582ee4ac0000000001
  *-nvme
       description: NVMe device
       product: GIGABYTE GP-GSM2NE3512GNTD
       vendor: Phison Electronics Corporation
       physical id: 0
       bus info: pci@0000:05:00.0
       logical name: /dev/nvme1
       version: EDFMD1.0
       serial: SN212208901935
       width: 64 bits
       clock: 33MHz
       capabilities: nvme pciexpress msix msi pm nvm_express bus_master cap_list
       configuration: driver=nvme latency=0 nqn=nqn.2014.08.org.nvmexpress:19871987SN212208901935      GIGABYTE GP-GSM2NE3512GNTD state=live
       resources: irq:60 memory:d1600000-d1603fff
     *-namespace:0
          description: NVMe disk
          physical id: 0
          logical name: hwmon2
     *-namespace:1
          description: NVMe disk
          physical id: 2
          logical name: /dev/ng1n1
     *-namespace:2
          description: NVMe disk
          physical id: 1
          bus info: nvme@1:1
          logical name: /dev/nvme1n1
          size: 476GiB (512GB)
          capabilities: gpt-1.00 partitioned partitioned:gpt
          configuration: guid=df5d9b60-be0f-4ba6-9061-bb71a6869abe logicalsectorsize=512 sectorsize=512 wwid=eui.6479a74d80c00782
  *-sata:0
       description: SATA controller
       product: FCH SATA Controller [AHCI mode]
       vendor: Advanced Micro Devices, Inc. [AMD]
       physical id: 0
       bus info: pci@0000:07:00.0
       version: 81
       width: 32 bits
       clock: 33MHz
       capabilities: sata pm pciexpress msi ahci_1.0 bus_master cap_list
       configuration: driver=ahci latency=0
       resources: irq:34 memory:d1101000-d11017ff
  *-sata:1
       description: SATA controller
       product: FCH SATA Controller [AHCI mode]
       vendor: Advanced Micro Devices, Inc. [AMD]
       physical id: 0.1
       bus info: pci@0000:07:00.1
       version: 81
       width: 32 bits
       clock: 33MHz
       capabilities: sata pm pciexpress msi ahci_1.0 bus_master cap_list
       configuration: driver=ahci latency=0
       resources: irq:36 memory:d1100000-d11007ff
18

I face the same problem in 5.18.7 (which I’m currently on). I will test that with 5.18.8 too, but I don’t think it solves the problem, because, like you, when I look into the commits for this version I didn’t see any eligible commit that may solve this problem.

19

Yeah, I’m really hopeful about kernel 5.19, and as I test that previously with rc3 (with no problem after 15 reboots), maybe I’ll switch to rc4 or wait for kernel 5.19 stable release.

BTW, Thank you so much for you support.
I will notify you (here) whenever this problem completely vanished.

20

Hi , Is there anyone still facing the problem ?

[shahad@fedora ~]$ uname -r 
6.0.15-200.fc36.x86_64