Low disk latency on HDD, high latency on NVMe

Hello,

On a whim I measured disk latencies on my system with the command ioping -c 10 ., and on a BTRFS RAID0 array with two mechanical hard drives, LUKS encryption and FS compression I got this result:

4 KiB <<< . ( ): request=1 time=121.6 us (warmup)
4 KiB <<< . ( ): request=2 time=207.3 us
4 KiB <<< . ( ): request=3 time=165.4 us
4 KiB <<< . ( ): request=4 time=167.1 us
4 KiB <<< . ( ): request=5 time=412.9 us
4 KiB <<< . ( ): request=6 time=137.7 us
4 KiB <<< . ( ): request=7 time=146.5 us (fast)
4 KiB <<< . ( ): request=8 time=146.0 us (fast)
4 KiB <<< . ( ): request=9 time=187.6 us
4 KiB <<< . ( ): request=10 time=164.6 us

--- . ( ) ioping statistics ---
9 requests completed in 1.74 ms, 36 KiB read, 5.19 k iops, 20.3 MiB/s
generated 10 requests in 9.00 s, 40 KiB, 1 iops, 4.44 KiB/s
min/avg/max/mdev = 137.7 us / 192.8 us / 412.9 us / 80.4 us

And on a single NVMe drive (again with BTRFS, LUKS encryption and FS compression) I got this result:

4 KiB <<< . ( ): request=1 time=54.2 us (warmup)
4 KiB <<< . ( ): request=2 time=8.23 ms
4 KiB <<< . ( ): request=3 time=8.26 ms
4 KiB <<< . ( ): request=4 time=8.23 ms
4 KiB <<< . ( ): request=5 time=8.24 ms
4 KiB <<< . ( ): request=6 time=87.5 us
4 KiB <<< . ( ): request=7 time=8.23 ms (slow)
4 KiB <<< . ( ): request=8 time=8.23 ms (slow)
4 KiB <<< . ( ): request=9 time=8.24 ms (slow)
4 KiB <<< . ( ): request=10 time=8.27 ms (slow)

--- . ( ) ioping statistics ---
9 requests completed in 66.0 ms, 36 KiB read, 136 iops, 545.3 KiB/s
generated 10 requests in 9.01 s, 40 KiB, 1 iops, 4.44 KiB/s
min/avg/max/mdev = 87.5 us / 7.34 ms / 8.27 ms / 2.56 ms

So the average latencies for the HDD array and the NVMe drive are 0.19 ms 7.34 ms respectively. This is the opposite result of what I would have expected. Am I misinterpreting these results, or what?

fpaste
=== fpaste 0.4.2.0 System Information ===
* OS Release (cat /etc/*-release | uniq):
     Fedora release 36 (Thirty Six)
     NAME="Fedora Linux"
     VERSION="36 (Workstation Edition)"
     ID=fedora
     VERSION_ID=36
     VERSION_CODENAME=""
     PLATFORM_ID="platform:f36"
     PRETTY_NAME="Fedora Linux 36 (Workstation Edition)"
     ANSI_COLOR="0;38;2;60;110;180"
     LOGO=fedora-logo-icon
     CPE_NAME="cpe:/o:fedoraproject:fedora:36"
     HOME_URL="https://fedoraproject.org/"
     DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f36/system-administrators-guide/"
     SUPPORT_URL="https://discussion.fedoraproject.org/"
     BUG_REPORT_URL="https://bugzilla.redhat.com/"
     REDHAT_BUGZILLA_PRODUCT="Fedora"
     REDHAT_BUGZILLA_PRODUCT_VERSION=36
     REDHAT_SUPPORT_PRODUCT="Fedora"
     REDHAT_SUPPORT_PRODUCT_VERSION=36
     PRIVACY_POLICY_URL="https://fedoraproject.org/wiki/Legal:PrivacyPolicy"
     VARIANT="Workstation Edition"
     VARIANT_ID=workstation
     Fedora release 36 (Thirty Six)
     
* Kernel (uname -r ; cat /proc/cmdline):
     5.18.7-200.fc36.x86_64
     BOOT_IMAGE=(hd2,gpt2)/vmlinuz-5.18.7-200.fc36.x86_64 root=UUID=6efd8298-6cb1-4dcd-ba09-722807a2bb14 ro rootflags=subvol=root rd.luks.uuid=luks-e44de74e-e4f3-44a0-a3ff-22317f826e44 rhgb quiet
     
* Desktop(s) Running (ps -eo comm= | grep -E '(gnome-session|startkde|startactive|xfce.?-session|fluxbox|blackbox|hackedbox|ratpoison|enlightenment|icewm-session|od-session|wmaker|wmx|openbox-lxde|openbox-gnome-session|openbox-kde-session|mwm|e16|fvwm|xmonad|sugar-session|mate-session|lxqt-session|cinnamon|lxdm-session)' ):
     gnome-session-b
     gnome-session-c
     gnome-session-b
     
* Desktop(s) Installed (ls -m /usr/share/xsessions/ | sed 's/\.desktop//g' ):
     gnome-classic, gnome-classic-xorg, gnome,
     gnome-xorg
     
* SELinux Status (sestatus):
     SELinux status:                 enabled
     SELinuxfs mount:                /sys/fs/selinux
     SELinux root directory:         /etc/selinux
     Loaded policy name:             targeted
     Current mode:                   enforcing
     Mode from config file:          enforcing
     Policy MLS status:              enabled
     Policy deny_unknown status:     allowed
     Memory protection checking:     actual (secure)
     Max kernel policy version:      33
     
* SELinux Errors (without results: "selinuxenabled && journalctl --since yesterday |grep avc: | grep -Eo comm="[^ ]+" | sort |uniq -c |sort -rn"):
     N/A

* CPU Model (grep 'model name' /proc/cpuinfo | awk -F: '{print $2}' | uniq -c |
     sed -re 's/^ +//' ):
     16  AMD Ryzen 7 5800X 8-Core Processor
     
* 64-bit Support (grep -q ' lm ' /proc/cpuinfo && echo Yes || echo No):
     Yes
     
* Hardware Virtualization Support (grep -Eq '(vmx|svm)' /proc/cpuinfo && echo Yes || echo No):
     Yes
     
* Load average (uptime):
      12:47:50 up 20:21,  1 user,  load average: 0,39, 0,41, 0,69
     
* Memory usage (free -m):
                    total        used        free      shared  buff/cache   available
     Mem:           15808        6206         613         808        8988        8458
     Swap:           8191        1821        6370
     
* Top 5 CPU hogs (ps axuScnh | awk '$2!=214346' | sort -rnk3 | head -5):
         1000    9831 33.8  1.7 1368144 280956 ?      S<l  heinä03 410:18 steam
         1000    3276 11.5  4.1 6836896 676584 ?      Ssl  heinä03 141:00 gnome-shell
         1000    3126 10.0  0.0  23748 12676 ?        Ss   heinä03 123:11 systemd
         1000  176310  7.9  2.7 4517520 445564 ?      Sl   10:05  12:53 firefox
         1000  214130  6.6  0.0 225312  5660 pts/5    Ss   12:47   0:01 zsh
     
* Top 5 Memory hogs (ps axuScnh | sort -rnk4 | head -5):
         1000    3276 11.5  4.1 6836896 676584 ?      Ssl  heinä03 141:00 gnome-shell
         1000   10614  0.7  3.7 5582100 600760 ?      Sl   heinä03   9:37 steamwebhelper
         1000  176310  7.9  2.7 4517520 445564 ?      Sl   10:05  12:53 firefox
            0    2744  0.0  2.2 1214172 357020 ?      Ssl  heinä03   0:24 packagekitd
         1000    9831 33.8  1.7 1368144 280956 ?      S<l  heinä03 410:18 steam
     
* Disk space usage (df -hT):
     Tiedostojärjestelmä Tyyppi    Koko  Käyt Vapaa Käy% Liitospiste
     devtmpfs            devtmpfs  4,0M     0  4,0M   0% /dev
     tmpfs               tmpfs     7,8G  959M  6,8G  13% /dev/shm
     tmpfs               tmpfs     3,1G  2,4M  3,1G   1% /run
     /dev/dm-0           btrfs     930G  695G  233G  75% /
     tmpfs               tmpfs     7,8G   14M  7,8G   1% /tmp
     /dev/nvme0n1p2      ext4      974M  308M  600M  34% /boot
     /dev/nvme0n1p1      vfat      599M   14M  585M   3% /boot/efi
     /dev/dm-2           btrfs     1,9T  786G  1,1T  43% /storage
     tmpfs               tmpfs     1,6G  1,2M  1,6G   1% /run/user/1000
     
* Block devices (without results: "blkid" AND "/sbin/blkid"):
     N/A

* PCI devices (lspci -nn):
     00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
     00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
     00:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
     00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
     00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
     00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
     00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
     00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
     00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
     00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 0 [1022:1440]
     00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 1 [1022:1441]
     00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 2 [1022:1442]
     00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 3 [1022:1443]
     00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 4 [1022:1444]
     00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 5 [1022:1445]
     00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 6 [1022:1446]
     00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 7 [1022:1447]
     01:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream [1022:57ad]
     02:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
     02:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
     02:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
     02:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
     03:00.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e 4-Port PCIe x1 Gen2 Packet Switch [1b21:1184]
     04:01.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e 4-Port PCIe x1 Gen2 Packet Switch [1b21:1184]
     04:03.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e 4-Port PCIe x1 Gen2 Packet Switch [1b21:1184]
     04:05.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e 4-Port PCIe x1 Gen2 Packet Switch [1b21:1184]
     04:07.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e 4-Port PCIe x1 Gen2 Packet Switch [1b21:1184]
     05:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6 AX200 [8086:2723] (rev 1a)
     07:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
     09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
     09:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
     09:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
     0a:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
     0b:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
     0c:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO [144d:a80a]
     0d:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch [1002:1478] (rev c1)
     0e:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch [1002:1479]
     0f:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 [Radeon RX 6800/6800 XT / 6900 XT] [1002:73bf] (rev c1)
     0f:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21/23 HDMI/DP Audio Controller [1002:ab28]
     10:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
     11:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
     11:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
     11:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
     11:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
     
* USB devices (lsusb):
     Bus 006 Device 002: ID 1e4e:7102 Cubeternet Live Streaming USB Device
     Bus 006 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 005 Device 002: ID 046d:c53a Logitech, Inc. PowerPlay Wireless Charging System
     Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 003 Device 015: ID 0bda:5418 Realtek Semiconductor Corp. BillBoard Device
     Bus 003 Device 014: ID 0bda:5411 Realtek Semiconductor Corp. RTS5411 Hub
     Bus 003 Device 005: ID 8087:0029 Intel Corp. AX200 Bluetooth
     Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     Bus 002 Device 006: ID 0bda:0411 Realtek Semiconductor Corp. Hub
     Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
     Bus 001 Device 007: ID 054c:09cc Sony Corp. DualShock 4 [CUH-ZCT2x]
     Bus 001 Device 005: ID 03f0:098d HP, Inc HyperX Cloud Alpha Wireless
     Bus 001 Device 004: ID 046d:c52b Logitech, Inc. Unifying Receiver
     Bus 001 Device 002: ID 05e3:0608 Genesys Logic, Inc. Hub
     Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
     
* DRM Information (journalctl -k -b | grep -o 'kernel:.*drm.*$' | cut -d ' ' -f 2- ):
     ACPI: bus type drm_connector registered
     [drm] Initialized simpledrm 1.0.0 20200625 for simple-framebuffer.0 on minor 0
     simple-framebuffer simple-framebuffer.0: [drm] fb0: simpledrmdrmfb frame buffer device
     [drm] amdgpu kernel modesetting enabled.
     [drm] initializing kernel modesetting (SIENNA_CICHLID 0x1002:0x73BF 0x148C:0x2406 0xC1).
     [drm] register mmio base: 0xFCC00000
     [drm] register mmio size: 1048576
     [drm] add ip block number 0 <nv_common>
     [drm] add ip block number 1 <gmc_v10_0>
     [drm] add ip block number 2 <navi10_ih>
     [drm] add ip block number 3 <psp>
     [drm] add ip block number 4 <smu>
     [drm] add ip block number 5 <dm>
     [drm] add ip block number 6 <gfx_v10_0>
     [drm] add ip block number 7 <sdma_v5_2>
     [drm] add ip block number 8 <vcn_v3_0>
     [drm] add ip block number 9 <jpeg_v3_0>
     [drm] VCN(0) decode is enabled in VM mode
     [drm] VCN(1) decode is enabled in VM mode
     [drm] VCN(0) encode is enabled in VM mode
     [drm] VCN(1) encode is enabled in VM mode
     [drm] JPEG decode is enabled in VM mode
     [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
     [drm] Detected VRAM RAM=16368M, BAR=256M
     [drm] RAM width 256bits GDDR6
     [drm] amdgpu: 16368M of VRAM memory ready
     [drm] amdgpu: 11856M of GTT memory ready.
     [drm] GART: num cpu pages 131072, num gpu pages 131072
     [drm] PCIE GART of 512M enabled (table at 0x0000008000E10000).
     [drm] Loading DMUB firmware via PSP: version=0x0202000F
     [drm] use_doorbell being set to: [true]
     [drm] use_doorbell being set to: [true]
     [drm] use_doorbell being set to: [true]
     [drm] use_doorbell being set to: [true]
     [drm] Found VCN firmware Version ENC: 1.20 DEC: 2 VEP: 0 Revision: 5
     [drm] reserve 0xa00000 from 0x83fe000000 for PSP TMR
     [drm] Display Core initialized with v3.2.177!
     [drm] DMUB hardware initialized: version=0x0202000F
     [drm] REG_WAIT timeout 1us * 100000 tries - mpc2_assert_idle_mpcc line:478
     [drm] kiq ring mec 2 pipe 1 q 0
     [drm] VCN decode and encode initialized successfully(under DPG Mode).
     [drm] JPEG decode initialized successfully.
     [drm] Initialized amdgpu 3.46.0 20150101 for 0000:0f:00.0 on minor 0
     fbcon: amdgpudrmfb (fb0) is primary device
     amdgpu 0000:0f:00.0: [drm] fb0: amdgpudrmfb frame buffer device
     [drm] DSC precompute is not needed.
     [drm] REG_WAIT timeout 1us * 100000 tries - mpc2_assert_idle_mpcc line:478
     [drm] free PSP TMR buffer
     [drm] PCIE GART of 512M enabled (table at 0x0000008000E10000).
     [drm] PSP is resuming...
     [drm] reserve 0xa00000 from 0x800f400000 for PSP TMR
     [drm] DMUB hardware initialized: version=0x0202000F
     [drm] kiq ring mec 2 pipe 1 q 0
     [drm] VCN decode and encode initialized successfully(under DPG Mode).
     [drm] JPEG decode initialized successfully.
     [drm] free PSP TMR buffer
     [drm] PCIE GART of 512M enabled (table at 0x0000008000E10000).
     [drm] PSP is resuming...
     [drm] reserve 0xa00000 from 0x800f400000 for PSP TMR
     [drm] DMUB hardware initialized: version=0x0202000F
     [drm] kiq ring mec 2 pipe 1 q 0
     [drm] VCN decode and encode initialized successfully(under DPG Mode).
     [drm] JPEG decode initialized successfully.
     
* Xorg modules (grep LoadModule /var/log/Xorg.0.log ~/.local/share/xorg/Xorg.0.log | cut -d \" -f 2 | xargs):
     
     
* GL Support (glxinfo | grep -E "OpenGL version|OpenGL renderer"):
     OpenGL renderer string: AMD Radeon RX 6800 XT (sienna_cichlid, LLVM 14.0.0, DRM 3.46, 5.18.7-200.fc36.x86_64)
     OpenGL version string: 4.6 (Compatibility Profile) Mesa 22.1.2
     
* Xorg errors (without results: "grep '^\[.*(EE)' /var/log/Xorg.0.log ~/.local/share/xorg/Xorg.0.log | cut -d ':' -f 2- "):
     N/A

* Kernel buffer tail (dmesg | tail):
     [36796.875096] wlp5s0: Limiting TX power to 30 (30 - 0) dBm as advertised by 00:1e:ab:05:cc:8c
     [36796.890801] IPv6: ADDRCONF(NETDEV_CHANGE): wlp5s0: link becomes ready
     [36812.227993] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     [37062.369769] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     [38003.611503] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     [39197.184599] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     [41603.722604] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     [41791.047253] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     [43648.984003] input: Microsoft X-Box 360 pad 0 as /devices/virtual/input/input56
     [44649.460338] iwlwifi 0000:05:00.0: Unhandled alg: 0x703
     
* Last few reboots (last -x -n10 reboot runlevel):
     runlevel (to lvl 5)   5.18.7-200.fc36. Sun Jul  3 16:26   still running
     reboot   system boot  5.18.7-200.fc36. Sun Jul  3 16:26   still running
     reboot   system boot  5.18.7-200.fc36. Sun Jul  3 06:29 - 06:29  (00:00)
     runlevel (to lvl 5)   5.18.7-200.fc36. Sat Jul  2 14:14 - 06:28  (16:14)
     reboot   system boot  5.18.7-200.fc36. Sat Jul  2 14:14 - 06:28  (16:14)
     runlevel (to lvl 5)   5.18.7-200.fc36. Fri Jul  1 23:45 - 03:13  (03:27)
     reboot   system boot  5.18.7-200.fc36. Fri Jul  1 23:44 - 03:13  (03:28)
     reboot   system boot  5.18.7-200.fc36. Fri Jul  1 23:38 - 23:38  (00:00)
     runlevel (to lvl 5)   5.18.7-200.fc36. Fri Jul  1 10:12 - 23:36  (13:24)
     reboot   system boot  5.18.7-200.fc36. Fri Jul  1 10:12 - 23:36  (13:24)
     
     wtmp begins Tue Apr 19 14:21:07 2022
     
* DNF Repositories (dnf repolist):
     lähdetunnus                     ohjelmistolähteen nimi
     fedora                          Fedora 36 - x86_64
     fedora-cisco-openh264           Fedora 36 openh264 (From Cisco) - x86_64
     fedora-modular                  Fedora Modular 36 - x86_64
     google-chrome                   google-chrome
     phracek-PyCharm                 Copr repo for PyCharm owned by phracek
     rpmfusion-free                  RPM Fusion for Fedora 36 - Free
     rpmfusion-free-tainted          RPM Fusion for Fedora 36 - Free tainted
     rpmfusion-free-updates          RPM Fusion for Fedora 36 - Free - Updates
     rpmfusion-nonfree               RPM Fusion for Fedora 36 - Nonfree
     rpmfusion-nonfree-nvidia-driver RPM Fusion for Fedora 36 - Nonfree - NVIDIA Driver
     rpmfusion-nonfree-steam         RPM Fusion for Fedora 36 - Nonfree - Steam
     rpmfusion-nonfree-tainted       RPM Fusion for Fedora 36 - Nonfree tainted
     rpmfusion-nonfree-updates       RPM Fusion for Fedora 36 - Nonfree - Updates
     updates                         Fedora 36 - x86_64 - Updates
     updates-modular                 Fedora Modular 36 - x86_64 - Updates
     
* DNF Extras (without results: "dnf -C list extras"):
     N/A

* Last 20 packages installed (rpm -qa --nodigest --nosignature --last | head -20):
     ioping-1.1-8.fc36.x86_64                      ma  4. heinäkuuta 2022 10.09.08
     pipewire-utils-0.3.53-2.fc36.x86_64           su  3. heinäkuuta 2022 06.29.33
     pipewire-pulseaudio-0.3.53-2.fc36.x86_64      su  3. heinäkuuta 2022 06.29.33
     pipewire-libs-0.3.53-2.fc36.x86_64            su  3. heinäkuuta 2022 06.29.33
     pipewire-libs-0.3.53-2.fc36.i686              su  3. heinäkuuta 2022 06.29.33
     pipewire-jack-audio-connection-kit-0.3.53-2.fc36.x86_64 su  3. heinäkuuta 2022 06.29.33
     pipewire-gstreamer-0.3.53-2.fc36.x86_64       su  3. heinäkuuta 2022 06.29.33
     pipewire-alsa-0.3.53-2.fc36.x86_64            su  3. heinäkuuta 2022 06.29.33
     pipewire-alsa-0.3.53-2.fc36.i686              su  3. heinäkuuta 2022 06.29.33
     pipewire-0.3.53-2.fc36.x86_64                 su  3. heinäkuuta 2022 06.29.33
     pipewire-0.3.53-2.fc36.i686                   su  3. heinäkuuta 2022 06.29.33
     yt-dlp-zsh-completion-2022.06.22.1-1.fc36.noarch su  3. heinäkuuta 2022 06.29.32
     yt-dlp-bash-completion-2022.06.22.1-1.fc36.noarch su  3. heinäkuuta 2022 06.29.32
     yt-dlp-2022.06.22.1-1.fc36.noarch             su  3. heinäkuuta 2022 06.29.32
     power-profiles-daemon-0.12-1.fc36.x86_64      su  3. heinäkuuta 2022 06.29.32
     piper-0.7-1.fc36.noarch                       su  3. heinäkuuta 2022 06.29.32
     gnome-software-42.3-1.fc36.x86_64             su  3. heinäkuuta 2022 06.29.32
     ansible-core-2.12.7-1.fc36.noarch             su  3. heinäkuuta 2022 06.29.32
     python3-pycryptodomex-3.15.0-1.fc36.x86_64    su  3. heinäkuuta 2022 06.29.31
     flexiblas-openblas-openmp-3.2.0-4.fc36.x86_64 su  3. heinäkuuta 2022 06.29.31
     
* EFI boot manager output (efibootmgr -v):
     BootCurrent: 0001
     Timeout: 1 seconds
     BootOrder: 0001,0000
     Boot0000* Fedora	HD(1,GPT,05d6ce60-0cfb-4c1c-9928-ed4e32ba8b38,0x800,0x12c000)/File(\EFI\FEDORA\SHIMX64.EFI)
     Boot0001* Fedora	HD(1,GPT,05d6ce60-0cfb-4c1c-9928-ed4e32ba8b38,0x800,0x12c000)/File(\EFI\FEDORA\SHIM.EFI)..BO
     

Its not the same configuration but 2nvme old generation raid0 ext4

4 KiB <<< . (ext4 /dev/md126): request=1 time=117.2 us (warmup)
4 KiB <<< . (ext4 /dev/md126): request=2 time=1.48 ms
4 KiB <<< . (ext4 /dev/md126): request=3 time=1.32 ms
4 KiB <<< . (ext4 /dev/md126): request=4 time=668.0 us
4 KiB <<< . (ext4 /dev/md126): request=5 time=744.7 us
4 KiB <<< . (ext4 /dev/md126): request=6 time=811.2 us
4 KiB <<< . (ext4 /dev/md126): request=7 time=1.16 ms
4 KiB <<< . (ext4 /dev/md126): request=8 time=940.1 us
4 KiB <<< . (ext4 /dev/md126): request=9 time=987.2 us
4 KiB <<< . (ext4 /dev/md126): request=10 time=936.0 us

— . (ext4 /dev/md126) ioping statistics —
9 requests completed in 9.06 ms, 36 KiB read, 993 iops, 3.88 MiB/s
generated 10 requests in 9.00 s, 40 KiB, 1 iops, 4.44 KiB/s
min/avg/max/mdev = 668.0 us / 1.01 ms / 1.48 ms / 254.4 us

Had a raid card or motherboard ?

I have an Asrock X570 Taichi motherboard, and if it does have a built-in RAID function, I have not enabled it. I also do not have a RAID accessory card.

Your results are much more in line with what I would expect to have seen from my single NVMe drive.

I had tested that ext4 is more faster than other fs !!!
try it and post your result :slight_smile: