Added nvidia
@job79 was correct here. I mixed up two commands. It’s either rpm-ostree reset
or rpm-ostree override reset -a
.
But it looks like something else is broken on this system. It would probably help if we could find what commands makes the system read only so that we can look at the logs at that time.
If you do not want to spend more time investigating, re-installing is also an option.
I am also experiencing this issue on Fedora 40 Kinoite for whatever that’s worth.
When looking at journalctl -b
, there are a lot of btrfs errors but I think they are the symptoms rather than the cause.
Here is the point in time where I suspect the system was kicked into read-only.
Interestingly, Vesktop(a third-party discord flatpak client) also crashed before this happened, although again as with the same with the btrfs errors, it might be a symptom, not the cause, and it is also running even when the system is in read-only.
Another possible cause could be me modifying the plasma desktop widgets and there being some kind of bug as I remembered doing that during the multiple times fedora died - but that seems exceedingly unlikely.
I am trying to test and isolate this problem right now, anyone has any other ideas?
Edit: system went into read-only without doing either of the above. however, this happened shortly after I ran ostree -h
, so there might be something up with that. I will try to keep this installation as long as possible to find the root cause but this is happening on my main machine.
Sorry about the prompt in the screenshot, I could not remove it during the read-only state the system was in. ↩︎
After doing rpm-ostree reset
, the system is almost instantly read only after boot.
I suspect something is up with the rpm-ostree system.
Here are some journalctl
display photos I managed to get
(The top and bottom seems to be the system going into read only before loading sddm and kde)
Video of journalctl since I am not able to dump it
Probably going to just reinstall at this point since system is not going to be able to boot
This may be a BTRFS issue.
The first image seems to indicate a btrfs issue which would force the read only status for mounting.
The system just booted up normally right after I sent the last message.
Managed to log in and dump the journal,
It booted up right after I sent the reply…
I am trying to upload the journal dump and link it here but akismet flagged google drive
Most on this forum do not like downloading files. Please post that somewhere that we can see it on the browser and not by downloading. I believe google drive would force downloading.
https://paste.fo/raw/1f54b609908a
hope this works
edit: forgot to edit out the earlier entries, the problematic bit is down at the end.
last boot is fine, second to last boot crashed sddm and need to ctrl+alt+F3
to go into the terminal as shown in the video.
From that it appears to be btrfs.
Aug 17 23:50:08 fedora systemd[1606]: Finished grub-boot-success.service - Mark boot as successful.
Aug 17 23:51:34 fedora systemd[1606]: Started app-org.mozilla.firefox@81faaccf1db9441293b74627b5d0e132.service - Firefox Web Browser - Web Browser.
Aug 17 23:51:34 fedora systemd[1606]: Started app-flatpak-org.mozilla.firefox-3345.scope.
Aug 17 23:51:35 fedora plasmashell[1940]: error creating screencast "Could not find window id {11af46ad-8f67-48b1-9921-813610fc9d43}"
Aug 17 23:52:06 fedora kioworker[3041]: kf.kio.core.connection: Socket not connected QLocalSocket::PeerClosedError
Aug 17 23:52:06 fedora kioworker[3041]: kf.kio.core: An error occurred during write. The worker terminates now.
Aug 17 23:52:06 fedora kioworker[3935]: kf.kio.core.connection: Socket not connected QLocalSocket::PeerClosedError
Aug 17 23:52:06 fedora kioworker[3935]: kf.kio.core: An error occurred during write. The worker terminates now.
Aug 17 23:52:09 fedora kioworker[3973]: kf.kio.core.connection: Socket not connected QLocalSocket::PeerClosedError
Aug 17 23:52:09 fedora kioworker[3973]: kf.kio.core: An error occurred during write. The worker terminates now.
Aug 17 23:52:24 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:52:24 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:52:24 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:52:24 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:52:33 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:33 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:33 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:33 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:33 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:35 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:35 fedora kwin_wayland[1708]: kwin_scene_opengl: 0x3: GL_INVALID_OPERATION in glDrawBuffers(unsupported buffer GL_BACK_LEFT)
Aug 17 23:52:55 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:52:55 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:52:55 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:52:55 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:03 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:24 fedora systemd[1606]: Starting systemd-tmpfiles-clean.service - Cleanup of User's Temporary Files and Directories...
Aug 17 23:53:24 fedora systemd[1606]: Finished systemd-tmpfiles-clean.service - Cleanup of User's Temporary Files and Directories.
Aug 17 23:53:27 fedora kernel: btrfs_validate_extent_buffer: 6 callbacks suppressed
Aug 17 23:53:27 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:27 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:27 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:27 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:28 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:28 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:28 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:28 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:28 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:28 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:37 fedora kernel: btrfs_validate_extent_buffer: 2 callbacks suppressed
Aug 17 23:53:37 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:37 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:53:37 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:53:37 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:06 fedora dolphin[2933]: The cached device pixel ratio value was stale on window update. Please file a QTBUG which explains how to reproduce.
Aug 17 23:55:06 fedora dolphin[2933]: QGestureManager::deliverEvent: could not find the target for gesture
Aug 17 23:55:09 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: Invalid transfer: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:55:09 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: g_strv_length: assertion 'str_array != NULL' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:55:09 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: g_strv_length: assertion 'str_array != NULL' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:55:09 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: g_strv_length: assertion 'str_array != NULL' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:55:09 fedora firefox-bin[3358]: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: Invalid transfer
Aug 17 23:55:09 fedora firefox-bin[3358]: g_strv_length: assertion 'str_array != NULL' failed
Aug 17 23:55:09 fedora firefox-bin[3358]: g_strv_length: assertion 'str_array != NULL' failed
Aug 17 23:55:09 fedora firefox-bin[3358]: g_strv_length: assertion 'str_array != NULL' failed
Aug 17 23:55:34 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:34 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:34 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:34 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:44 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:44 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:44 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:44 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:45 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:45 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:45 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:45 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:45 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:55:45 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:55:48 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: Server is missing xdg_foreign support: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:55:48 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: Failed to export handle, could not set transient for: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:55:48 fedora firefox-bin[3358]: Server is missing xdg_foreign support
Aug 17 23:55:48 fedora firefox-bin[3358]: Failed to export handle, could not set transient for
Aug 17 23:56:04 fedora dolphin[2933]: The cached device pixel ratio value was stale on window update. Please file a QTBUG which explains how to reproduce.
Aug 17 23:56:05 fedora dolphin[2933]: QGestureManager::deliverEvent: could not find the target for gesture
Aug 17 23:56:06 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: Invalid transfer: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:56:06 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: g_strv_length: assertion 'str_array != NULL' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:56:06 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: g_strv_length: assertion 'str_array != NULL' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:56:06 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: g_strv_length: assertion 'str_array != NULL' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:56:06 fedora firefox-bin[3358]: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: Invalid transfer
Aug 17 23:56:06 fedora firefox-bin[3358]: g_strv_length: assertion 'str_array != NULL' failed
Aug 17 23:56:06 fedora firefox-bin[3358]: g_strv_length: assertion 'str_array != NULL' failed
Aug 17 23:56:06 fedora firefox-bin[3358]: g_strv_length: assertion 'str_array != NULL' failed
Aug 17 23:56:06 fedora dolphin[2933]: kf.purpose.externalprocess: Cannot initialize model for plugin type "Export" with data QJsonObject(): missing key "urls"
Aug 17 23:56:06 fedora dolphin[2933]: QGestureManager::deliverEvent: could not find the target for gesture
Aug 17 23:56:13 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: Server is missing xdg_foreign support: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:56:13 fedora flatpak[3358]: [Parent 2, Main Thread] WARNING: Failed to export handle, could not set transient for: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
Aug 17 23:56:13 fedora firefox-bin[3358]: Server is missing xdg_foreign support
Aug 17 23:56:13 fedora firefox-bin[3358]: Failed to export handle, could not set transient for
Aug 17 23:56:23 fedora kernel: btrfs_validate_extent_buffer: 38 callbacks suppressed
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 1 wanted 52210 found 57219
Aug 17 23:56:23 fedora kernel: BTRFS error (device nvme0n1p3): parent transid verify failed on logical 831651840 mirror 2 wanted 52210 found 57219
Aug 17 23:57:40 fedora kwin_wayland[1708]: This plugin does not support raise()
Aug 17 23:57:41 fedora kwin_wayland[1708]: This plugin does not support raise()
Aug 17 23:57:45 fedora systemd[1606]: Started app-org.gnome.TextEditor@c523b166da834b7fbd25d28b26f3717a.service - Text Editor - Text Editor.
Aug 17 23:57:45 fedora systemd[1606]: Started app-flatpak-org.gnome.TextEditor-4825.scope.
Aug 17 23:57:45 fedora xdg-desktop-portal-kde[2039]: xdp-kde-settings: Namespace "org.gnome.desktop.a11y.interface" is not supported
Aug 17 23:57:46 fedora kwin_wayland[1708]: kwin_core: Cannot grant a token to KWin::ClientConnection(0x560d2cdf70c0)
Aug 17 23:57:46 fedora kwin_wayland[1708]: kwin_core: Cannot grant a token to KWin::ClientConnection(0x560d2cdf70c0)
Aug 17 23:57:48 fedora gnome-text-edit[4838]: Finalizing GtkSourceGutter 0x55e422acebc0, but it still has children left:
- GtkSourceGutterRendererLines 0x55e422ad06d0
Aug 17 23:58:08 fedora systemd[1]: flatpak-system-helper.service: Deactivated successfully.
Aug 17 23:58:08 fedora audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=flatpak-system-helper comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Aug 17 23:58:56 fedora konsole[3260]: kf.windowsystem: static int KX11Extras::currentDesktop() may only be used on X11
Aug 17 23:58:56 fedora konsole[3260]: kf.windowsystem: static void KX11Extras::setOnDesktop(WId, int) may only be used on X11
though I did not dig deep enough to see what triggered it.
the issue was quite intermittent - I guess only some parts of the file system was corrupted? Am going to try to run rpm-ostree reset
again and report back
Did rpm-ostree update
and let it update to the kinoite 0818 build, system booted and stays normal for almost 4 hours with no read-only mode shenanigans.
edit: checked SMART but no errors there, will try to make a bootable usb stick and check the file system from there.
Try some BTRFS fixes.
sudo btrfs filesystem resize max /
(Only if you cloned the partition, otherwise harmless)
And try the 3 BTRFS filesystem repair things
sudo btrfs balance /
sudo btrfs filesystem defragment -r /var # I think you need /var, / doesnt work, may want to use /etc and others too
sudo btrfs scrub start /