Silverblue @ update: Remount error

When my system updates (so either rpm-ostree update or the automatic background update), the whole system gets frozen into a read-only state at some point. My file system is then not writable anymore and I have to reboot to be able to work again. The error looks like this:

❯ rpm-ostree update
…
…
rpm-md repo 'updates-archive' (cached); generated: 2024-05-02T02:13:06Z solvables: 45817
Resolving dependencies... done
Applying 2 overrides and 201 overlays
Processing packages... done
Running pre scripts... done
Running post scripts... done
Running posttrans scripts... done
Writing rpmdb... done
Writing OSTree commit... done
Staging deployment... done
error: Staging deployment: Cleaning deployments: Removing ostree/deploy/fedora/deploy/3fd29d12b510aabcc32bd5ab5a6262b4d1a4da43efc7a70788c11837f1afa140.0: unlinkat(classic-topbar-network-cellular-acquiring.svg): Das Dateisystem ist nur lesbar (engl.: „File system is read-only“)

❯ LANG=en_US.utf8; rpm-ostree update
error: Remounting /sysroot read-write: Das Argument ist ungültig (engl.: „Argument not valid“)

Some background: Lately, I ran into the bootloader-kernel-issue (F39/F40: Fails to boot on with "vmlinuz has invalid signature" · Issue #543 · fedora-silverblue/issue-tracker · GitHub), then I followed the step described there, then the above problem occurred. Seemed to me like they might have something to do with each other.

I’d be very glad if someone could help me. :slight_smile:

1 Like

I would start by trying to recreate the update process and checking it with --verbose

rpm-ostree update --verbose Let’s see what that returns.

Check Logs with :

journalctl -b -1 | grep rpm-ostree

This might contain details about the update process and potential errors.

There are some more deep commands to run, but let’s see what that returns.

Thanks for your help! Sadly, there is just a --verbose for rpm-ostree status, none for update.

journalctl shows, that after the starting commands, the %post commands follow, where akmod-nvidia issues pretty much exactly 5000 needs lines, which I don’t want to past here. But here’s the start:

Mai 11 22:55:20 khazad-dum systemd[1]: Started rpm-ostree-countme.timer - Weekly rpm-ostree Count Me timer.
Mai 11 22:55:20 khazad-dum systemd[1]: rpm-ostree-fix-shadow-mode.service - Update permissions for /etc/shadow was skipped because of an unmet condition check (ConditionPathExists=!/etc/.rpm-ostree-shadow-mode-fixed.stamp).
Mai 11 22:55:43 khazad-dum systemd[1]: Starting rpm-ostreed.service - rpm-ostree System Management Daemon...
Mai 11 22:55:43 khazad-dum rpm-ostree[3676]: Reading config file '/etc/rpm-ostreed.conf'
Mai 11 22:55:45 khazad-dum rpm-ostree[3676]: In idle state; will auto-exit in 64 seconds
Mai 11 22:55:45 khazad-dum audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=rpm-ostreed comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Mai 11 22:55:45 khazad-dum systemd[1]: Started rpm-ostreed.service - rpm-ostree System Management Daemon.
Mai 11 22:55:45 khazad-dum rpm-ostree[3676]: Allowing active client :1.112 (uid 1000)
Mai 11 22:55:45 khazad-dum rpm-ostree[3676]: client(id:gnome-software dbus:1.112 unit:app-gnome-org.gnome.Software-2752.scope uid:1000) added; new total=1
Mai 11 22:55:48 khazad-dum rpm-ostree[3676]: Loaded sysroot
Mai 11 22:55:48 khazad-dum rpm-ostree[3676]: Locked sysroot
Mai 11 22:55:48 khazad-dum rpm-ostree[3676]: Initiated txn RefreshMd for client(id:gnome-software dbus:1.112 unit:app-gnome-org.gnome.Software-2752.scope uid:1000): /org/projectatomic/rpmostree1/fedora
Mai 11 22:55:48 khazad-dum rpm-ostree[3676]: Process [pid: 2752 uid: 1000 unit: user@1000.service] connected to transaction progress
Mai 11 22:55:48 khazad-dum rpm-ostree[3676]: Librepo version: 1.17.1 with CURL_GLOBAL_ACK_EINTR support (libcurl/8.2.1 OpenSSL/3.1.1 zlib/1.2.13 brotli/1.1.0 libidn2/2.3.7 libpsl/0.21.2 (+libidn2/2.3.4) libssh/0.10.6/openssl/zlib nghttp2/1.55.
1 OpenLDAP/2.6.6)
Mai 11 22:55:52 khazad-dum rpm-ostree[3676]: Txn RefreshMd on /org/projectatomic/rpmostree1/fedora successful
Mai 11 22:55:52 khazad-dum rpm-ostree[3676]: Unlocked sysroot
Mai 11 22:55:52 khazad-dum rpm-ostree[3676]: Process [pid: 2752 uid: 1000 unit: user@1000.service] disconnected from transaction progress
Mai 11 22:55:53 khazad-dum rpm-ostree[3676]: Handling GetPackages for caller :1.112
Mai 11 22:55:53 khazad-dum rpm-ostree[3676]: Enabled rpm-md repositories: fedora-cisco-openh264 updates fedora rpmfusion-free rpmfusion-nonfree google-chrome rpmfusion-nonfree-nvidia-driver rpmfusion-nonfree-steam rpmfusion-nonfree-updates rpm
fusion-free-updates phracek-PyCharm copr:copr.fedorainfracloud.org:dusansimic:themes copr:copr.fedorainfracloud.org:atim:starship copr:copr.fedorainfracloud.org:peterwu:rendezvous updates-archive
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: Importing rpm-md...done
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'fedora-cisco-openh264' (cached); generated: 2023-12-12T17:22:46Z solvables: 4
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'updates' (cached); generated: 2024-05-11T02:14:07Z solvables: 27180
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'fedora' (cached); generated: 2023-11-01T00:12:39Z solvables: 70825
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-free' (cached); generated: 2023-11-04T16:49:08Z solvables: 445
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree' (cached); generated: 2023-11-04T17:26:32Z solvables: 208
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'google-chrome' (cached); generated: 2024-05-09T21:06:21Z solvables: 3
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree-nvidia-driver' (cached); generated: 2024-05-02T14:37:09Z solvables: 29
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree-steam' (cached); generated: 2024-04-20T13:10:44Z solvables: 2
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree-updates' (cached); generated: 2024-05-08T12:16:26Z solvables: 86
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-free-updates' (cached); generated: 2024-05-08T11:56:17Z solvables: 179
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'phracek-PyCharm' (cached); generated: 2024-03-18T11:54:48Z solvables: 14
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'copr:copr.fedorainfracloud.org:dusansimic:themes' (cached); generated: 2023-10-15T08:46:30Z solvables: 2
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'copr:copr.fedorainfracloud.org:atim:starship' (cached); generated: 2024-04-05T10:06:29Z solvables: 2
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'copr:copr.fedorainfracloud.org:peterwu:rendezvous' (cached); generated: 2024-04-24T08:43:42Z solvables: 6
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: rpm-md repo 'updates-archive' (cached); generated: 2024-05-11T03:05:12Z solvables: 47789
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: Handling GetPackages for caller :1.112
Mai 11 22:55:57 khazad-dum rpm-ostree[3676]: Enabled rpm-md repositories: fedora-cisco-openh264 updates fedora rpmfusion-free rpmfusion-nonfree google-chrome rpmfusion-nonfree-nvidia-driver rpmfusion-nonfree-steam rpmfusion-nonfree-updates rpm
fusion-free-updates phracek-PyCharm copr:copr.fedorainfracloud.org:dusansimic:themes copr:copr.fedorainfracloud.org:atim:starship copr:copr.fedorainfracloud.org:peterwu:rendezvous updates-archive
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: Importing rpm-md...done
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'fedora-cisco-openh264' (cached); generated: 2023-12-12T17:22:46Z solvables: 4
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'updates' (cached); generated: 2024-05-11T02:14:07Z solvables: 27180
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'fedora' (cached); generated: 2023-11-01T00:12:39Z solvables: 70825
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-free' (cached); generated: 2023-11-04T16:49:08Z solvables: 445
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree' (cached); generated: 2023-11-04T17:26:32Z solvables: 208
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'google-chrome' (cached); generated: 2024-05-09T21:06:21Z solvables: 3
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree-nvidia-driver' (cached); generated: 2024-05-02T14:37:09Z solvables: 29
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree-steam' (cached); generated: 2024-04-20T13:10:44Z solvables: 2
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-nonfree-updates' (cached); generated: 2024-05-08T12:16:26Z solvables: 86
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'rpmfusion-free-updates' (cached); generated: 2024-05-08T11:56:17Z solvables: 179
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'phracek-PyCharm' (cached); generated: 2024-03-18T11:54:48Z solvables: 14
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'copr:copr.fedorainfracloud.org:dusansimic:themes' (cached); generated: 2023-10-15T08:46:30Z solvables: 2
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'copr:copr.fedorainfracloud.org:atim:starship' (cached); generated: 2024-04-05T10:06:29Z solvables: 2
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'copr:copr.fedorainfracloud.org:peterwu:rendezvous' (cached); generated: 2024-04-24T08:43:42Z solvables: 6
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: rpm-md repo 'updates-archive' (cached); generated: 2024-05-11T03:05:12Z solvables: 47789
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: Allowing active client :1.140 (uid 1000)
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: client(id:cli dbus:1.140 unit:flatpak-session-helper.service uid:1000) added; new total=2
Mai 11 22:56:00 khazad-dum rpm-ostree[3676]: client(id:cli dbus:1.140 unit:flatpak-session-helper.service uid:1000) vanished; remaining=1
Mai 11 22:56:04 khazad-dum rpm-ostree[3676]: Allowing active client :1.143 (uid 1000)
Mai 11 22:56:04 khazad-dum rpm-ostree[3676]: client(id:cli dbus:1.143 unit:flatpak-session-helper.service uid:1000) added; new total=2
Mai 11 22:56:04 khazad-dum rpm-ostree[3676]: Loaded sysroot
Mai 11 22:56:04 khazad-dum rpm-ostree[3676]: Locked sysroot
Mai 11 22:56:04 khazad-dum rpm-ostree[3676]: Initiated txn Upgrade for client(id:cli dbus:1.143 unit:flatpak-session-helper.service uid:1000): /org/projectatomic/rpmostree1/fedora
Mai 11 22:56:04 khazad-dum rpm-ostree[3676]: Process [pid: 5169 uid: 1000 unit: user@1000.service] connected to transaction progress
Mai 11 22:56:06 khazad-dum rpm-ostree[3676]: libostree pull from 'fedora' for fedora/39/x86_64/silverblue complete
Mai 11 22:56:06 khazad-dum rpm-ostree[3676]: 2 metadata, 0 content objects fetched; 788 B transferred in 2 seconds; 0 Bytes content written
Mai 11 22:56:23 khazad-dum rpm-ostree[3676]: Preparing pkg txn; enabled repos: ['fedora-cisco-openh264', 'updates', 'fedora', 'rpmfusion-free', 'rpmfusion-nonfree', 'google-chrome', 'rpmfusion-nonfree-nvidia-driver', 'rpmfusion-nonfree-steam',
 'rpmfusion-nonfree-updates', 'rpmfusion-free-updates', 'phracek-PyCharm', 'copr:copr.fedorainfracloud.org:dusansimic:themes', 'copr:copr.fedorainfracloud.org:atim:starship', 'copr:copr.fedorainfracloud.org:peterwu:rendezvous', 'updates-archiv
e'] solvables: 146774
Mai 11 22:56:29 khazad-dum rpm-ostree[3676]: Executed %prein for akmods in 167 ms
Mai 11 22:56:29 khazad-dum rpm-ostree[3676]: Executed %prein for xorg-x11-drv-nvidia in 78 ms
Mai 11 22:56:29 khazad-dum rpm-ostree[3676]: Executed %prein for mfcl3770cdwpdrv in 74 ms
Mai 11 22:56:29 khazad-dum rpm-ostree(binutils-gold.post)[6375]: failed to link /usr/bin/ld -> /etc/alternatives/ld: /usr/bin/ld exists and it is not a symlink
Mai 11 22:56:29 khazad-dum rpm-ostree[3676]: Executed %post for binutils-gold in 80 ms
Mai 11 22:56:29 khazad-dum rpm-ostree[3676]: Executed %post for binutils in 80 ms
Mai 11 22:56:29 khazad-dum rpm-ostree[3676]: Executed %post for sdubby in 70 ms
Mai 11 22:56:30 khazad-dum rpm-ostree[3676]: Executed %post for nvidia-persistenced in 143 ms
Mai 11 22:56:30 khazad-dum rpm-ostree[3676]: Executed %post for kernel-devel in 68 ms
Mai 11 22:56:30 khazad-dum rpm-ostree[3676]: Executed %post for fakeroot in 96 ms
Mai 11 22:56:30 khazad-dum rpm-ostree(akmods.post)[6528]: Created symlink /etc/systemd/system/multi-user.target.wants/akmods.service → /usr/lib/systemd/system/akmods.service.
Mai 11 22:56:30 khazad-dum rpm-ostree[3676]: Executed %post for akmods in 258 ms
Mai 11 22:56:30 khazad-dum rpm-ostree(xorg-x11-drv-nvidia-power.post)[6579]: Created symlink /etc/systemd/system/systemd-hibernate.service.wants/nvidia-hibernate.service → /usr/lib/systemd/system/nvidia-hibernate.service.
Mai 11 22:56:30 khazad-dum rpm-ostree(xorg-x11-drv-nvidia-power.post)[6583]: Created symlink /etc/systemd/system/multi-user.target.wants/nvidia-powerd.service → /usr/lib/systemd/system/nvidia-powerd.service.
Mai 11 22:56:30 khazad-dum rpm-ostree(xorg-x11-drv-nvidia-power.post)[6587]: Created symlink /etc/systemd/system/systemd-suspend.service.wants/nvidia-resume.service → /usr/lib/systemd/system/nvidia-resume.service.
Mai 11 22:56:30 khazad-dum rpm-ostree(xorg-x11-drv-nvidia-power.post)[6587]: Created symlink /etc/systemd/system/systemd-hibernate.service.wants/nvidia-resume.service → /usr/lib/systemd/system/nvidia-resume.service.
Mai 11 22:56:30 khazad-dum rpm-ostree(xorg-x11-drv-nvidia-power.post)[6590]: Created symlink /etc/systemd/system/systemd-suspend.service.wants/nvidia-suspend.service → /usr/lib/systemd/system/nvidia-suspend.service.
Mai 11 22:56:30 khazad-dum rpm-ostree[3676]: Executed %post for xorg-x11-drv-nvidia-power in 294 ms
Mai 11 22:56:31 khazad-dum rpm-ostree(xorg-x11-drv-nvidia.post)[6623]: sed: /etc/default/grub kann nicht gelesen werden: Datei oder Verzeichnis nicht gefunden
Mai 11 22:56:31 khazad-dum rpm-ostree[3676]: Executed %post for xorg-x11-drv-nvidia in 139 ms
Mai 11 22:56:31 khazad-dum rpm-ostree(akmod-nvidia.post)[6643]: Building /usr/src/akmods/nvidia-kmod-550.78-1.fc39.src.rpm for kernel 6.8.9-200.fc39.x86_64
Mai 11 22:59:55 khazad-dum rpm-ostree(akmod-nvidia.post)[6651]: /tmp/akmods-post.5n1HWyue/results/kmod-nvidia-6.8.9-200.fc39.x86_64-550.78-1.fc39.x86_64.rpm
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-x86_64.ko.xz needs "twofish_setkey": /lib/modules/6.8.9-200.fc39.x86_64/kernel/crypto/twofish_common.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-x86_64-3way.ko.xz needs "twofish_dec_blk": /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-x86_64.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-x86_64-3way.ko.xz needs "twofish_setkey": /lib/modules/6.8.9-200.fc39.x86_64/kernel/crypto/twofish_common.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-avx-x86_64.ko.xz needs "twofish_dec_blk": /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-x86_64.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-avx-x86_64.ko.xz needs "twofish_dec_blk_3way": /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-x86_64-3way.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/twofish-avx-x86_64.ko.xz needs "twofish_setkey": /lib/modules/6.8.9-200.fc39.x86_64/kernel/crypto/twofish_common.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko.xz needs "__serpent_setkey": /lib/modules/6.8.9-200.fc39.x86_64/kernel/crypto/serpent_generic.ko.xz

And here the end – fhe first commands which follow are just some RPMs, added to the OS image. Then immediately the RO-filesystem errors arise:

Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-modeset.ko.xz needs "nvidia_get_rm_ops": /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-modeset.ko.xz needs "__acpi_video_get_backlight_type": /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/acpi/video.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-drm.ko.xz needs "nvKmsKapiGetFunctionsTable": /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-modeset.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-uvm.ko.xz needs "nvUvmInterfaceDisableAccessCntr": /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia.ko.xz
Mai 11 23:00:13 khazad-dum rpm-ostree[3676]: Executed %post for akmod-nvidia in 222251 ms
Mai 11 23:00:13 khazad-dum rpm-ostree(brscan4.post)[24460]: This software is based in part on the work of the Independent JPEG Group.
Mai 11 23:00:13 khazad-dum rpm-ostree[3676]: Executed %post for brscan4 in 171 ms
Mai 11 23:00:13 khazad-dum rpm-ostree[3676]: Executed %post for brscan-skey in 137 ms
Mai 11 23:00:13 khazad-dum rpm-ostree[3676]: Executed %post for brother-udev-rule-type1 in 144 ms
Mai 11 23:00:13 khazad-dum rpm-ostree[3676]: Executed %post for android-tools in 134 ms
Mai 11 23:00:14 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24650]: mkdir: das Verzeichnis „/var/spool“ kann nicht angelegt werden: Das Dateisystem ist nur lesbar
Mai 11 23:00:14 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24652]: chown: Zugriff auf '/var/spool/lpd/mfcl3770cdw' nicht möglich: Datei oder Verzeichnis nicht gefunden
Mai 11 23:00:14 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24654]: chgrp: Zugriff auf '/var/spool/lpd/mfcl3770cdw' nicht möglich: Datei oder Verzeichnis nicht gefunden
Mai 11 23:00:14 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24656]: chmod: Zugriff auf '/var/spool/lpd/mfcl3770cdw' nicht möglich: Datei oder Verzeichnis nicht gefunden
Mai 11 23:00:16 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24751]: lpinfo: Ungültiger Dateideskriptor
Mai 11 23:00:16 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24658]: lpadmin -p MFCL3770CDW -E -v usb://dev/usb/lp0 -P /usr/share/cups/model/Brother/brother_mfcl3770cdw_printer_en.ppd
Mai 11 23:00:16 khazad-dum rpm-ostree(mfcl3770cdwpdrv.post)[24752]: lpadmin: Kann nicht mit dem Server verbinden: Ungültiger Dateideskriptor
Mai 11 23:00:24 khazad-dum rpm-ostree[3676]: Executed %post for mfcl3770cdwpdrv in 10811 ms
Mai 11 23:00:24 khazad-dum rpm-ostree[3676]: Executed %posttrans for akmod-nvidia in 71 ms
Mai 11 23:00:24 khazad-dum rpm-ostree[3676]: No files matched %transfiletriggerin(lib) for glibc-common
Mai 11 23:00:24 khazad-dum rpm-ostree[3676]: No files matched %transfiletriggerin(lib64) for glibc-common
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(glibc-common) for lib, lib64, usr/lib, usr/lib64 in 1242 ms; 34259 matched files
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(hicolor-icon-theme) for usr/share/icons/hicolor in 176 ms; 220 matched files
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(glib2) for usr/lib64/gio/modules in 116 ms; 7 matched files
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(glib2) for usr/share/glib-2.0/schemas in 143 ms; 111 matched files
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: No files matched %transfiletriggerin(usr/local/share/fonts) for fontconfig
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: No files matched %transfiletriggerin(usr/share/X11/fonts/TTF) for fontconfig
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: No files matched %transfiletriggerin(usr/share/X11/fonts/Type1) for fontconfig
Mai 11 23:00:26 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(fontconfig) for usr/local/share/fonts, usr/share/X11/fonts/TTF, usr/share/X11/fonts/Type1, usr/share/fonts in 288 ms; 254 matched files
Mai 11 23:00:27 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(shared-mime-info) for usr/share/mime in 87 ms; 877 matched files
Mai 11 23:00:27 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(gdk-pixbuf2) for usr/lib64/gdk-pixbuf-2.0/2.10.0/loaders in 174 ms; 15 matched files
Mai 11 23:00:27 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(desktop-file-utils) for usr/share/applications in 102 ms; 84 matched files
Mai 11 23:00:28 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(appstream) for usr/share/app-info/xmls in 1030 ms; 7 matched files
Mai 11 23:00:28 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(fedora-third-party) for usr/lib/fedora-third-party/conf.d in 325 ms; 3 matched files
Mai 11 23:00:29 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(systemd-udev) for usr/lib/udev/hwdb.d in 817 ms; 38 matched files
Mai 11 23:00:29 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(systemd-udev) for usr/lib/udev/rules.d in 71 ms; 123 matched files
Mai 11 23:00:29 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(adwaita-icon-theme) for usr/share/icons/Adwaita in 123 ms; 896 matched files
Mai 11 23:00:29 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(gtk3) for usr/lib64/gtk-3.0/3.0.0/immodules in 128 ms; 1 matched files
Mai 11 23:00:30 khazad-dum rpm-ostree[3676]: Executed %transfiletriggerin(ibus) for usr/share/ibus/component in 549 ms; 10 matched files
Mai 11 23:00:30 khazad-dum rpm-ostree[3676]: sanitycheck(/usr/bin/true) successful
Mai 11 23:00:33 khazad-dum rpm-ostree[3676]: Regenerating rpmdb for target
Mai 11 23:03:01 khazad-dum rpm-ostree[3676]: Wrote commit: 2ac840624768e23c563ab5f9048f289fb761acb0a6b44665aae1f95292d41df6; New objects: meta:246 content:17 totaling 135,3 MB)

My bad ! :upside_down_face:

Although it looks like you are having some Nvidia issues. Have you tried reinstalling?

I haven’t thought that file system locking has something to do with driver building, so I didn’t try before – but now I did (I also tried to remove akmod-nvidia etc, but all versions lead to the same result):

❯ sudo rpm-ostree remove xorg-x11-drv-nvidia xorg-x11-drv-nvidia-cuda xorg-x11-drv-nvidia-cuda-libs
Checking out tree b71450c... done
Resolving dependencies... done
Applying 2 overrides and 198 overlays
Processing packages... done
Running pre scripts... done
Running post scripts... done
error: Running %post for akmod-nvidia: bwrap(/bin/sh): Vorgang wurde abgebrochen [engl.: “transaction was aborted”]; run `journalctl -t 'rpm-ostree(akmod-nvidia.post)'` for more information

Where:

❯ journalctl -t 'rpm-ostree(akmod-nvidia.post)' | tail
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/kernel/net/qrtr/qrtr-mhi.ko.xz needs "mhi_queue_skb": /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/bus/mhi/host/mhi.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-modeset.ko.xz needs "nvidia_get_rm_ops": /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-modeset.ko.xz needs "__acpi_video_get_backlight_type": /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/acpi/video.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-drm.ko.xz needs "nvKmsKapiGetFunctionsTable": /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-modeset.ko.xz
Mai 11 23:00:12 khazad-dum rpm-ostree(akmod-nvidia.post)[23965]: /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia-uvm.ko.xz needs "nvUvmInterfaceDisableAccessCntr": /lib/modules/6.8.9-200.fc39.x86_64/extra/nvidia/nvidia.ko.xz
-- Boot 27f01185fffb4304b1015397c11e3c2a --
Mai 12 22:37:20 khazad-dum rpm-ostree(akmod-nvidia.post)[676859]: Building /usr/src/akmods/nvidia-kmod-550.78-1.fc39.src.rpm for kernel 6.8.9-200.fc39.x86_64
Mai 12 22:54:08 khazad-dum rpm-ostree(akmod-nvidia.post)[726493]: Building /usr/src/akmods/nvidia-kmod-550.78-1.fc39.src.rpm for kernel 6.8.9-200.fc39.x86_64
Mai 12 23:17:04 khazad-dum rpm-ostree(akmod-nvidia.post)[789423]: Building /usr/src/akmods/nvidia-kmod-550.78-1.fc39.src.rpm for kernel 6.8.7-200.fc39.x86_64
Mai 12 23:18:48 khazad-dum rpm-ostree(akmod-nvidia.post)[796956]: Building /usr/src/akmods/nvidia-kmod-550.78-1.fc39.src.rpm for kernel 6.8.7-200.fc39.x86_64
1 Like

So I can’t even uninstall the NVIDIA driver anymore. Does anyone have an idea how to do this?

Added atomic-desktops, bootupd, grub, rpm-ostree, secure-boot

Can we get a rpm-ostree status ?

Did you exactly follow these steps?

# Enter a root shell on the host (i.e. not in a toolbox)
sudo -i

# Make a backup of the content of the EFI partition
cd /boot/efi/
cp -a EFI EFI.bkp

# Copy updated bootloader versions
cp /usr/lib/ostree-boot/efi/EFI/BOOT/{BOOTIA32.EFI,BOOTX64.EFI,fbia32.efi,fbx64.efi} /boot/efi/EFI/BOOT/
cp /usr/lib/ostree-boot/efi/EFI/fedora/{BOOTIA32.CSV,BOOTX64.CSV,grubia32.efi,grubx64.efi,mmia32.efi,mmx64.efi,shim.efi,shimia32.efi,shimx64.efi} /boot/efi/EFI/fedora/

# Only needed if it exists already on your system
cp /usr/lib/ostree-boot/efi/EFI/fedora/shimx64.efi /boot/efi/EFI/fedora/shimx64-fedora.efi

# Sync changes to the disk
sync

# Reboot
reboot now

I followed them a bit prior and had no issues with it.

I’m pretty sure, yes. Shuld I do them again for being sure?

Of course:

❯ rpm-ostree status
State: idle
Deployments:
● fedora:fedora/39/x86_64/silverblue
                  Version: 39.20240501.0 (2024-05-01T02:05:27Z)
               BaseCommit: b71450c5bca702d62dc5df9adc3815ec6423d905f63c92aac7f6bbd05d594c22
             GPGSignature: Valid signature by E8F23996F23218640CB44CBE75CF5AC418B8E74C
      RemovedBasePackages: firefox firefox-langpacks 125.0.2-1.fc39
          LayeredPackages: akmod-nvidia android-tools bibata-cursor-themes eza fd-find
                           gnome-console gnome-tweaks igt-gpu-tools libva-utils
                           linux-libertine-fonts morewaita-icon-theme neovim nvtop ripgrep
                           rpmdevtools rpmfusion-free-release rpmfusion-nonfree-release
                           starship tilix vulkan-tools xorg-x11-drv-nvidia
                           xorg-x11-drv-nvidia-cuda xorg-x11-drv-nvidia-cuda-libs
            LocalPackages: akmods-keys-0.0.2-8.fc37.noarch
                           brother-udev-rule-type1-1.0.2-0.noarch
                           brscan-skey-0.3.1-2.x86_64 brscan4-0.4.11-1.x86_64
                           mfcl3770cdwpdrv-1.0.2-0.i386

  fedora:fedora/39/x86_64/silverblue
                  Version: 39.20240403.0 (2024-04-03T00:41:12Z)
               BaseCommit: 23c1e1e0a565124e5f2fb6dca5189ccc9f717e8b32e9447e12bc63a98997162e
             GPGSignature: Valid signature by E8F23996F23218640CB44CBE75CF5AC418B8E74C
      RemovedBasePackages: firefox firefox-langpacks 124.0.1-2.fc39
          LayeredPackages: akmod-nvidia android-tools bibata-cursor-themes eza fd-find
                           gnome-console gnome-tweaks igt-gpu-tools libva-utils
                           linux-libertine-fonts morewaita-icon-theme neovim nvtop ripgrep
                           rpmdevtools rpmfusion-free-release rpmfusion-nonfree-release
                           starship tilix vulkan-tools xorg-x11-drv-nvidia
                           xorg-x11-drv-nvidia-cuda xorg-x11-drv-nvidia-cuda-libs
            LocalPackages: akmods-keys-0.0.2-8.fc37.noarch
                           brother-udev-rule-type1-1.0.2-0.noarch
                           brscan-skey-0.3.1-2.x86_64 brscan4-0.4.11-1.x86_64
                           mfcl3770cdwpdrv-1.0.2-0.i386
                   Pinned: yes

This may be a permission issue. I dont have enough knowledge about this, but force deploying the vanilla OSTree OS may work.

If you didnt already, please mention your issues on that tracker as this is directly related.

When did you pin the previous image? You may try to rollback to that if it was made before, or just boot into it in the boot menu, then roll back.

Try resetting everything rpm-ostree reset -a, then update to latest F39, then rebase to F40, then re-apply the overrides that you need.

1 Like

There is no -a option, so I tried without. Sadly, this also is impossible, as also this operation was blocked by the RO file system very quickly. Even more astounding is the fact, that I couldn’t even save the promt result on a USB stick, as even that external stick file system was RO…?!

> rpm-ostree reset
Staging deployment... done
error: Staging deployment: Leaning deployments: Removing ostree/deploy/fedora/deploy/3fd29d12b510aabcc32bd5ab5a6262b4d1a4da43efc7a70788c11837f1afa140.0: unlinkat(classic-topbar-network-cellular-acquiring.svg): The file system is read-only
1 Like

Yes that was expected.

@siosm is there a way to download the default upstream image and deploy directly with ostree?

But @zyklon please mention this in the said issue, and try to fix there.

Also maybe using history you could maybe dig up the exact commands you ran. So we can see how you did this.

Also maybe do

sudo -i
history

if you ran it in a root shell

I re-checked the commands, they exactly match the instructions.

1 Like

Has anyone else an idea? This immutable system doesn’t seem to be so robust as advertised. :confused:

Shouldn’t rpm-ostree reset -a be rpm-ostree override reset -a? Could you try the second command and see if that works.

Thanks, that command is valid. However, also this command aborts at the NVIDIA drivers with the same error as mentioned alredy above when trying sudo rpm-ostree remove xorg-x11-drv-nvidia xorg-x11-drv-nvidia-cuda xorg-x11-drv-nvidia-cuda-libs.

❯ rpm-ostree override reset -a
Checking out tree b71450c... done
Resolving dependencies... done
Relabeling... done
Checking out packages... done
Running pre scripts... done
Running post scripts... done
error: Running %post for akmod-nvidia: bwrap(/bin/sh): Vorgang wurde abgebrochen; run `journalctl -t 'rpm-ostree(akmod-nvidia.post)'` for more information

(german “Vorgang wurde abgebrochen” = engl. “Process aborted”)

No it is reset. override is for changing the OS, reset is to let go of all changes and switch to 100% upstream.

To be fair, you are installing out of tree proprietary Kernel modules, that are not even shipped by Fedora for legal reasons.

This is totally out of the area where ostree helps you, this is simply a breakage in the kernel modification process or something.

Really, consider using ublues -nvidia images instead, as they do this unsupported action on their side, more eyes look at it and things get solved centrally and for all.

From them on you can again benefit from ostree as you have a system so stable as if these changes werent there.