Failed upgrade to Fedora 37

Hello all. I have a problem in that I have a failed upgrade attempt to Fedora 37. It’ll probably take two stages to ask my question thoroughly because I’m stuck in how to ask my question. After the upgrade attempt (from GNOME asking “Upgrade available! Do you wish to upgrade now?” or something close to that to which I responded in the affirmative), I got a character mode screen with the following message:

[begin message]
Generating “/run/initramfs/rdsosreport.txt”
Entering emergency mode. Exit the shell to continue.
Type “journalctl” to view systemlogs.

You might want to save “/run/initramfs/rdsosreport.txt” to a USB stick or /boot after mounting them and attach it to a bug report.

Press Enter for maintenance
(or press Control-D to continue):
[end message]

Pressing Ctl-D doesn’t continue so entering maintenance is the only option. I looked at the system logs but I’m not particularly versed in what I’m looking for so if that’s worth attaching, let me know where to get them and I’ll try to attach them to this thread.

I have a more basic problem at the moment. I’d like to copy the rdsosreport.txt to a USB stick but I’m not sure how to mount the stick from the command line. I put in a USB memory stick in the machine and I see a “sdb” and “sdb1” appear in the /dev folder but when I “ls” either one, I don’t see the preexisting file there (which I had there to verify that I had the correct device). The “sdb”s are not there when I remove the stick so I’m pretty certain that they represent the stick I’m inserting. I assume I have to mount one of them in some way? I tried mounting them with various mount commands but I don’t think I’m doing it correctly.

So, before I actually ask for help with the failure, how do I get the rdsosreport.txt onto a stick? Is that what is needed here? Or is it the system logs? If the latter, what files do I need to attach and where are they?

I apologize if this is a known process but I’ve been using Fedora since 34 and this is way beyond any problem I’ve ever had to deal with so it’s way beyond my capabilities. Thanks for the help.

-mraki

Assuming what you see in /dev as /dev/sdb1 is actually the usb stick, you would mount it as sudo mount /dev/sdb1 /mnt, then to see the content ls /mnt. You have to mount a device file system (/dev/sdb1) on a mount point (/mnt) before you can see the content.

To understand how mount works use man mount and read it.

Thanks for responding so quickly, jeff V. The “sudo” command does not exist in maintenance mode but no matter, I tried variations without it. I tried “mount dev/sdb1 /mnt”, “mount dev/sdb /mnt”, “mount /dev/sdb /mnt”, and “mount /dev/sdb1 /mnt” and all ended with the message:

mount: /mnt: mount point does not exist

Would you suggest any other variations? Thanks.

-mraki

Create the mount point you wish to use then mount the flash drive there.
A mount point is only a directory after all.

You really should, as soon as reasonable, get a reference for the bash command line and learn the tools available and how to use them.

https://tldp.org is a good online reference, and this is a good quick reference that you can save and use.
Top (Bash Reference Manual)

1 Like

Thanks, Jeff V. I appreciate the sentiment and I will devote more time to it but the thing is, I was using the command properly. What I didn’t understand (in the feature deprived mode of operation I was in) is that I needed to create a folder to which to mount the usb stick to mount it to. Otherwise, I would wipe out one of the existing necessary folder in the very sparse maintenance partition that I was operating in (a Fedora 31 one from when the it was first installed).

Anyway, I was able to get the rdsosreport.txt file off of the machine. I know this is way beyond my capability to decipher. However, it’s a fairly large text file and trying to paste it in to the post violates the size limit for the forum. Any suggestions for how to get other eyes upon it? There doesn’t seem to be a way to add attachments. Thanks.

-mraki

What others have done is use google drive, upload the file there, and make the file accessible. Then add a link in your post so it can be reached.

Others use similar methods with different sites, including pastebin, though pastebin has a default time limit of 24 hours for access.

A free site for uploads of this sort is hastebin, which can be easily used by most.
From the README.md for that utility is this

# Haste Client

[![Build Status](https://secure.travis-ci.org/seejohnrun/haste-client.png)](http://travis-ci.org/seejohnrun/haste-client)

haste-client is a simple client for uploading data to haste-server.  All you do it pipe data in STDIN:

`cat file | haste`

And once the output makes it to the server, it will print the URL to STDOUT.

This can be really really cool in combination with `pbcopy`, like:

* mac osx: `cat file | haste | pbcopy`
* linux: `cat file | haste | xsel`

after which the contents of `file` will be accessible at a URL which has been copied to your pasteboard.

## Installation

``` bash
gem install haste
```

## Making uploading file contents easier

If you supply a valid file path as argument #1 to the client, it will be uploaded:

``` bash
# equivalent
cat file | haste
haste file
```

It is installed at a user (not system) level so the executable haste is placed in ~/bin.

Hi,

I went the easy (Google docs) route for now. Haste sounds interesting particularly when my Fedora box is back up.

Anyway, here’s where my rdsosreport.txt is located. If it’s of any value, I think the problem is somewhere in GNOME’s setup. It looks like GNOME tries to get started (the graphical screen comes up with the ‘please wait’ spinny going) before it collapses into the above error message).

If that’s the case, is there an incantation I can perform that gets basic machine started with say the bash shell without starting GNOME? I expect I’ll need to do that to perform whatever fixes are necessary anyway? Thanks again, and in advance, for taking a look at the report and making suggestions.

-mraki

In the file I see a FAILED fsck on the root file system.
This is the tail end of that file which shows the part I thought of interest; particularly the first 15 or so entries.

[    8.870186] localhost iscsid[649]: iSCSI daemon with pid=650 started!
[    8.870564] localhost iscsid[649]: can't open InitiatorName configuration file /etc/iscsi/initiatorname.iscsi
[    8.870591] localhost iscsid[649]: Warning: InitiatorName file /etc/iscsi/initiatorname.iscsi does not exist or does not contain a properly formatted InitiatorName. If using software iscsi (iscsi_tcp or ib_iser) or partial offload (bnx2i or cxgbi iscsi), you may not be able to log into or
[    8.870616] localhost iscsid[649]: can't open InitiatorAlias configuration file /etc/iscsi/initiatorname.iscsi
[   12.145758] localhost systemd-fsck[662]: /dev/mapper/fedora_localhost--live-root: Inodes that were part of a corrupted orphan linked list found.
[   12.145758] localhost systemd-fsck[662]: /dev/mapper/fedora_localhost--live-root: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
[   12.145758] localhost systemd-fsck[662]: 	(i.e., without -a or -p options)
[   12.189482] localhost systemd-fsck[662]: fsck failed with exit status 4.
[   12.189798] localhost systemd-fsck[662]: Running request emergency.target/start/replace
[   12.192523] localhost systemd[1]: systemd-fsck-root.service: Main process exited, code=exited, status=1/FAILURE
[   12.192818] localhost systemd[1]: systemd-fsck-root.service: Failed with result 'exit-code'.
[   12.192894] localhost systemd[1]: Failed to start File System Check on /dev/mapper/fedora_localhost--live-root.
[   12.192966] localhost systemd[1]: Dependency failed for /sysroot.
[   12.193000] localhost systemd[1]: Dependency failed for Initrd Root File System.
[   12.193027] localhost systemd[1]: Dependency failed for Reload Configuration from the Real Root.
[   12.193054] localhost systemd[1]: initrd-parse-etc.service: Job initrd-parse-etc.service/start failed with result 'dependency'.
[   12.193078] localhost systemd[1]: initrd-parse-etc.service: Triggering OnFailure= dependencies.
[   12.193181] localhost systemd[1]: initrd-root-fs.target: Job initrd-root-fs.target/start failed with result 'dependency'.
[   12.193209] localhost systemd[1]: initrd-root-fs.target: Triggering OnFailure= dependencies.
[   12.193279] localhost systemd[1]: sysroot.mount: Job sysroot.mount/start failed with result 'dependency'.
[   12.193344] localhost audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed'
[   12.193527] localhost systemd[1]: iscsid.socket: Succeeded.
[   12.193594] localhost systemd[1]: Closed Open-iSCSI iscsid Socket.
[   12.193660] localhost systemd[1]: iscsiuio.socket: Succeeded.
[   12.193687] localhost systemd[1]: Closed Open-iSCSI iscsiuio Socket.
[   12.193752] localhost systemd[1]: Stopped target Basic System.
[   12.193812] localhost systemd[1]: Reached target Initrd File Systems.
[   12.193847] localhost systemd[1]: Stopped target System Initialization.
[   12.193890] localhost systemd[1]: dracut-pre-mount.service: Succeeded.
[   12.193915] localhost systemd[1]: Stopped dracut pre-mount hook.
[   12.193959] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194006] localhost systemd[1]: dracut-initqueue.service: Succeeded.
[   12.194033] localhost systemd[1]: Stopped dracut initqueue hook.
[   12.194074] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194106] localhost systemd[1]: dracut-pre-trigger.service: Succeeded.
[   12.194133] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-trigger comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194161] localhost systemd[1]: Stopped dracut pre-trigger hook.
[   12.194188] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194893] localhost kernel: audit: type=1130 audit(1669867350.650:17): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed'
[   12.195511] localhost kernel: audit: type=1131 audit(1669867350.650:18): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.195626] localhost kernel: audit: type=1131 audit(1669867350.650:19): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.195672] localhost kernel: audit: type=1131 audit(1669867350.650:20): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-trigger comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.195730] localhost kernel: audit: type=1131 audit(1669867350.650:21): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.195836] localhost kernel: audit: type=1131 audit(1669867350.651:22): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194327] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194359] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline-ask comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.194386] localhost systemd[1]: dracut-pre-udev.service: Succeeded.
[   12.194412] localhost systemd[1]: Stopped dracut pre-udev hook.
[   12.194438] localhost systemd[1]: dracut-cmdline.service: Succeeded.
[   12.194462] localhost systemd[1]: Stopped dracut cmdline hook.
[   12.194490] localhost systemd[1]: dracut-cmdline-ask.service: Succeeded.
[   12.194515] localhost systemd[1]: Stopped dracut ask for additional cmdline parameters.
[   12.195897] localhost kernel: audit: type=1131 audit(1669867350.651:23): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline-ask comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.195380] localhost systemd[1]: Starting Setup Virtual Console...
[   12.202628] localhost systemd-vconsole-setup[667]: KD_FONT_OP_GET failed while trying to get the font metadata: Invalid argument
[   12.202986] localhost systemd-vconsole-setup[667]: Fonts will not be copied to remaining consoles
[   12.203634] localhost systemd[1]: systemd-vconsole-setup.service: Succeeded.
[   12.203821] localhost systemd[1]: Started Setup Virtual Console.
[   12.203959] localhost audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.204006] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.205516] localhost kernel: audit: type=1130 audit(1669867350.660:24): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.205521] localhost kernel: audit: type=1131 audit(1669867350.660:25): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.205159] localhost systemd[1]: Started Emergency Shell.
[   12.205339] localhost audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=emergency comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.205458] localhost systemd[1]: Reached target Emergency Mode.
[   12.205549] localhost systemd[1]: Startup finished in 3.024s (kernel) + 0 (initrd) + 9.181s (userspace) = 12.205s.
[   12.206877] localhost kernel: audit: type=1130 audit(1669867350.662:26): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=emergency comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   12.227648] localhost systemd[1]: Received SIGRTMIN+21 from PID 529 (plymouthd).
[   14.835575] localhost systemd[1]: Received SIGRTMIN+21 from PID 529 (plymouthd).
[   14.836521] localhost systemd[1]: plymouth-start.service: Succeeded.
[   14.836787] localhost audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=plymouth-start comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'

If you ignore that and do not run fsck manually, then the error will spread until the file system is totally unusable. Best thing is to immediately copy any valuable files to a different disk.

Right now, I can’t run anything. I don’t mind reading up on how to fix things (with fsck, presumably) but can a general approach be suggested? What media can/should I boot to (e.g. Fedora 37 Live, make a Fedora 37 USB stick, what)? Then mount the main partition and run fsck?

If one can suggest a basic outline, I can read up on the details. Thanks.

-mraki

Man fsck

Do not ever attempt to run fsck on a mounted file system. It may destroy the file system.
Boot to a live media then run the file system check on the unmounted file system in question. Also do not run fsck on a btrfs file system. Check what you have before doing more damage.

A good reference to keep handy may be The Linux Command Line by William Shotts as well as https://tldp.org/

If you don’t have a root password, then you will need to boot the Fedora live. Gnome (Workstation) usually don’t have a root password defined.

That seemed to do the trick. I was able to boot Fedora 36 Live DVD media. It wasn’t apparent how to get just a command line (which is what I wanted) but I got a basic core graphical I/F up from which I ran a terminal box. I fsck on all the visible partitions of the hard drive. fsck cleaned one up pretty well sending a number of fragments off and other tidbits.

Rebooting brought Gnome back to life. Shutting down after that either resumed the Fedora 37 upgrade or installed a number of updates to 37 that have occurred since 37 released. Things seem to be okay for now.

Thanks to all for the help and especially to Jeff V for walking me through the process. I’ve not had to go through this process before which just means I never had to learn how to do this. Thanks for both: helping through the fix and guiding me to learn how to do this.

-mraki

1 Like

Glad to assist. We all learn from each other so do not feel like your situation is unique.
:+1: