Kernel panic after loss of power

hey all,

i can’t wrap my head around what’s happening, and i haven’t been able to find answers in similar threads. i’m somewhat familiar with linux but by no means fluent.

my laptop (acer e1-531) running fedora 41 unexpectedly lost power. (intel issue that happens several times a week, for over a year.). however, booting after the most recent power cut runs into a kernel panic returning 0x00007f00. this happens on 3 different 6.11 kernels and in an f39 rescue, all with the same exit code.

last working kernel version: 6.11.4-301.fc41.x86_64 (that was running at the time of the power loss)

kernel panic

i was drafting an email at the time of power failure. no system/package updates/installs/removals were made over the last few weeks. no config files were changed or were open at the time. no bootloader or kernel changes. no hardware changes. i don’t suspect hardware to be an issue because live cds seem to work fine. all disk partitions are also accessible through a live cd.

laptop

acer e1-531

changes:

  • cpu: i7 2960xm
  • drive: crucial mx500 (500gb)
  • ram: 2x8gb crucial 1600

everything else is factory

my only guess is broken initramfs, though it feels like there’s several issues because a lot of other things seem to be broken. when trying to chroot on a live cd, multiple shared libraries refuse to load (“file too short”), so things like dnf, systemctl and journalctl are unusable in chroot.

  1. ldd -v /bin/rpm returns “error while loading libraries: /lib64/librpm.so.10: file too short”. i checked and this one in particular isn’t zero size
  2. fsck reported a dirty bit on the EFI partition. removing it fixed nothing
  3. dracut --kver ... can’t find the required module directory
  4. dracut --regenerate-all refuses to overwrite. --force fails because of bad libraries, though i’m almost certain --force changed the kernel entries in grub from three 6.11.x versions to three 6.12.x versions, but i could have just seen incorrectly.

i’m not sure what other information might be needed. please let me know and i’ll provide if i can.

dracut output + /lib/modules contents + others

/lib/modules + missing libraries:

dracut failure

any and all help is appreciated. i suspect a reinstall might be required but i’m not certain.

I’m suspecting file system has been damaged.

If you do a ls -l on one of the files that is “too short” what is its size?
You may need to do this from a live USB image if you have too many damaged .so’s.

A broken initramfs would most likely give you an error from kernel trying to load the initramfs.

1 Like

thank you for your reply,

i see what you mean regarding initramfs. as for file sizes, i ran ls on two “short” files and got the following:

-rwxr-xr-x. 1 root root 0 Mar  7 02:00 /usr/lib64/systemd/libsystemd-shared-256.12-1.fc41.so

lrwxrwxrwx. 1 root root 16 Mar 11 02:00 /usr/lib64/librpm.so.10 -> librpm.so.10.2.1

You have 0 length file, that has clearly been damaged.

I think your only way out is to reinstall.
Do you have backups of your /home?

yeah it seems like the way forward. i do have /home backups so it’s not too much of a hassle

If you can share the output of sudo smartctl -x /dev/nvme0 we can check the SMART counters for indications of failure.

sure thing, i ran it got this:

output
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.11.4-301.fc41.x86_64] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Crucial/Micron Client SSDs
Device Model:     CT500MX500SSD1
Serial Number:    2011E293439B
LU WWN Device Id: 5 00a075 1e293439b
Firmware Version: M3CR023
User Capacity:    500,107,862,016 bytes [500 GB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
TRIM Command:     Available
Device is:        In smartctl database 7.3/5528
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu May 15 16:16:20 2025 SAST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM level is:     254 (maximum performance)
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Unknown

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(    0) seconds.
Offline data collection
capabilities: 			 (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine 
recommended polling time: 	 (   2) minutes.
Extended self-test routine
recommended polling time: 	 (  30) minutes.
Conveyance self-test routine
recommended polling time: 	 (   2) minutes.
SCT capabilities: 	       (0x0031)	SCT Status supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   100   100   000    -    0
  5 Reallocate_NAND_Blk_Cnt -O--CK   100   100   010    -    0
  9 Power_On_Hours          -O--CK   100   100   000    -    14754
 12 Power_Cycle_Count       -O--CK   100   100   000    -    4706
171 Program_Fail_Count      -O--CK   100   100   000    -    0
172 Erase_Fail_Count        -O--CK   100   100   000    -    0
173 Ave_Block-Erase_Count   -O--CK   097   097   000    -    56
174 Unexpect_Power_Loss_Ct  -O--CK   100   100   000    -    399
180 Unused_Reserve_NAND_Blk PO--CK   000   000   000    -    46
183 SATA_Interfac_Downshift -O--CK   100   100   000    -    153
184 Error_Correction_Count  -O--CK   100   100   000    -    0
187 Reported_Uncorrect      -O--CK   100   100   000    -    0
194 Temperature_Celsius     -O---K   067   032   000    -    33 (Min/Max 0/68)
196 Reallocated_Event_Count -O--CK   100   100   000    -    0
197 Current_Pending_ECC_Cnt -O--CK   100   100   000    -    0
198 Offline_Uncorrectable   ----CK   100   100   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   100   100   000    -    33
202 Percent_Lifetime_Remain ----CK   097   097   001    -    3
206 Write_Error_Rate        -OSR--   100   100   000    -    0
210 Success_RAIN_Recov_Cnt  -O--CK   100   100   000    -    0
246 Total_LBAs_Written      -O--CK   100   100   000    -    8768469994
247 Host_Program_Page_Count -O--CK   100   100   000    -    159436258
248 FTL_Program_Page_Count  -O--CK   100   100   000    -    693339719
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      1  Comprehensive SMART error log
0x03       GPL     R/O      1  Ext. Comprehensive SMART error log
0x04       GPL,SL  R/O      8  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  NCQ Command Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x24       GPL     R/O     88  Current Device Internal Status Data log
0x25       GPL     R/O     64  Saved Device Internal Status Data log
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (1 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Completed [00% left] (0-65535)
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       1 (0x0001)
Device State:                        Active (0)
Current Temperature:                    33 Celsius
Power Cycle Min/Max Temperature:     30/36 Celsius
Lifetime    Min/Max Temperature:      0/68 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/100 Celsius
Min/Max Temperature Limit:            0/100 Celsius
Temperature History Size (Index):    128 (99)

Index    Estimated Time   Temperature Celsius
 100    2025-05-15 14:09     ?  -
 ...    ..(  3 skipped).    ..  -
 104    2025-05-15 14:13     ?  -
 105    2025-05-15 14:14    31  ************
 ...    ..( 16 skipped).    ..  ************
 122    2025-05-15 14:31    31  ************
 123    2025-05-15 14:32     ?  -
 ...    ..(  2 skipped).    ..  -
 126    2025-05-15 14:35     ?  -
 127    2025-05-15 14:36    31  ************
   0    2025-05-15 14:37    30  ***********
 ...    ..(  2 skipped).    ..  ***********
   3    2025-05-15 14:40    30  ***********
   4    2025-05-15 14:41    41  **********************
   5    2025-05-15 14:42    30  ***********
   6    2025-05-15 14:43    30  ***********
   7    2025-05-15 14:44    31  ************
   8    2025-05-15 14:45    30  ***********
   9    2025-05-15 14:46    30  ***********
  10    2025-05-15 14:47     ?  -
  11    2025-05-15 14:48     ?  -
  12    2025-05-15 14:49    25  ******
  13    2025-05-15 14:50    25  ******
  14    2025-05-15 14:51    26  *******
  15    2025-05-15 14:52    28  *********
  16    2025-05-15 14:53     ?  -
  17    2025-05-15 14:54    28  *********
 ...    ..(  2 skipped).    ..  *********
  20    2025-05-15 14:57    28  *********
  21    2025-05-15 14:58    30  ***********
  22    2025-05-15 14:59    30  ***********
  23    2025-05-15 15:00    38  *******************
  24    2025-05-15 15:01    30  ***********
 ...    ..(  2 skipped).    ..  ***********
  27    2025-05-15 15:04    30  ***********
  28    2025-05-15 15:05    31  ************
 ...    ..(  2 skipped).    ..  ************
  31    2025-05-15 15:08    31  ************
  32    2025-05-15 15:09     ?  -
  33    2025-05-15 15:10     ?  -
  34    2025-05-15 15:11    31  ************
 ...    ..(  8 skipped).    ..  ************
  43    2025-05-15 15:20    31  ************
  44    2025-05-15 15:21     ?  -
 ...    ..(  3 skipped).    ..  -
  48    2025-05-15 15:25     ?  -
  49    2025-05-15 15:26    31  ************
 ...    ..(  5 skipped).    ..  ************
  55    2025-05-15 15:32    31  ************
  56    2025-05-15 15:33     ?  -
 ...    ..(  3 skipped).    ..  -
  60    2025-05-15 15:37     ?  -
  61    2025-05-15 15:38    33  **************
  62    2025-05-15 15:39    35  ****************
  63    2025-05-15 15:40    35  ****************
  64    2025-05-15 15:41     ?  -
  65    2025-05-15 15:42     ?  -
  66    2025-05-15 15:43    25  ******
  67    2025-05-15 15:44    25  ******
  68    2025-05-15 15:45    25  ******
  69    2025-05-15 15:46    26  *******
  70    2025-05-15 15:47    26  *******
  71    2025-05-15 15:48    28  *********
 ...    ..(  2 skipped).    ..  *********
  74    2025-05-15 15:51    28  *********
  75    2025-05-15 15:52    30  ***********
  76    2025-05-15 15:53    30  ***********
  77    2025-05-15 15:54     ?  -
  78    2025-05-15 15:55     ?  -
  79    2025-05-15 15:56    31  ************
  80    2025-05-15 15:57    30  ***********
  81    2025-05-15 15:58    31  ************
 ...    ..(  2 skipped).    ..  ************
  84    2025-05-15 16:01    31  ************
  85    2025-05-15 16:02     ?  -
  86    2025-05-15 16:03     ?  -
  87    2025-05-15 16:04    26  *******
  88    2025-05-15 16:05    28  *********
 ...    ..(  2 skipped).    ..  *********
  91    2025-05-15 16:08    28  *********
  92    2025-05-15 16:09    30  ***********
  93    2025-05-15 16:10    30  ***********
  94    2025-05-15 16:11    30  ***********
  95    2025-05-15 16:12     ?  -
  96    2025-05-15 16:13     ?  -
  97    2025-05-15 16:14    30  ***********
  98    2025-05-15 16:15    30  ***********
  99    2025-05-15 16:16    30  ***********

SCT Error Recovery Control command not supported

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4            4706  ---  Lifetime Power-On Resets
0x01  0x010  4           14754  ---  Power-on Hours
0x01  0x018  6       178535402  ---  Logical Sectors Written
0x01  0x020  6       364321930  ---  Number of Write Commands
0x01  0x028  6      3155946209  ---  Logical Sectors Read
0x01  0x030  6       208394205  ---  Number of Read Commands
0x01  0x038  6      4294967296  ---  Date and Time TimeStamp
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4             399  ---  Resets Between Cmd Acceptance and Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              35  ---  Current Temperature
0x05  0x010  1              32  ---  Average Short Term Temperature
0x05  0x018  1              32  ---  Average Long Term Temperature
0x05  0x020  1              68  ---  Highest Temperature
0x05  0x028  1               0  ---  Lowest Temperature
0x05  0x030  1              41  ---  Highest Average Short Term Temperature
0x05  0x038  1               0  ---  Lowest Average Short Term Temperature
0x05  0x040  1              40  ---  Highest Average Long Term Temperature
0x05  0x048  1               0  ---  Lowest Average Long Term Temperature
0x05  0x050  4              35  ---  Time in Over-Temperature
0x05  0x058  1              70  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4           21982  ---  Number of Hardware Resets
0x06  0x010  4              99  ---  Number of ASR Events
0x06  0x018  4              33  ---  Number of Interface CRC Errors
0x07  =====  =               =  ===  == Solid State Device Statistics (rev 1) ==
0x07  0x008  1               3  ---  Percentage Used Endurance Indicator
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2            0  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2            7  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS
0x000f  2            0  R_ERR response for host-to-device data FIS, CRC
0x0010  2            0  R_ERR response for host-to-device data FIS, non-CRC
0x0012  2            0  R_ERR response for host-to-device non-data FIS, CRC
0x0013  2            0  R_ERR response for host-to-device non-data FIS, non-CRC

If I’m calculating this right you have written 85GiB to the disk.
That’s a small amount.

All the error counts are 0’s so I think you the drive is good.

That is terrible, but apparently not unusual for that model. There is a large supply of “refurbished” enterprise grade laptops that don’t support enterprise Windows 11 being sold by OEMS and reputable resellers. Many models work well with linux, so it may be a good time to upgrade to a more robust laptop.

good to know, though it sucks to find out the hard way. i’ll definitely take a look at that enterprise laptop route though. thanks for pointing it out

yeah that sounds about right, that drive doesn’t see many writes to it at all. good to know that it’s still in good health, at least