Many programs crash with `Illegal instruction (core dumped)`

Hey, I tried installing The Fedora Workstation 40 Beta on my laptop and It gets installed fine, but some programs crash when I run them (node, npm, mediawriter, prismlauncher). I also noticed that on boot a notification comes up that gstreamer1 or something like that crashed.
What I did to try to fix: installed the beta from the server netinst, the Live ISO and the F39 Live iso (working here in F39) and then upgraded with dnf.

After some thinking I remembered there was some proposal to provide optimized x86_64_vx binaries (Changes/Optimized Binaries for the AMD64 Architecture - Fedora Project Wiki). There is a line where the following is stated: When code is compiled for a higher microarchitecture level it will crash (with SIGILL, "illegal instruction") on CPUs which do not support it.
But the proposal was denied so This isn’t the problem. Have there maybe been changes to build arguments between between the two versions?

Thanks in advance

1 Like

While I cannot answer your question, I cannot help but notice a dicotomy in your question and the title.

The title mentions zsh and the tags show#server.

The server release uses xfs file system.
Workstation uses btrfs file system for both f39 & f40.

We really need more info and to work with only one installed OS since when you bounce between versions there is no clarity as to the exact configuration and no starting point to plan a path to a solution.

Install a single version of the system, update it to the latest software versions, tell us what it is, then stay on that version while we work to identify and provide potential fixes for the problems you see at that point. If you intend to work with a gui desktop it is best that you avoid the server version since you would have to manually install and configure the gui on server.

1 Like

Removed f39, server

Does this mean that you are working with F40 and trying to solve some issues?

If so then

  1. Have you fully updated f40 with sudo dnf upgrade then rebooted?
  2. What exact issue are we addressing here? What app? What results?
    Please be very specific in describing what you do and what your results are.

Addressing one app at a time may simplify the solution and problem reporting.

Added design-team

  1. Yes I am on the Fedora 40 Beta, updated with dnf upgrade --refresh.
  2. There are several apps crashing, i.e.: node or mediawriter. I also noticed that on boot a program called gstreamer1 crashes. All of these crash with Illegal instruction (core dumped) when running from terminal.

I just tested mediawriter from the command line on my f40 test bed. It provided a lot of messages when launched from a terminal but did not crash.
node apparently comes from the nodejs package and I do not have it installed.

Gstreamer1 should not be launching automatically at boot so the way you stated that is surprising to me.

Please first run sudo dnf distro-sync to ensure everything is fully in sync with the repo then provide the text from trying to run each of those commands from the terminal window by copy & paste using the preformatted text tags done like this
```
paste the text here
```
From a terminal window those commands will normally give much more info than when launching from the desktop icon.
It may take a lot more info to identify the problem, and also might benefit us all if you were to provide details of your system using inxi -Fzxx. Even a bug report requires much more info and a crash usually provides a crash dump for tracing the cause.

kada49@laptop ~ % sudo dnf distro-sync
[sudo] password for kada49: 
Copr repo for prismlauncher owned by g3tchoo         6.4 kB/s | 3.8 kB     00:00    
Fedora 40 - x86_64                                   3.4 MB/s |  33 MB     00:09    
Fedora 40 openh264 (From Cisco) - x86_64             2.4 kB/s | 1.8 kB     00:00    
Fedora 40 - x86_64 - Updates                         342  B/s | 134  B     00:00    
Fedora 40 - x86_64 - Test Updates                    1.6 MB/s | 3.5 MB     00:02    
Dependencies resolved.
Nothing to do.
Complete!
kada49@laptop ~ % 

Program crashes:

kada49@laptop ~ % node
[1]    22041 illegal hardware instruction (core dumped)  node
132 kada49@laptop ~ % npm                                                         :(
[1]    22111 illegal hardware instruction (core dumped)  npm
132 kada49@laptop ~ % mediawriter                                                 :(
[1]    22171 illegal hardware instruction (core dumped)  mediawriter
132 kada49@laptop ~ %
  1. inxi -Fzxx output
System:
  Kernel: 6.8.1-300.fc40.x86_64 arch: x86_64 bits: 64 compiler: gcc
    v: 2.41-34.fc40
  Desktop: GNOME v: 46.0 tk: GTK v: 3.24.41 wm: gnome-shell dm: GDM
    Distro: Fedora Linux 40 (Workstation Edition Prerelease)
Machine:
  Type: Laptop System: Acer product: Swift SF114-32 v: V1.15
    serial: <superuser required>
  Mobo: GLK model: Sapporo_GL v: V1.15 serial: <superuser required>
    part-nu: 0000000000000000 UEFI: Insyde v: 1.15 date: 11/03/2020
Battery:
  ID-1: BAT0 charge: 41.5 Wh (100.0%) condition: 41.5/54.2 Wh (76.7%)
    volts: 12.5 min: 11.6 model: PANASONIC AP15O5L serial: <filter>
    status: not charging
  Device-1: hidpp_battery_0 model: Logitech Wireless Mouse MX Master 3
    serial: <filter> charge: 100% (should be ignored) status: discharging
CPU:
  Info: quad core model: Intel Pentium Silver N5000 bits: 64 type: MCP
    arch: Goldmont Plus rev: 1 cache: L1: 224 KiB L2: 4 MiB
  Speed (MHz): avg: 822 high: 894 min/max: 800/2700 cores: 1: 800 2: 796
    3: 800 4: 894 bogomips: 8755
  Flags: ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx
Graphics:
  Device-1: Intel GeminiLake [UHD Graphics 605] vendor: Acer Incorporated ALI
    driver: i915 v: kernel arch: Gen-9.5 ports: active: eDP-1 empty: HDMI-A-1
    bus-ID: 00:02.0 chip-ID: 8086:3184
  Device-2: Chicony HD WebCam driver: uvcvideo type: USB rev: 2.0
    speed: 480 Mb/s lanes: 1 bus-ID: 1-7:5 chip-ID: 04f2:b5c5
  Display: wayland server: X.org v: 1.20.14 with: Xwayland v: 23.2.4
    compositor: gnome-shell driver: gpu: i915 display-ID: 0
  Monitor-1: eDP-1 model: ChiMei InnoLux 0x14d4 res: 1920x1080 dpi: 158
    diag: 354mm (13.9")
  API: OpenGL v: 4.6 vendor: intel mesa v: 24.0.3 glx-v: 1.4 es-v: 3.2
    direct-render: yes renderer: Mesa Intel UHD Graphics 605 (GLK 3)
    device-ID: 8086:3184 display-ID: :0.0
  API: EGL Message: EGL data requires eglinfo. Check --recommends.
Audio:
  Device-1: Intel Celeron/Pentium Silver Processor High Definition Audio
    vendor: Acer Incorporated ALI driver: snd_hda_intel v: kernel
    bus-ID: 00:0e.0 chip-ID: 8086:3198
  API: ALSA v: k6.8.1-300.fc40.x86_64 status: kernel-api
  Server-1: JACK v: 1.9.22 status: off
  Server-2: PipeWire v: 1.0.4 status: active with: 1: pipewire-pulse
    status: active 2: wireplumber status: active 3: pipewire-alsa type: plugin
Network:
  Device-1: Intel Gemini Lake PCH CNVi WiFi driver: iwlwifi v: kernel
    bus-ID: 00:0c.0 chip-ID: 8086:31dc
  IF: wlp0s12f0 state: down mac: <filter>
  Device-2: Realtek RTL8153 Gigabit Ethernet Adapter driver: r8152 type: USB
    rev: 3.2 speed: 5 Gb/s lanes: 1 bus-ID: 2-1:2 chip-ID: 0bda:8153
  IF: enp0s21f0u1 state: up speed: 1000 Mbps duplex: full mac: <filter>
Bluetooth:
  Device-1: Intel Bluetooth 9460/9560 Jefferson Peak (JfP) driver: btusb
    v: 0.8 type: USB rev: 2.0 speed: 12 Mb/s lanes: 1 bus-ID: 1-9:6
    chip-ID: 8087:0aaa
  Report: btmgmt ID: hci0 rfk-id: 3 state: up address: <filter> bt-v: 5.1
    lmp-v: 10
Drives:
  Local Storage: total: 119.24 GiB used: 6.52 GiB (5.5%)
  ID-1: /dev/sda vendor: SK Hynix model: HFS128G39TND-N210A size: 119.24 GiB
    speed: 6.0 Gb/s serial: <filter> temp: 27 C
Partition:
  ID-1: / size: 117.66 GiB used: 6.16 GiB (5.2%) fs: btrfs dev: /dev/sda3
  ID-2: /boot size: 973.4 MiB used: 350.1 MiB (36.0%) fs: ext4
    dev: /dev/sda2
  ID-3: /boot/efi size: 598.8 MiB used: 19 MiB (3.2%) fs: vfat
    dev: /dev/sda1
  ID-4: /home size: 117.66 GiB used: 6.16 GiB (5.2%) fs: btrfs
    dev: /dev/sda3
Swap:
  ID-1: swap-1 type: zram size: 3.63 GiB used: 877.5 MiB (23.6%) priority: 100
    dev: /dev/zram0
Sensors:
  System Temperatures: cpu: 41.0 C mobo: N/A
  Fan Speeds (rpm): N/A
Info:
  Memory: total: 4 GiB available: 3.63 GiB used: 2.6 GiB (71.7%)
  Processes: 806 Power: uptime: 2h 6m wakeups: 1 Init: systemd v: 255
    target: graphical (5) default: graphical
  Packages: Compilers: gcc: 14.0.1 Shell: Zsh v: 5.9
    running-in: gnome-terminal inxi: 3.3.33

please post the result of dnf list installed xz* or xz --version

dnf list installed xz*

Installed Packages
xz.x86_64                              1:5.4.6-3.fc40                         @System
xz-libs.x86_64                         1:5.4.6-3.fc40                         @System

I think you meant xfs.

1 Like

You are right and I fixed that above.
Thanks for the heads-up info.

If you installed xz version 5.6.0 from rawhide and downgraded per Urgent Security Alert, crashes could be indicators of compromise.

Crashes in multiple programs often come from a common shared library. You can see the list of libraries loaded by each program using ldd. Compare the list for programs that work with the list for programs that crash to see if there is one library common to the crashes. If you identify the responsible package you can examine the .spec file to see what compiler flags were used.

Are you getting ABRT alerts? See: Providing a stack trace using ABRT (there are also sections on valgrind and strace to DIY).

found some dynamic libs to check out later.
Yes, I am getting ABRT alerts. What part do I paste here? The crash_function?

Edit 1:
Here are the ABRT reports for executing node and mediawriter:
https://retrace.fedoraproject.org/faf/reports/920517/
https://retrace.fedoraproject.org/faf/reports/913065/

Regarding ABRT Analytics - Report #920517 - mediawriter in aeshash128(unsigned char const*, unsigned long, unsigned long, unsigned long), it looks like qt6-qtbase now assumes that the running processor has the AES extension. I assume your CPU does not. For that one, file a bug on https://bugzilla.redhat.com/ against qt6-qtbase and point out that src/corelib/tools/qhash.cpp contains functions marked with QT_FUNCTION_TARGET(AES). Fedora is supposed to support all x86_64 CPUs, so that should not be done without checking cpuid.

The ABRT Analytics - Report #913065 - nodejs20 in simdutf::internal::unsupported_implementation::unsupported_implementation... case is similar. The nodejs20 tarball contains a bundled project named simdutf. For this one, file a bug against nodejs20 and point out that deps/simdutf/simdutf.h does check cpuid, but still wants at least one of pclmulqdq, SSE 4.2, osxsave, bmi1, bmi2, avx2, or one of the avx512 variants, none of which are guaranteed to be available on the x86_64 CPUs supported by Fedora.

You aren’t the victim of any kind of concerted effort to make your CPU not work. This is just various uncoordinated upstreams assuming they can move on from the original x86_64 and the Fedora packagers failing to notice.

Thank you very much! Going to to that!

Never thought that was the case lol

Edit 1:
I looked up the specs but it seems that my cpu does support the AES-NI instructions (followed this guide to check: https://www.baeldung.com/linux/aes-ni-cpu-support).

Okay. That code also uses various vector instructions. I didn’t bother tracking down which instruction sets they were from. (Some, at least, are SSE2 which is present on all x86_64 CPUs.) Out of curiosity, what does “cat /proc/cpuinfo” show?

processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 122
model name	: Intel(R) Pentium(R) Silver N5000 CPU @ 1.10GHz
stepping	: 1
microcode	: 0x3e
cpu MHz		: 1890.327
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 24
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave rdrand lahf_lm 3dnowprefetch cpuid_fault cat_l2 pti cdp_l2 ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust smep erms mpx rdt_a rdseed smap clflushopt intel_pt sha_ni xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts vnmi umip rdpid md_clear arch_capabilities
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs ept_mode_based_exec tsc_scaling
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass rfds
bogomips	: 2188.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 39 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 122
model name	: Intel(R) Pentium(R) Silver N5000 CPU @ 1.10GHz
stepping	: 1
microcode	: 0x3e
cpu MHz		: 1890.346
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 24
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave rdrand lahf_lm 3dnowprefetch cpuid_fault cat_l2 pti cdp_l2 ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust smep erms mpx rdt_a rdseed smap clflushopt intel_pt sha_ni xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts vnmi umip rdpid md_clear arch_capabilities
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs ept_mode_based_exec tsc_scaling
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass rfds
bogomips	: 2188.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 39 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 122
model name	: Intel(R) Pentium(R) Silver N5000 CPU @ 1.10GHz
stepping	: 1
microcode	: 0x3e
cpu MHz		: 1890.308
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 24
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave rdrand lahf_lm 3dnowprefetch cpuid_fault cat_l2 pti cdp_l2 ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust smep erms mpx rdt_a rdseed smap clflushopt intel_pt sha_ni xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts vnmi umip rdpid md_clear arch_capabilities
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs ept_mode_based_exec tsc_scaling
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass rfds
bogomips	: 2188.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 39 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 122
model name	: Intel(R) Pentium(R) Silver N5000 CPU @ 1.10GHz
stepping	: 1
microcode	: 0x3e
cpu MHz		: 1890.308
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 24
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg cx16 xtpr pdcm sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave rdrand lahf_lm 3dnowprefetch cpuid_fault cat_l2 pti cdp_l2 ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust smep erms mpx rdt_a rdseed smap clflushopt intel_pt sha_ni xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts vnmi umip rdpid md_clear arch_capabilities
vmx flags	: vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs ept_mode_based_exec tsc_scaling
bugs		: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass rfds
bogomips	: 2188.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 39 bits physical, 48 bits virtual
power management:

Huh. Well, that means pretty much everything I told you is wrong. Your CPU does have support for SSE 4.2, for example. Something else is going on here, but I’m afraid I don’t know what.

# Check enabled repos
sudo dnf repolist

# Verify packages integrity
sudo dnf check all
sudo dnf repoquery --duplicates
sudo dnf repoquery --unsatisfied
sudo dnf repoquery --extras
sudo rpm -V -a

# Restore SELinux labels
sudo fixfiles -F onboot
sudo reboot