After updating to F38, dbus won't start under users

Hi,

I have a Fedora Server installation on an Ampere based aarch64 board. I have installed Fedora on a Pi4 first and moved the disk image onto the board. It’s been working fine for ages and I have been using it since F34. All updates were flawless too.

However ever since I updated to F38 from F37 I noticed that dbus won’t start on user slices:

[unclefrank@mailserver ~]$ systemctl --user list-units --state failed
  UNIT                         LOAD   ACTIVE SUB    DESCRIPTION                                                     
● dbus.socket                  loaded failed failed D-Bus User Message Bus Socket                                   
● grub-boot-success.timer      loaded failed failed Mark boot as successful after the user session has run 2 minutes
● systemd-tmpfiles-clean.timer loaded failed failed Daily Cleanup of User's Temporary Directories

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.
3 loaded units listed.

It happens under all users. However if I create a new user and run sudo loginctl enable-linger <newuser>, that user’s dbus works just fine.

Here is a journalctl output from dbus-broker:

-- Boot 1f120c8f83c84c2fb10c9ec5d120ca51 --
May 23 00:05:40 mailserver systemd[1978]: Starting dbus-broker.service - D-Bus User Message Bus...
May 23 00:05:41 mailserver systemd[1978]: Started dbus-broker.service - D-Bus User Message Bus.
May 23 00:05:41 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:05:41 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:05:41 mailserver dbus-broker-launch[2180]: Ready
May 23 00:07:05 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:05 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:05 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:21 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:21 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:21 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:21 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:21 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:21 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:30 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:33 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:33 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:33 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:07:33 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:07:33 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:07:33 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:09:08 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:09:08 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:09:08 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:23 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:24 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:31 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:31 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:31 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:31 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:31 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:31 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:44 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:44 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:44 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:44 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:45 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:45 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:51 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:51 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:51 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:10:51 mailserver dbus-broker-launch[2180]: Noticed file-system modification, trigger reload.
May 23 00:10:51 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +31: Eavesdropping is deprecated and ignored
May 23 00:10:51 mailserver dbus-broker-launch[2180]: Policy to allow eavesdropping in /usr/share/dbus-1/session.conf +33: Eavesdropping is deprecated and ignored
May 23 00:15:37 mailserver systemd[1978]: Stopping dbus-broker.service - D-Bus User Message Bus...
May 23 00:15:37 mailserver dbus-broker[2186]: Dispatched 1518 messages @ 1(±15)μs / message.
May 23 00:15:37 mailserver systemd[1978]: Stopped dbus-broker.service - D-Bus User Message Bus.

I also see

May 29 00:17:06 mailserver systemd[838]: dbus.socket: Failed to queue service startup job (Maybe the service file is missing or not a non-template unit?): Unit app.slice failed to load properly, please adjust/correct and reload service>
May 29 00:17:06 mailserver systemd[838]: dbus.socket: Failed with result 'resources'.
May 29 00:17:06 mailserver podman[969]: time="2023-05-29T00:17:06+02:00" level=warning msg="Failed to add pause process to systemd sandbox cgroup: dial unix /run/user/1002/bus: connect: connection refused"

Can’t even restart any services. I assume that’s because dbus didn’t start, therefore the app.slice errored:

[unclefrank@mailserver ~]$ systemctl --user restart cloudflared.service 
Failed to restart cloudflared.service: Unit app.slice failed to load properly, please adjust/correct and reload service manager: No such process
See user logs and 'systemctl --user status cloudflared.service' for details.

Any idea what could I do besides moving all the files to a new user and deleting the old one?

Dbus works fine as root. I don’t get what could be different on new users than on old ones. rpm -qV systemd returns that no files were altered.

I also tried to switch selinux to permissive, tried countless reboots, systemctl daemon-reload and reexec all without much success. :frowning:

Does creating a new user and logging in as that new user have things operating properly?

If so then it seems something may have changed in the user config and that can be narrowed down with a little patience and effort.
If not then it may be something system-wide.

Yeah. Like I stated in the original post, all users from before the upgrade are seemingly affected, however new users aren’t. Not sure which config could cause this.