Not possible to update Fedora CoreOs with layered packages

I have a some Fedora CoreOS instances that try to update, but fail in the process, they have some layered packages. I think it’s a bug, bud others in the chat can not reproduce it.

State: busy
Transaction: uninstall --idempotent --allow-inactive wget
Initiator: client(id:cli dbus:1.6139739 unit:session-39780.scope uid:0)
Deployments:
● fedora:fedora/x86_64/coreos/stable
Version: 39.20231101.3.0 (2023-11-20T17:08:57Z)
BaseCommit: 926547c621e72254a178bdf2dbfd9c094ff88145a91d13e829b4dec7f66fff58
GPGSignature: Valid signature by E8F23996F23218640CB44CBE75CF5AC418B8E74C
LayeredPackages: awscli htop ipset lm_sensors smartmontools tcpdump vim wget

fedora:fedora/x86_64/coreos/stable
Version: 38.20231027.3.2 (2023-11-08T03:35:36Z)
BaseCommit: 759c112d3a3d1f762ba368106411fcc4edf8b1c39323aca99269741c88e6a597
GPGSignature: Valid signature by 6A51BBABBA3D5467B6171221809A8D7CEB10B464
LayeredPackages: awscli htop ipset lm_sensors smartmontools tcpdump vim wget

There is the issue where updating to wget2 (CoreOS cannot be upgraded anymore because wget/wget2) from wget prevents the proper update, so I try to manually remove wget before letting zincati to its thing:

 echo 'test IF CoreOs wants update & reboot ...'
+ . /etc/os-release
++ NAME='Fedora Linux'
++ VERSION='39.20231101.3.0 (CoreOS)'
++ ID=fedora
++ VERSION_ID=39
++ VERSION_CODENAME=
++ PLATFORM_ID=platform:f39
++ PRETTY_NAME='Fedora CoreOS 39.20231101.3.0'
++ ANSI_COLOR='0;38;2;60;110;180'
++ LOGO=fedora-logo-icon
++ CPE_NAME=cpe:/o:fedoraproject:fedora:39
++ HOME_URL=https://getfedora.org/coreos/
++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora-coreos/
++ SUPPORT_URL=https://github.com/coreos/fedora-coreos-tracker/
++ BUG_REPORT_URL=https://github.com/coreos/fedora-coreos-tracker/
++ REDHAT_BUGZILLA_PRODUCT=Fedora
++ REDHAT_BUGZILLA_PRODUCT_VERSION=39
++ REDHAT_SUPPORT_PRODUCT=Fedora
++ REDHAT_SUPPORT_PRODUCT_VERSION=39
++ SUPPORT_END=2024-05-14
++ VARIANT=CoreOS
++ VARIANT_ID=coreos
++ OSTREE_VERSION=39.20231101.3.0
++ curl --max-time 30 https://builds.coreos.fedoraproject.org/streams/stable.json
++ jq -r .architectures.x86_64.artifacts.metal.release
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 55078  100 55078    0     0  3116k      0 --:--:-- --:--:-- --:--:-- 3361k
+ currentCoreOSVersion=40.20240416.3.1
+ [[ ! -z 39.20231101.3.0 ]]
+ [[ ! 39.20231101.3.0 == \4\0\.\2\0\2\4\0\4\1\6\.\3\.\1 ]]
+ echo '########################################################'
+ echo 'CoreOS wants update & reboot'
+ echo 'Will not come back here, but wait for reboot, boot starts podman again'
+ sudo cp /home/wildfly/epoq-podman/coreos/zincati/99-force-update.toml /etc/zincati/config.d/
########################################################
CoreOS wants update & reboot
Will not come back here, but wait for reboot, boot starts podman again
+ sudo rpm-ostree uninstall --idempotent --allow-inactive wget
Checking out tree 926547c...done
Resolving dependencies...done
error: Could not depsolve transaction; 1 problem detected:
 Problem: conflicting requests
  - package smartmontools-1:7.4-2.fc38.x86_64 from @commandline requires (smartmontools-selinux if selinux-policy-targeted), but none of the providers can be installed
  - package smartmontools-1:7.4-2.fc39.x86_64 from @commandline requires (smartmontools-selinux if selinux-policy-targeted), but none of the providers can be installed
  - package smartmontools-selinux-1:7.4-2.fc38.noarch from @commandline requires policycoreutils-python-utils, but none of the providers can be installed
  - package smartmontools-selinux-1:7.4-2.fc39.noarch from @commandline requires policycoreutils-python-utils, but none of the providers can be installed
  - package policycoreutils-python-utils-3.5-7.fc39.noarch from @commandline requires python3-policycoreutils = 3.5-7.fc39, but none of the providers can be installed
  - package python3-policycoreutils-3.5-7.fc39.noarch from @commandline requires python(abi) = 3.12, but none of the providers can be installed
  - cannot install both python3-3.11.6-1.fc38.x86_64 from @commandline and python3-3.12.0-1.fc39.x86_64 from @commandline
  - package awscli-1.27.111-2.fc38.noarch from @commandline requires python(abi) = 3.11, but none of the providers can be installed
  - package policycoreutils-python-utils-3.5-1.fc38.noarch from @commandline requires python3-policycoreutils = 3.5-1.fc38, but none of the providers can be installed
  - nothing provides policycoreutils = 3.5-1.fc38 needed by python3-policycoreutils-3.5-1.fc38.noarch from @commandline

is the a way to properly handle this issue?

I tested this solution and it works in a libvirt VM.

That is:

sudo rpm-ostree rebase "fedora/x86_64/coreos/testing"
...
Fedora CoreOS 40.20240504.2.0
Tracker: https://github.com/coreos/fedora-coreos-tracker
Discuss: https://discussion.fedoraproject.org/tag/coreos

Last login: Tue May 21 10:56:46 2024

core@fcos-test:~$ sudo rpm-ostree status 
State: idle
Deployments:
● fedora:fedora/x86_64/coreos/testing
                  Version: 40.20240504.2.0 (2024-05-06T17:59:08Z)
               BaseCommit: 2d5ead6c3f868c60c0245466ad541e0427a71f93e9b5aa500dc3a2f171ebf6c2
             GPGSignature: Valid signature by 115DF9AEF857853EE8445D0A0727707EA15B79CC
          LayeredPackages: awscli htop ipset lm_sensors smartmontools tcpdump vim wget

  fedora:fedora/x86_64/coreos/stable
                  Version: 39.20231101.3.0 (2023-11-20T17:08:57Z)
               BaseCommit: 926547c621e72254a178bdf2dbfd9c094ff88145a91d13e829b4dec7f66fff58
             GPGSignature: Valid signature by E8F23996F23218640CB44CBE75CF5AC418B8E74C
          LayeredPackages: awscli htop ipset lm_sensors smartmontools tcpdump vim wget
                   Pinned: yes