Infra and RelEng Update - Week 39 2024

[zlopez (Michal Konečný)]

Originally published at: Infra and RelEng Update - Week 39 2024 – Fedora Community Blog

This is a weekly report from the I&R (Infrastructure & Release Engineering) Team. It also contains updates for CPE (Community Platform Engineering) Team as the CPE initiatives are in most cases tied to I&R work.

We provide you both infographic and text version of the weekly report. If you just want to quickly look at what we did, just look at the infographic. If you are interested in more in depth details look below the infographic.

Week: 23 September – 27 September 2024

Infrastructure & Release Engineering

The purpose of this team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.).
List of planned/in-progress issues

Fedora Infra

• In progress:
  • Create pagure API token with group_modify ACLs
  • Need some OIDC credentials for com blog in STG
  • RFE: fedoras container image register change
  • The process to update the OpenH264 repos is broken
  • httpd 2.4.61 causing issue in fedora infrastructure
  • Support allocation dedicated hosts for Testing Farm
  • Feature / Change request: make the Fedora bugzilla more accessible
  • Searching mailing list archives does not work
  • EPEL minor version archive repos in MirrorManager
  • vmhost-x86-copr01.rdu-cc.fedoraproject.org DOWN
  • Update DRAC Firmware on All Dell Servers
  • Recurring issue that Bugzilla stops sending messages to fedora-messaging
  • Cleaning script for communishift
  • rhel7 eol
  • rhel7 EOL – github2fedmsg
  • Setup RISC-V builder(s) VM in Fedora Infrastructure
  • Move from iptables to firewalld
  • notofications do not notify
  • fedmsg -> fedora-messaging migration tracker
  • rhel9 adoption
  • Create monitoring tool for rabbitmq certificates
  • Replace Nagios with Zabbix in Fedora Infrastructure
  • DMARC validation failed for mail from lists.fp-o
  • Migration of registry.fedoraproject.org to quay.io
  • Commits don’t end up on the scm-commits list
• Done:
  • Spam on fedora-users list
  • Add a sponsor to the multimedia-sig FAS group
  • build-planet container is failing
  • ipa cluster degraded
  • requesting access for GitLab test instances
  • [CommOps] MediaWiki – HitCounter Extension
  • vmhost-x86-11.stg.iad2.fedoraproject.org has a failed disk
  • fedoraplanet is not sending any fedora messages
  • Moderating mailing list viewing message shows “This held message has been lost.”
  • Help me move my discourse bots to production?

CentOS Infra including CentOS CI

• In progress:
  • Investigate how MBS relies on fedmsg and its implications on us when fedmsg disappears
  • Release Improvements
  • Auth issues on blog platforms
• Done:
  • Create fullfiletimelist on CentOS Stream mirrors
  • OOM on x86-03.stream.rdu2.redhat.com
  • c9s: DNS is enabled in some s390x servers again?
  • [CloudSIG] Add cloud9s-openstack-caracal-testing as inherited tag in cloud9s-openstack-dalmatian-el9s-build
  • mirror-request

Release Engineering

• In progress:
  • Please create epel10-openh264 koji tag
  • fedpkg request-branch –all-releases Attempts to Create F42 & Releng Bot Fails
  • The `openh264` package fails to install because of the GPG key
  • Fedora 41 Mass Branching Tracker
  • Create new registry repository for ‘fedora-bootc-minimal’ images
  • Investigate and untag packages that failed gating but were merged in via mass rebuild
  • a few mass rebuild bumps failed to git push – script should retry or error
  • Some (?) retired packages not actually getting retired since ~2 days ago
  • Drop modularity from EPEL8.
  • unmaintained bot account: dummy-test-package-gloster gating pipeline tests broken
  • Renaming distribution media for Fedora Server
  • Package retirements are broken in rawhide
  • Implement checks on package retirements
  • Untag containers-common-0.57.1-6.fc40
  • orphan-all-packages.py should remove bugzilla_contact entries from fedora-scm-requests as well
  • Packages that fail to build SRPM are not reported during the mass rebuild bugzillas
  • When orphaning packages, keep the original owner as co-maintainer
  • Create an ansible playbook to do the mass-branching
  • Fix tokens for ftbfs_weekly_reminder. script
  • Update bootloader components assignee to “Bootloader Engineering Team”for Improved collaboration
• Done:
  • Block retired ghc packages
  • Manually block all repos that were retired during extended toddler outage
  • Unretire tinyows
  • some f39 updates stuck in testing → stable due to tagging issues
  • some users unable to request dist-git branches but should be able to

CPE Initiatives

EPEL

Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS, Scientific Linux (SL) and Oracle Linux (OL).

Updates

• EPEL 10 source package count: 2086
• Move EPEL 7 keys to obsolete on Fedora website
• Fixed disttag issue with fedpkg verrel
• Fixed permissions issue preventing certain users from requesting epel10 branches
• Assisted porting koji_block_retired to work with epel10 branches
• Rebuilt perl-pgsql_perl5 in EPEL 10 due to perl 5.40 in CentOS 10

Community Design

CPE has few members that are working as part of Community Design Team. This team is working on anything related to design in Fedora Community.

Updates

• Fedora:
  • In progress: #53: SWAG: Fedora Websites & Apps Revamp Community Initiative
• Deal Maker Sticker Sheet in progress
• Discussions of the potential Design Hackfest

ARC Investigations

The ARC (which is a subset of the CPE team) investigates possible initiatives that CPE might take on.

Updates

• Dist Git Move
  • Merged
    • Review the git for comparison document
    • Limit the document to have 100 chars per line
  • Pending user story #69 addressed from the previous week
  • Fedora QE onboarded to the ARC investigation process
  • Work in progress for seeding the testing dependencies

If you have any questions or feedback, please respond to this report or contact us on #redhat-cpe channel on matrix.