I found a fix for this, in case someone else runs into this issue in the future.
You have to edit the steam.desktop file and change the PrefersNonDefaultGPU value from true to false. Then, update the the desktop database file with sudo update-desktop-database /usr/share/applications/steam.desktop command.
sudo vim /usr/share/applications/steam.desktop
PrefersNonDefaultGPU=false
sudo update-desktop-database /usr/share/applications/steam.desktop
Note: after updating the database I got a gripe that it could not be updated but it still worked.
I think the reason for this required changed is because I have an integrated GPU on my motherboard and discrete GPU (AMD Radeon RX 6800) installed.
Just a theory…