Unable to start container

I use toolbox as well as podman connecting from a remote host via SSH. The machine is running :fedora: 31
All the containers work fine.

If I connect to the host where the containers are located (using the graphical interface), and I try to start such containers from there, I get this error:
Error: unable to start container "65ed8b5cafef": cannot chown /sys/fs/cgroup//user.slice/user-1000.slice/session-29.scope/.: Operation not permitted: OCI runtime permission denied error

Via ssh these containers still work.