I don’t know if it has something to-do with your problem but as it has bugs i post it here.
I hadn’t checked whether the moby-engine package I was using was the latest version before I uninstalled it. I installed the latest version (20.10.11) which contains the fix for the bug linked above, and the problem persists. So apparently that bug wasn’t related ty my problem. Back to docker-ce for now I guess.
1 Like
does doing
sudo sytemctl log-level debug
prior to starting shed any more light on the issue?
Yes, it does. After running systemctl log-level debug I get a lot more information in the log:
Dec 15 20:47:34 picard systemd[1]: docker.service: Changed failed -> auto-restart
Dec 15 20:47:34 picard systemd[1]: docker.service: Control group is empty.
Dec 15 20:47:34 picard systemd[1]: docker.service: Service RestartSec=100ms expired, scheduling restart.
Dec 15 20:47:34 picard systemd[1]: docker.service: Trying to enqueue job docker.service/restart/replace
Dec 15 20:47:34 picard systemd[1]: docker.service: Installed new job docker.service/restart as 161439
Dec 15 20:47:34 picard systemd[1]: docker.service: Enqueued job docker.service/restart as 161439
Dec 15 20:47:34 picard systemd[1]: docker.service: Scheduled restart job, restart counter is at 2.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ Automatic restarting of the unit docker.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Dec 15 20:47:34 picard systemd[1]: docker.service: Changed auto-restart -> dead
Dec 15 20:47:34 picard systemd[1]: docker.service: Job 161439 docker.service/restart finished, result=done
Dec 15 20:47:34 picard systemd[1]: Stopped Docker Application Container Engine.
░░ Subject: A stop job for unit docker.service has finished
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ A stop job for unit docker.service has finished.
░░
░░ The job identifier is 161439 and the job result is done.
Dec 15 20:47:34 picard systemd[1]: docker.service: Converting job docker.service/restart -> docker.service/start
Dec 15 20:47:34 picard systemd[1]: docker.service: Consumed 604ms CPU time.
░░ Subject: Resources consumed by unit runtime
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ The unit docker.service completed and consumed the indicated resources.
Dec 15 20:47:34 picard systemd[1]: docker.service: Passing 1 fds to service
Dec 15 20:47:34 picard systemd[1]: docker.service: About to execute /usr/bin/dockerd --host=fd:// --exec-opt native.cgroupdriver=systemd $OPTIONS
Dec 15 20:47:34 picard systemd[1]: docker.service: Forked /usr/bin/dockerd as 511598
Dec 15 20:47:34 picard systemd[511598]: docker.service: Executing: /usr/bin/dockerd --host=fd:// --exec-opt native.cgroupdriver=systemd --selinux-enabled --log-driver=journald --live-restore --default-ulimit nofile=1024:1024 --init-path /usr/libexec/docker/docker-init --userland-proxy-path /usr/libexec/docker/docker-proxy
Dec 15 20:47:34 picard systemd[1]: docker.service: Changed dead -> start
Dec 15 20:47:34 picard systemd[1]: Starting Docker Application Container Engine...
░░ Subject: A start job for unit docker.service has begun execution
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ A start job for unit docker.service has begun execution.
░░
░░ The job identifier is 161439.
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.698134231-05:00" level=info msg="Starting up"
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.699352581-05:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.699373534-05:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.699414882-05:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.699445054-05:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.700455550-05:00" level=info msg="parsed scheme: \"unix\"" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.700476503-05:00" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.700511145-05:00" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock <nil> 0 <nil>}] <nil> <nil>}" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.700530981-05:00" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Dec 15 20:47:34 picard dockerd[511598]: time="2021-12-15T20:47:34.743887865-05:00" level=info msg="[graphdriver] using prior storage driver: overlay2"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.017097444-05:00" level=info msg="Loading containers: start."
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.146174083-05:00" level=info msg="Firewalld: docker zone already exists, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.290176277-05:00" level=info msg="Firewalld: interface docker0 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.309377649-05:00" level=info msg="Firewalld: interface docker0 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.380222976-05:00" level=info msg="Firewalld: interface br-2c6e71107ca8 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.399917444-05:00" level=info msg="Firewalld: interface br-2c6e71107ca8 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.472185343-05:00" level=info msg="Firewalld: interface docker_gwbridge already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.491566073-05:00" level=info msg="Firewalld: interface docker_gwbridge already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.566711803-05:00" level=info msg="Firewalld: interface br-ec1e9730ae72 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.585977712-05:00" level=info msg="Firewalld: interface br-ec1e9730ae72 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.772120115-05:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.843558273-05:00" level=info msg="Firewalld: interface docker0 already part of docker zone, returning"
Dec 15 20:47:35 picard dockerd[511598]: time="2021-12-15T20:47:35.952441762-05:00" level=info msg="Loading containers: done."
Dec 15 20:47:36 picard dockerd[511598]: time="2021-12-15T20:47:36.001768030-05:00" level=info msg="Docker daemon" commit=e2f740d graphdriver(s)=overlay2 version=20.10.11
Dec 15 20:47:36 picard dockerd[511598]: time="2021-12-15T20:47:36.001985103-05:00" level=fatal msg="Error starting cluster component: --live-restore daemon configuration is incompatible with swarm mode"
Dec 15 20:47:36 picard systemd[1]: docker.service: Child 511598 belongs to docker.service.
Dec 15 20:47:36 picard systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ An ExecStart= process belonging to unit docker.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 1.
Dec 15 20:47:36 picard systemd[1]: docker.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ The unit docker.service has entered the 'failed' state with result 'exit-code'.
Dec 15 20:47:36 picard systemd[1]: docker.service: Service will restart (restart setting)
Dec 15 20:47:36 picard systemd[1]: docker.service: Changed start -> failed
Dec 15 20:47:36 picard systemd[1]: docker.service: Job 161439 docker.service/start finished, result=failed
Dec 15 20:47:36 picard systemd[1]: Failed to start Docker Application Container Engine.
░░ Subject: A start job for unit docker.service has failed
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ A start job for unit docker.service has finished with a failure.
░░
░░ The job identifier is 161439 and the job result is failed.
Dec 15 20:47:36 picard systemd[1]: docker.service: Unit entered failed state.
Dec 15 20:47:36 picard systemd[1]: docker.service: Consumed 609ms CPU time.
░░ Subject: Resources consumed by unit runtime
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ The unit docker.service completed and consumed the indicated resources.
Dec 15 20:47:36 picard systemd[1]: docker.service: Changed failed -> auto-restart
Dec 15 20:47:36 picard systemd[1]: docker.service: Control group is empty.
Dec 15 20:47:36 picard systemd[1]: docker.service: Service RestartSec=100ms expired, scheduling restart.
Dec 15 20:47:36 picard systemd[1]: docker.service: Trying to enqueue job docker.service/restart/replace
Dec 15 20:47:36 picard systemd[1]: docker.service: Installed new job docker.service/restart as 161639
Dec 15 20:47:36 picard systemd[1]: docker.service: Enqueued job docker.service/restart as 161639
Dec 15 20:47:36 picard systemd[1]: docker.service: Scheduled restart job, restart counter is at 3.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ Automatic restarting of the unit docker.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Dec 15 20:47:36 picard systemd[1]: docker.service: Changed auto-restart -> dead
Dec 15 20:47:36 picard systemd[1]: docker.service: Job 161639 docker.service/restart finished, result=done
Dec 15 20:47:36 picard systemd[1]: Stopped Docker Application Container Engine.
░░ Subject: A stop job for unit docker.service has finished
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ A stop job for unit docker.service has finished.
░░
░░ The job identifier is 161639 and the job result is done.
Dec 15 20:47:36 picard systemd[1]: docker.service: Converting job docker.service/restart -> docker.service/start
Dec 15 20:47:36 picard systemd[1]: docker.service: Consumed 609ms CPU time.
░░ Subject: Resources consumed by unit runtime
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ The unit docker.service completed and consumed the indicated resources.
Dec 15 20:47:36 picard systemd[1]: docker.service: Start request repeated too quickly.
Dec 15 20:47:36 picard systemd[1]: docker.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ The unit docker.service has entered the 'failed' state with result 'exit-code'.
Dec 15 20:47:36 picard systemd[1]: docker.service: Service restart not allowed.
Dec 15 20:47:36 picard systemd[1]: docker.service: Changed dead -> failed
Dec 15 20:47:36 picard systemd[1]: docker.service: Job 161639 docker.service/start finished, result=failed
Dec 15 20:47:36 picard systemd[1]: Failed to start Docker Application Container Engine.
░░ Subject: A start job for unit docker.service has failed
░░ Defined-By: systemd
░░ Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel
░░
░░ A start job for unit docker.service has finished with a failure.
░░
░░ The job identifier is 161639 and the job result is failed.
Dec 15 20:47:36 picard systemd[1]: docker.service: Unit entered failed state.
The lines in the above log that look most interesting is
Dec 15 18:49:49 picard dockerd[495378]: time="2021-12-15T18:49:49.794781397-05:00" level=fatal msg="Error starting cluster component: --live-restore daemon configuration is incompatible with swarm mode"
Dec 15 18:49:49 picard systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE
I saw that the --live-restore option is set in the OPTIONS environment variable in /etc/sysconfig/docker, so I removed it from there.
3 Likes
It looks like the reason docker-ce worked is that it didn’t have the --live-restore option turned on by default.
1 Like