Skip to content

container xxx could not be removed #109

@janusn

Description

@janusn

Describe the bug

Since I have set WATCHTOWER_MONITOR_ONLY=false. 3 instances of the containers always fail to stop a container while updating.

Sometimes the containers were stopped. Sometimes they were still running.

I have no problem to get those failed containers update with Dockge or docker compose up -d afterwards.

Steps to reproduce

  1. $ cd /the/watchertower/directory
  2. # docker compose up -d
  3. Wait until the timer trigger and a new image was found.
  4. See the log below

Expected behavior

The containers restart successfully.

Screenshots

No response

Environment

  • Platform Alpine Linux 3.21.0 64bit
$ uname -a
Linux rocker 6.6.44-production+truenas #1 SMP PREEMPT_DYNAMIC Tue Jan 28 03:14:06 UTC 2025 x86_64 
GNU/Linux
  • Architecture amd64 Intel(R) Xeon(R) Silver 4116 CPU @ 2.10GHz, 48 cores
  • Docker Version
$ docker -v
Docker version 28.0.1, build 068a01e

Your logs

$ docker logs watchtower
time="2025-03-08T13:46:49Z" level=info msg="Watchtower 2.2.0"
time="2025-03-08T13:46:49Z" level=info msg="Using notifications: smtp"
time="2025-03-08T13:46:49Z" level=info msg="Checking all containers (except explicitly disabled with label)"
time="2025-03-08T13:46:49Z" level=info msg="Scheduling first run: 2025-03-08 18:26:00 +0000 GMT"
time="2025-03-08T13:46:49Z" level=info msg="Note that the first check will be performed in 4 hours, 39 minutes, 10 seconds"
time="2025-03-08T18:26:15Z" level=info msg="Session done" Failed=0 Scanned=25 Updated=0 notify=no
time="2025-03-09T00:26:15Z" level=info msg="Session done" Failed=0 Scanned=25 Updated=0 notify=no
time="2025-03-09T06:26:04Z" level=info msg="Found new jonoh/openvpn-proxy:latest image (d52a97637f05)"
time="2025-03-09T06:26:17Z" level=info msg="Stopping /openvpn-proxy (1236c2fb3340) with SIGTERM"
time="2025-03-09T06:26:20Z" level=error msg="container /openvpn-proxy (1236c2fb3340) could not be removed"
time="2025-03-09T06:26:20Z" level=info msg="Session done" Failed=1 Scanned=25 Updated=0 notify=no
time="2025-03-09T12:29:30Z" level=info msg="Found new jhj0517/whisper-webui:latest image (2d58201bfe60)"
time="2025-03-09T12:29:39Z" level=info msg="Stopping /whisper-webui (8b315d9ad487) with SIGTERM"
time="2025-03-09T12:29:45Z" level=error msg="container /whisper-webui (8b315d9ad487) could not be removed"
time="2025-03-09T12:29:45Z" level=info msg="Session done" Failed=1 Scanned=25 Updated=0 notify=no
time="2025-03-09T18:26:10Z" level=info msg="Found new linuxserver/radarr:latest image (b2d7a15336a7)"
time="2025-03-09T18:26:13Z" level=info msg="Found new linuxserver/radarr:latest image (b2d7a15336a7)"
time="2025-03-09T18:26:24Z" level=info msg="Stopping /radarr (fd96eed90221) with SIGTERM"
time="2025-03-09T18:26:25Z" level=error msg="container /radarr (fd96eed90221) could not be removed"
time="2025-03-09T18:26:25Z" level=info msg="Stopping /radarr4k (3693db5fda9d) with SIGTERM"
time="2025-03-09T18:26:30Z" level=error msg="container /radarr4k (3693db5fda9d) could not be removed"
time="2025-03-09T18:26:30Z" level=info msg="Session done" Failed=2 Scanned=25 Updated=0 notify=no

Additional context

$ cat compose.yaml
---
# watchtower/compose.yaml

services:
  watchtower:
    image: beatkind/watchtower:latest
    container_name: watchtower
    deploy:
      resources:
        limits:
          memory: 64M
    restart: unless-stopped

    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    env_file:
      ./secret.env
    environment:
      - TZ=Europe/London
      - DOCKER_API_VERSION=1.43
      - WATCHTOWER_CLEANUP=true
      - WATCHTOWER_INCLUDE_RESTARTING=true
      - WATCHTOWER_INCLUDE_STOPPED=true
      - WATCHTOWER_REVIVE_STOPPED=false
      - WATCHTOWER_LABEL_ENABLE=false
      - WATCHTOWER_MONITOR_ONLY=false
      - WATCHTOWER_TIMEOUT=300
      - WATCHTOWER_SCHEDULE=0 26 */6 * * *
      - WATCHTOWER_NOTIFICATIONS_LEVEL=info
      - WATCHTOWER_NOTIFICATIONS_HOSTNAME=rocker
      - WATCHTOWER_NOTIFICATIONS=email
      - WATCHTOWER_NOTIFICATION_EMAIL_FROM=someone@some.where
      - WATCHTOWER_NOTIFICATION_EMAIL_TO=another.one@some.where
      - WATCHTOWER_NOTIFICATION_EMAIL_SERVER=smtp.gmail.com
      - WATCHTOWER_NOTIFICATION_EMAIL_SERVER_PORT=587
      - WATCHTOWER_NOTIFICATION_EMAIL_SERVER_USER=someone@some.where
    labels:
      - "com.centurylinklabs.watchtower.monitor-only=true"

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions