Search code examples
pythonrediscelerybroker

Celery cancels itself

When I try to run a worker:

celery -A celery_conf --loglevel=debug worker -Q celery -c 1

It seems to start, but then it "cancel"s

[2018-08-07 16:25:16,132: INFO/MainProcess] Connected to redis://server:6379/1
[2018-08-07 16:25:23,984: DEBUG/MainProcess] Canceling task consumer...
[2018-08-07 16:25:24,993: DEBUG/MainProcess] Canceling task consumer...
[2018-08-07 16:25:24,993: DEBUG/MainProcess] Closing consumer channel...
[2018-08-07 16:25:24,993: WARNING/MainProcess] Restoring 1 unacknowledged message(s)
[2018-08-07 16:25:24,996: DEBUG/MainProcess] removing tasks from inqueue until task handler finished

Any idea how to begin debugging? I already have the loglevel to DEBUG.

  • Celery version: 4.2.1 (also tested on master)
  • Python version: 3.6.6
  • Using a Redis Broker
Solution

  • downgrade your redis-py to redis>=2.10.0,<3.0.0, or just upgrade your celery version to 4.3.0(I didn't try this, I down)

    https://github.com/celery/celery/issues/4495#issuecomment-440438055