Search code examples
pythondjangorabbitmqceleryamqp

How do I make multiple celery workers run the same tasks?


I have one task that is checking a url speed, but i want that to be executed by multiple celery workers in different servers. I want the same url to be checked by multiple workers.

How can I do that?


Solution

  • If you could set ignore_result=True . Try Broadcast

    If you couldn't, check Routing Tasks and send the task multiple times to different queues, for different IDC for example, and corresponding workers.