0

Celery currently has parameters for a broker and backend. Am I able to add even more nodes?

I have 5 nodes. How would I reference them in the configuration celeryapp.py

app = Celery('mytaks',
                 broker='redis://clusternode1/0',
                 backend='redis://clusternode1/0',
                 include=['tasks',]
                 )
Atma
  • 29,141
  • 56
  • 198
  • 299
  • Celery doesn't have support for using Redis cluster as broker. It can use Redis highly available setup as broker (with Sentinels), but has no support for Redis cluster to be used as broker. – Nipun Talukdar Feb 20 '18 at 03:16
  • @NipunTalukdar What about just using 3 nodes, not a cluster? – Atma Feb 20 '18 at 04:07
  • you may not add different Redis nodes as brokers to the Celery. Only way to do that is through Sentinels where Sentinels take care of sending the writes to current Redis master and also transparently fails over to new master if the current master goes down. http://docs.celeryproject.org/en/latest/getting-started/brokers/redis.html – Nipun Talukdar Feb 20 '18 at 04:32

0 Answers0