Number of celery tasks executed at a given point of time

Question

I am trying to create a bunch of celery tasks asynchronously on the fly. Say there are 1000 tasks I start asynchronously and I have only one celeryd process running to execute tasks. How many threads will be created by celery to handle these tasks?

If there are multiple threads that celery starts automatically to process the task queue, how do I limit celery to execute only 100 threads at a given point of time.

Thanks.

score 0 · Answer 1 · answered Mar 27 '13 at 22:27

0

Its starts as many as you specify with the CELERYD_OPTS concurrency parameter. Which is also discussed here.

answered Mar 27 '13 at 22:27

RickyA

15,465
5
71
95

So the concurrency in celeryd_opts specifies how many tasks are executed by each of the worker processes? – Vijay Shankar Kalyanaraman Mar 28 '13 at 18:13
1

yes, as explained [here](http://docs.celeryproject.org/en/latest/configuration.html#concurrency-settings) – RickyA Mar 28 '13 at 23:26

Number of celery tasks executed at a given point of time

1 Answers1