too many celery processes running

Asked Jul 26 '21 at 13:09

Active Jul 27 '21 at 08:15

Viewed 140 times

I have a tornado application with a celery application initiated like this.

celery worker --app=pluto -l INFO -Q pluto -c 4 -Ofair --logfile=pluto-celery.log

The application is eating lot of memory, when I do an htops i see a lot of celery application (around 30), most of them sleeping but consuming 0.1% memory. Why do I have so many processes, is there anything wrong with the command I am using, I tried to look, but could not find about -c 4 part of that command. How can I find more info/debug this memory leak issue ?

edited Jul 27 '21 at 08:15

asked Jul 26 '21 at 13:09

vijay shanker

2,517
1
24
37

-c 4 is concurrency, got there by doing celery worker --help – vijay shanker Jul 26 '21 at 16:55
Why would tornado application run celery worker? Celery worker should be a separate process, completely independent from Tornado app. – DejanLekic Jul 27 '21 at 08:08
sorry, i should have phrased it as "with a" – vijay shanker Jul 27 '21 at 08:15

too many celery processes running

0 Answers0