Stack Overflow
Stack Overflow

Questions tagged [celeryd]

celeryd is the common name of a Celery worker node, running as a daemon.

Celery is a widely used asynchronous job/task queue processing engine, written in Python and available under the New BSD License. It can use a large variety of message brokers like RabbitMQ, Redis, MongoDB, CouchDB, Amazon SQS and others.

More info here: http://celery.github.com/celery/getting-started/introduction.html#overview

148 questions
0
votes
1 answer

using celery with pyramid and mod_wsgi

I've been able to deploy a test application by using pyramid with pserve and running pceleryd (I just send an email without blocking while it is sent). But there's one point that I don't understand: I want to run my application with mod_wsgi, and I…
Ottavio Campana
  • 4,088
  • 5
  • 31
  • 58
0
votes
2 answers

Cannot get django celeryd to work on Windows

I have a django project which runs just fine with runserver located in: D:\EverTabs\work\evertabs-website\src\evertabs\ My settings.py and manage.py reside in the above path. I open the trusty cmd shell, cd to that directory and run manage.py…
Krystian Cybulski
  • 10,789
  • 12
  • 67
  • 98
0
votes
1 answer

I want to have a queue that push task to worker (celeryd) depend on interval time setting

I 'm working of project that use celery, rabbitmq. I want to have right to control interval that queue push task to worker(celeryd).
vernomcrp
  • 3,459
  • 11
  • 34
  • 44
0
votes
1 answer

Django-Celery Daemon is unable to connect to Redis on Elasticbeanstalk

I am using celery with django for may scheduled tasks. Locally it worked. When i deployed it to Elasticbeanstalk the Celery Daemon is always connecting to rabbitmq and failing since there is no rabbitmq installed. Redis is locally installed on EB…
Rohail Najam
  • 1,031
  • 1
  • 8
  • 11
0
votes
0 answers

Celery gives Error No Nodes replied within time on doing Celery Control Shutdown

I want to kill a Celery App being used in another Service . Found out a command upon research- Celery Control Shutdown This Command Successfully Kills All the Processes but ends with a Error Error : No Nodes Replied within Time Constraint. PS:- We…
Raj Singh
  • 1
  • 1
0
votes
0 answers

Python Celery chord raises ChordError even when error is handled by callback

I have this problem in a larger application, but have reduced it to the following MRE. I have a Celery chord consisting of two parallel tasks feeding into one final tasks. It's expected that tasks might occasionally permanently fail for external…
ajn
  • 225
  • 1
  • 11
0
votes
0 answers

Celery - Loosing celery node/host momentarily when we send SIGTERM signal

Context: I am trying to write a graceful shutdown for my celery application The logic is that when I receive a SIGTERM signal, I stop (revoke) my currently running tasks by the celery and then exit the main worker process I am trying to achieve…
TCSHM
  • 31
  • 2
0
votes
0 answers

Celery worker exited prematurely on restart using systemd

I'm using celery with systemd. I noticed that most times on restart, I lose the workers mid-task. From the celery multi documentation, it seems like the celery multi stopwait should be waiting for the tasks to finish. Got the following error on…
Ankit
  • 3,878
  • 5
  • 35
  • 51
0
votes
0 answers

Some tasks, when received gets deplayed in celery

I am running my celery worker this way: celery -A main worker --loglevel=info --without-gossip --without-mingle -Ofair --autoscale=64,16 So there are tasks which run on very 5 min interval. Now in my website lets say i created a post then while…
Mohit Sharma
  • 23
  • 5
0
votes
1 answer

Is it possible to redeliver a Celery worker's tasks as soon as the worker stops sending heartbeat?

According to the celery documentation on Celery using Redis broker, The visibility timeout defines the number of seconds to wait for the worker to acknowledge the task before the message is redelivered to another worker This means that if a worker…
Jessica
  • 721
  • 1
  • 6
  • 13
0
votes
1 answer

Calling abort method of AbortableAsyncResult instance causes "RuntimeError: RPC backend missing task request for task_id"

I try to implement a working example with abortable tasks in celery (5.1.2) (code snippet bellow). When I call "abort" method on AbortableAsyncResult instance exception "RuntimeError: RPC backend missing task request for {task_id}" is raised. What…
Mark Nevt
  • 1
0
votes
1 answer

Celery prefetching not working celery app argument

I have a long task that I am asynchronously running with celery. Since I am using multiple workers I was getting poor load balancing due to prefetching. I initially tried to turn it off like this # __init__.py from celery import Celery celery =…
Naman
  • 372
  • 4
  • 20
0
votes
1 answer

No ExceptionInfo being passed to after_return handler in celery

Based on documentation, this handler is supposed to be called after the task returns. The einfo argument refers to the ExceptionInfo instance, the definition for which is found at http://docs.celeryproject.org/en/3.1/_modules/billiard/einfo.html I…
user3732361
  • 377
  • 8
  • 13
0
votes
1 answer

Why do tasks from previous celery workers persist when I create a new worker?

A celery worker created with one file of tasks "remembers" tasks from a previous celery worker which are not in the file of tasks that I am now using. At a time in the past, I created a celery worker using a file containing tasks called 'tasks.py.'…
dalex1
  • 49
  • 4
0
votes
1 answer

Using Celery and Redis with my Django application

I would like to ask a question according to Celery and Redis with my Django application. As I will explain further in details, I get some random issues with these applications. My environment: I'm using : Django 1.11.20 django-redis 4.7.0 / redis…
Essex
  • 6,042
  • 11
  • 67
  • 139
1 2 3
…
9 10