Stack Overflow
Stack Overflow

Questions tagged [celeryd]

celeryd is the common name of a Celery worker node, running as a daemon.

Celery is a widely used asynchronous job/task queue processing engine, written in Python and available under the New BSD License. It can use a large variety of message brokers like RabbitMQ, Redis, MongoDB, CouchDB, Amazon SQS and others.

More info here: http://celery.github.com/celery/getting-started/introduction.html#overview

148 questions
0
votes
0 answers

Celery scheduler does not let tasks to run

Here is excerpt from my settings.py CELERYBEAT_SCHEDULER = "djcelery.schedulers.DatabaseScheduler" import djcelery from celery.schedules import crontab djcelery.setup_loader() CELERY_IMPORTS = ("app.some.tasks",) CELERYBEAT_SCHEDULE = { …
changer
  • 329
  • 2
  • 4
  • 19
0
votes
1 answer

/etc/init.d/celeryd start fail on AWS

Hi I've been reading a lot about this on this forums but I just don't have an idea of what's going wrong right now, looks like everything is ok, but just don't work I set up my local configuration like this (/etc/default/celeryd): # or we could have…
Chriss Mejía
  • 110
  • 1
  • 10
0
votes
1 answer

Django/Python: import error in celery taks.py

I am facing an import error inside celery task.py. The class StockManager method which is in another package is used to save the details. However i am getting and import error for StockManager(). How can i resolve this issue. Am i doing anything…
Anish
  • 872
  • 5
  • 21
  • 42
0
votes
1 answer

Mysterious unrelated task_id being returned for celery workflow.

I have a rather complex workflow (which is built dynamically) which looks something like this: workflow= chain( signature('workflow.tasks.start_workflow', kwargs= {}), chord( [ signature('workflow.tasks.group_task', kwargs= {}), …
richie
  • 1
  • 2
0
votes
0 answers

Celery workers only using 15% cpu?

I'm running a celery + rabbitmq app. I start up a bunch of ec2 machines, but I find that my celery worker machines only use about 15% cpu (peak of 30%). I've configured 6 celery workers per machine ( I just set number of workers to a big higher than…
jeffrey
  • 3,196
  • 7
  • 26
  • 44
0
votes
2 answers

How to run celery as daemon with normal celery command

I have a django app for which i am using celery tasks to perform some csv processing in background, and so i installed rabbitmq-server like sudo apt-get install rabbitmq-server, by this command the rabbitmq-server was installed and running…
Shiva Krishna Bavandla
  • 25,548
  • 75
  • 193
  • 313
0
votes
1 answer

Django Models not being loaded when the celery worker starts

I am using Django-Celery 3.0.23. When I run the command python manage.py celery worker, the models do not get loaded instantaneously. This is something opposite as seen in python manage.py celeryd. To test this I put a print statement in my…
Sandip Agarwal
  • 1,890
  • 5
  • 28
  • 42
0
votes
1 answer

/init.d/function + python version

I am trying to daemonize celery and celerybeat. I have downloaded the celeryd and celeybeat files from github and placed them in /etc/init.d/ (celery and celerybeat) with the corresponding config files under /etc/default/. My problem is that when I…
Reza
  • 1
  • 2
0
votes
1 answer

Django Celerybeat PeriodicTask running far more than expected

I'm struggling with Django, Celery, djcelery & PeriodicTasks. I've created a task to pull a report for Adsense to generate a live stat report. Here is my task: import datetime import httplib2 import logging from apiclient.discovery import…
Dustin
  • 3,965
  • 5
  • 27
  • 33
0
votes
1 answer

Number of celery tasks executed at a given point of time

I am trying to create a bunch of celery tasks asynchronously on the fly. Say there are 1000 tasks I start asynchronously and I have only one celeryd process running to execute tasks. How many threads will be created by celery to handle these…
Vijay Shankar Kalyanaraman
  • 917
  • 3
  • 9
  • 16
0
votes
1 answer

Celeryd does not execute my workers

I'm trying to daemonize my tasks in celery, i've tested without daemonizing and it's working very well. But i can't daemonize like the tutorial said (http://docs.celeryproject.org/en/latest/tutorials/daemonizing.html#daemonizing) I have my…
shinjidev
  • 383
  • 1
  • 6
  • 21
0
votes
1 answer

Running celeryd_multi as a daemon

I'm using celery 3.0.11 and djcelery 3.0.11 with python 2.7 and django 1.3.4. I'm trying to run celeryd as a daemon and I've followed instructions from http://docs.celeryproject.org/en/latest/tutorials/daemonizing.html When I run the workers using…
ksrini
  • 1,412
  • 2
  • 19
  • 33
-1
votes
1 answer

Run celery periodic tasks on one machine only

I am working on a django project where I am using celery. I have three two big modules in the project named app1 and app2. I have created two celery apps for that which are running on two separate machines. In the app1 and app2 there are different…
rajpreet singh
  • 41
  • 5
1 2 3
…
9
10