Stack Overflow
Stack Overflow

Questions tagged [celeryd]

celeryd is the common name of a Celery worker node, running as a daemon.

Celery is a widely used asynchronous job/task queue processing engine, written in Python and available under the New BSD License. It can use a large variety of message brokers like RabbitMQ, Redis, MongoDB, CouchDB, Amazon SQS and others.

More info here: http://celery.github.com/celery/getting-started/introduction.html#overview

148 questions
1
vote
0 answers

OS Error on running django-celery as daemon

I need to run celery as a daemon. I am not using supervisor for this. Instead, I want to run celery with init on system start. Here is the traceback of the error I am getting on starting the celery with sudo /etc/init.d/celeryd…
sukantk
  • 45
  • 7
1
vote
1 answer

Celery worker can't complete job wher running as daemon

I have a celery setup with django & redis. When i run celery by command from user, like celery multi start 123_work -A 123 --pidfile="/var/log/celery/%n.pid" --logfile="/var/log/celery/%n.log" --workdir="/data/ports/dj_dois" --loglevel=INFO job…
Алексей Девяткин
  • 19
  • 1
  • 4
1
vote
1 answer

Celery worker receiving task with the same id more than once

I have a django project with celery. I'm seeing an issue of some workers receiving task with the same id more than once. Here is a snippet of the logs: 9238 [2015-07-03 10:25:03,310: INFO/MainProcess] Task…
A. B
  • 687
  • 9
  • 18
1
vote
1 answer

Celery KeyError when wrapping app.task function with imported decorator; errors only w/ import

Given the layout: background \ tasks \ __init__.py generic.py helpers.py __init__.py _server.py config.py router.py server.py And launching _server.py with celery -A background._server worker I'm…
blakev
  • 4,154
  • 2
  • 32
  • 52
1
vote
3 answers

celeryd with RabbitMQ hangs on "mingle: searching for neighbors", but plain celery works

I'm banging my head to the wall with celeryd and RabbitMQ. This example from tutorial is working just fine: from celery import Celery app = Celery('tasks', backend='amqp', broker='amqp://') @app.task def add(x, y): return x + y I run: celery -A…
auramo
  • 13,167
  • 13
  • 66
  • 88
1
vote
0 answers

Running celery on windows

I'm working with Django and my development environment is Windows. Yesterday I spent the WHOLE day trying to make celery run on my laptop with RabbitMQ. I went through all the tutorials and nothing special was mentions about windows. I followed this…
tkazaz
  • 11
  • 2
1
vote
2 answers

"celeryd stop" is not working

I am using celery in an uncommon way - I am creating custom process when celery is started, this process should be running all the time when celery is running. Celery workers use this process for their tasks (details not needed). I run celery from…
misoK
  • 415
  • 1
  • 3
  • 15
1
vote
1 answer

Command 'celeryd' not known when using ckanext-archiver

I'm using CKAN as my open data portal and am installing the Archiver Extension by following the instructions at https://github.com/ckan/ckanext-archiver. I have installed celery as shown: Successfully installed celery kombu kombu-sqlalchemy…
kean23
  • 105
  • 6
1
vote
1 answer

Celery multi not working as expected

I have this my project folder structure api -- __init__.py --jobs/ -- __init__.py -- celery.py -- celeyconfig.py -- tasks.py --api_helpers/ --views/ tasks has a task called ExamineColumns I launch the…
Ranjith Ramachandra
  • 10,399
  • 14
  • 59
  • 96
1
vote
1 answer

Celery Python logging config to log DEBUG only from specified modules

I'm trying to get django celery to log (to console) DEBUG (and higher) events coming from my modules (and not those of libraries). So starting celeryd with: python hack/manage.py celeryd -E -l DEBUG -c 2 will mean that all DEBUG events are passed…
Trent
  • 2,328
  • 3
  • 33
  • 51
1
vote
2 answers

Difficulty changing a Python method signature across Celery

This is probably a Captain Obvious style question, but I feel like I'm missing something. I inherrited a Python WSGI app that creates Celery tasks. That looks like this: #web.py from bottle import route, run, request, response, abort import…
Chris
  • 1,231
  • 1
  • 17
  • 35
1
vote
1 answer

Deployment of Celeryd to the AWS Beanstalks

I'm working on python web site which uses Celery for running long running background procesess. I plan to deploy my web site with celery worker to Beanstalk container. Please share you expirence or ideas how to deploy and run celeary workers as…
Vadym Fedorov
  • 2,395
  • 2
  • 21
  • 31
1
vote
1 answer

Celeryd running multiple daemons

I'm attempting to use Celery with the RabbitMQ backend to run asynchronous background tasks on Fedora, and I'm finding it frustratingly unreliable. The biggest problem is that it occasionally runs the identical task multiple times, and I'm having…
Cerin
  • 60,957
  • 96
  • 316
  • 522
1
vote
1 answer

celery tasks with returned data: doing it wrong or doing it right?

I'm learning to use celery. I have a function (in a Flask application) in somewhat pseudocode from what I've learned so far: def do_a_task_route(): try: result = a_celery_task.apply_async(args=[request_data]) returned =…
blueblank
  • 4,724
  • 9
  • 48
  • 73
1
vote
1 answer

Celeryd Worker stops processing tasks

I have a celeryd running with two workers, and watching them I see them accept 4 tasks each, process them, and then stop processing tasks. (Note that these tasks are long running, up to 2mins to process). celeryctl provides the following…
thomas
  • 949
  • 6
  • 20
1 2 3
…
9 10