Questions tagged [celeryd]

celeryd is the common name of a Celery worker node, running as a daemon.

Celery is a widely used asynchronous job/task queue processing engine, written in Python and available under the New BSD License. It can use a large variety of message brokers like RabbitMQ, Redis, MongoDB, CouchDB, Amazon SQS and others.

More info here: http://celery.github.com/celery/getting-started/introduction.html#overview

148 questions
0
votes
1 answer

start celery with sudo command

I am working with Celery and I am trying to start it with sudo. sudo celery multi start worker --app=app.celery --loglevel=info --concurrency=1 I need to run the command with sudo, however when I do that I am getting a permission error. How can I…
Max Powers
  • 1,119
  • 4
  • 23
  • 54
0
votes
0 answers

Winrm error in while restarting the celeryd service

The module winrm is installed with all its dependencies, but still the celeryd service is not able to run. Here is the error trace: worker1@man11idm01.stman00.isyntax.net: DOWN /usr/lib64/python2.6/site-packages/cryptography/__init__.py:26:…
Raj
  • 419
  • 1
  • 4
  • 10
0
votes
0 answers

Run Celery Tasks at the end of all others celery tasks

I have First Function say A. This function will call Celery Task Cel_task1 in a loop and for each Cel_task1 will call another celery task Cel_task2 and each Cel_task2 will call celery task Cel_task3 and Cel_task3 will calculate result and save to…
0
votes
1 answer

How to save the task name in extended django_celery_result model

This is the tree of my project. └── elt-ui2 ├── Etl_ui │   ├── celerybeat.pid │   ├── celerybeat-schedule │   ├── celery_tasks │   │   ├── admin.py │   │   ├── apps.py │   │   ├── __init__.py │   │   ├── migrations │   │   │   ├── __init__.py │  …
0
votes
0 answers

Celery is not working as daemon

I am trying to use django and celery to automate the task and want to run celery as daemon. I copied the code for celeryd and celerybeat from its official documentation and put it inside the /etc/init.d/ folder. Below is the code of my…
0
votes
2 answers

django celery daemon does work: it can't create pid file

I can't init mi celeryd and celerybeat service, I used the same code on another enviroment (configuring everything from the start) but here don't work. I think this was by permissions but I could'nt run it. please help me. this is my celery conf on…
AsPolar
  • 1
  • 2
0
votes
1 answer

Celery does not start multiple workers

I am trying to set up a server to run multiple workers on Ubuntu using celery. Set up the daemon using the generic scripts and using rabbit-mq as the broker. celery==3.1.23 django-celery==3.1.17 django-celery-beat==1.0.1 /etc/default/celeryd -…
0
votes
1 answer

Production setup for celery

How can i setup Celery in Production Server using aws or digitalocean and broker as redis or rabbitmq. Please elaborate more on how we can resilience over the connection refused error while the broker is down.
Mukul Mantosh
  • 358
  • 4
  • 15
0
votes
1 answer

Attempting to restart Celery processes via Supervisor results in error

I am running supervisor/celery on an amazon aws server. Attempting to deploy a new application version eventually fails because the celery processes are not started. I have taken a look at the supervisord.conf file to ensure that the programs are…
0
votes
1 answer

How to get the list of hosts listening on a particular Que in Celery?

In my project I have two ques. I would like to know list of all the workers listening to a que. (need a pythonic way of doing this. Celery is running on a different machine and I want the details on other machine.)
Datta
  • 87
  • 1
  • 17
0
votes
1 answer

run Celery on same server as django?

I am running my Django app in a load balanced Elastic Beanstalk Environment. I want to add a Celery daemon process to do the following things: Upload files to S3 in background and send a success response to my Android app Send SMS to users to…
0
votes
1 answer

flower (Celery monitoring tool) API - how does the tasks sorted?

I'm using flower API Reference to build my own monitoring tool. When calling to: GET /api/tasks - how are tasks sorted? If I make a request each minute, will I get the most newest tasks received? started? finished? Is there an option to choose…
ItayB
  • 10,377
  • 9
  • 50
  • 77
0
votes
1 answer

Correcting mis-configured celery (running with supervisord)

I started running celery for tasks in a Python/Django web project, hosted on a single VM with 8 cores or CPUs. I need to improve the configuration now - I've made rookie mistakes. I use supervisor to handle celery workers and beat. In…
Hassan Baig
  • 15,055
  • 27
  • 102
  • 205
0
votes
1 answer

Celeryd ignores BROKER_URL in /etc/default/celeryd

Summary I am running Celery as a daemon via celeryd (as per instructions) Specified redis as the broker in the configuration file /etc/default/celeryd BROKER_URL="redis://localhost:6379/0" Worker log file indicates that BROKER_URL is being ignored…
taygan
  • 135
  • 1
  • 10
0
votes
1 answer

Celery configuration gets updated when calling a different task

I have multiple tasks as different django apps using a RabbitMQ broker. This was setup with standard django configuration and was working perfectly. I was using groups, chains and calling them from different modules. As a standard practice, I…
Confused
  • 617
  • 1
  • 9
  • 17
1 2 3
9
10