Stack Overflow
Stack Overflow

Questions tagged [celerybeat]

The Celery periodic task scheduler

Celery beat is a scheduler for periodic tasks in Celery. It provides useful functions to create and execute tasks on certain intervals, with support for fail-over, retries, status tracking etc. For more info look at project documentation: http://celery.github.com/celery/internals/reference/celery.beat.html

514 questions
0
votes
1 answer

Celery 4.1.0 And django-celery-beat 1.10, don't work tgether

Helo, i have created a periodic task in database using django-celery-beat then try to run celery with beat by using next command celery -A proj worker -B -l info but beat don't send task to celery Add Debug level log, maybe some one know how to fix…
Beliaf
  • 577
  • 2
  • 8
  • 25
0
votes
1 answer

@task_postrun.connect signal in Celery and executing another task results in some infite loop of executions

I need following workflow for my celery tasks. when taskA finishes with success I want to execute taskB. I know there is signal @task_success but this returns only task's result, and I need access to parameters of previous task's arguments. So I…
andilabs
  • 22,159
  • 14
  • 114
  • 151
0
votes
2 answers

Shared image volume mount error in docker

I use docker-compose for running my containers in docker. I have two services - one of celerybeat and other the web (I have many others but considering only these services because they contain my problem). docker-compose.yml file looks like…
Arpit Goyal
  • 2,212
  • 11
  • 31
0
votes
0 answers

Django-celery-beat is scheduling interval tasks continuously

I recently followed this tutorial: https://www.codingforentrepreneurs.com/blog/celery-redis-django/ in order to configure django-celery-beat. Everything works fine if I start the beat worker like this: celery -A proj beat -l info however, if I get…
Rob
  • 617
  • 8
  • 21
0
votes
1 answer

Add a delay between subtasks of a group

I am creating a Celery group to execute a bunch of processes in parallel. The following is the code - @periodic_task(run_every=timedelta(minutes=1)) def schedule_pivots(): today_list="A,B,C,D" g = group(get_pivots.s(l,'OPT') for l in…
Ved
  • 3,380
  • 6
  • 40
  • 51
0
votes
1 answer

process is not spawning with Multiprocessing module in celery

I have a pretty standard set-up: Django + Rabbitmq + Celery. I am trying to spawn a process using standard python multiprocessing module in celery. I have noticed that process itself is not spawning. What could be the reason for not spawning the…
Anil Kumar Thotamalla
  • 93
  • 1
  • 8
0
votes
1 answer

run Celery on same server as django?

I am running my Django app in a load balanced Elastic Beanstalk Environment. I want to add a Celery daemon process to do the following things: Upload files to S3 in background and send a success response to my Android app Send SMS to users to…
Joy Lal Chattaraj
  • 3
  • 3
0
votes
1 answer

Celery worker goes into infinite startup and shutdown cycle

I've been using celery (the async task queue in python) in a Django project with Redis as a results backend and broker for a few years now - today I tried switching the backend / broker to AWS's ElastiCache Redis, but the celery worker goes into an…
tzenderman
  • 2,523
  • 3
  • 21
  • 24
0
votes
0 answers

Showing KeyError: 'schedules.tasks.run' while running the django celery for periodic tasks

I've created a classes based periodic task using djcelery to send emails to the client. Task is performing the action and sending email when it is called from shell but while using the crontab, I am getting KeyError as "Schedule.tasks.run". I have…
Srishti Gupta
  • 9
  • 2
0
votes
1 answer

Celery-beat: why it doesn't work in Django?

Task itself works well(run asynchronously), but when I trying using celery beat it doesn't work. I followed http://docs.celeryproject.org/en/latest/userguide/periodic-tasks.html#beat-custom-schedulers. This is my django project structure: . . ├──…
user3595632
  • 5,380
  • 10
  • 55
  • 111
0
votes
1 answer

celery periodic task not getting executed with tasks.py

Hi I have added a new app called "schedule_stop" and registered the app in settings also. Now added a new file called tasks.py and following is the content of the file, from celery.task.schedules import crontab from celery.decorators import…
Naggappan Ramukannan
  • 2,564
  • 9
  • 36
  • 59
0
votes
1 answer

Periodic task schedules set through view functions (Django app)

I schedule repeat tasks for my Django app via including them in the CELERYBEAT_SCHEDULE dictionary in my settings.py. For instance: CELERYBEAT_SCHEDULE = { 'tasks.rank_photos': { 'task': 'tasks.rank_photos', 'schedule':…
Hassan Baig
  • 15,055
  • 27
  • 102
  • 205
0
votes
1 answer

Celery Django celerybeat.pid permissions

Running Celery with Django on Debian production server under user that can't write in project' dir, but while initialization celery beat needs to create file to store pid (celerybeat.pid). > File >…
napilnik
  • 117
  • 2
  • 8
0
votes
1 answer

Celery beat scheduling option to immediately launch task upon celery launch

I can schedule an hourly task in my Django app using celery beat in settings.py like so: CELERYBEAT_SCHEDULE={ 'tasks.my_task':{ 'task':'tasks.my_task', 'schedule':timedelta(seconds=60*60), 'args':(), }, } But is there a way to schedule a task such…
Hassan Baig
  • 15,055
  • 27
  • 102
  • 205
0
votes
1 answer

Where to define Celery subtask queues

I have a pluggable app I'm developing for a Django system. In it, I have a task for creating notifications that looks something like so: installable_app.tasks @app.task(name='tasks.generate_notifications') def generate_notifications(...): I have a…
Eric Blum
  • 744
  • 12
  • 29
1 2 3
…
34 35