Stack Overflow
Stack Overflow

Questions tagged [celerybeat]

The Celery periodic task scheduler

Celery beat is a scheduler for periodic tasks in Celery. It provides useful functions to create and execute tasks on certain intervals, with support for fail-over, retries, status tracking etc. For more info look at project documentation: http://celery.github.com/celery/internals/reference/celery.beat.html

514 questions
10
votes
1 answer

Sending message from Celery task to Channels

Django 2.1.1, Django Channels 2.1.3, Celery 4.2.1 I've set up a task in Celery and at the end of the task, I need to send a websocket message to the client(s). However, the websocket message is never sent. There are no errors thrown, it just…
Charles Koch
  • 151
  • 1
  • 8
10
votes
2 answers

Periodic tasks in Django on Elastic Beanstalk (possibly with celery beat)

I'm trying to set up a daily task for my Django application on Elastic Beanstalk. There doesn't appear to be an accepted way to set this up, as celery beat is the go-to solution for periodic tasks in Django, but isn't great for load-balanced…
Jonathan Richards
  • 1,414
  • 1
  • 16
  • 20
10
votes
1 answer

Replacing Celerybeat with Chronos

How mature is Chronos? Is it a viable alternative to scheduler like celery-beat? Right now our scheduling implements a periodic "heartbeat" task that checks of "outstanding" events and fires them if they are overdue. We are using python-dateutil's…
Goro
  • 9,919
  • 22
  • 74
  • 108
9
votes
1 answer

How not to start same task and wait until it is finished with celery beat

I have scheduled task with celery beat to run every 3 hours: 'sync_stuff': { 'task': 'celery_tasks.sync_stuff', 'schedule': crontab(hour='*/3') } Sometimes it takes longer than 3 hours to finish the task and I want to ensure that celery…
Ivan Lebediev
  • 507
  • 4
  • 15
9
votes
1 answer

Testing Celery Beat

i work on a celery beat task within a django project which creates Database entries periodically. I know so beacuse when i set the task up like this : celery.py: from __future__ import absolute_import, unicode_literals import os from celery import…
Chgad
  • 820
  • 2
  • 7
  • 18
9
votes
2 answers

Celery beat + redis with password throws No Auth exception

I am using celery and redis as two services in my docker setup. Configuration is as below: redis: image: redis:latest hostname: redis ports: - "0.0.0.0:6379:6379" command: --requirepass PASSWORD celeryworker: <<:…
Rajesh Yogeshwar
  • 2,111
  • 2
  • 18
  • 37
9
votes
3 answers

Celery autoreload not working

I am using Celery 3.1.16 broker (running RabbitMQ) and multiple Celery workers with celeryd daemonized through supervisor. Problem is with tasks update. When I update my tasks.py file, celery worker runs old code. Celery launch…
LJ Adams
  • 91
  • 1
  • 2
9
votes
1 answer

Maximum clients reached on Heroku and Redistogo Nano

I am using celerybeat on Heroku with RedisToGo Nano addon There is one web dyno and one worker dyno The celerybeat worker is set to perform a task every minute. The problem is: Whenever I deploy a new commit, dynos restart, and I get this error…
JV.
  • 2,658
  • 4
  • 24
  • 36
9
votes
4 answers

Celery beat - different time zone per task

I am using celery beat to schedule some tasks. I'm able to use the CELERY_TIMEZONE setting to schedule the tasks using the crontab schedule and it runs at the scheduled time in the mentioned time zone. But I want to be able to setup multiple such…
ksrini
  • 1,412
  • 2
  • 19
  • 33
9
votes
2 answers

celerybeat uses UTC even with timezone settings

I'm finding that celerybeat is using UTC time in its scheduling (and outputting logs in UK time?!) even though I believe I have the required settings in my django settings.py: TIME_ZONE = 'UTC' USE_TZ = True CELERY_ENABLE_UTC = True CELERY_TIMEZONE…
Trent
  • 2,328
  • 3
  • 33
  • 51
8
votes
1 answer

Django Celery Beat with Database scheduler not running tasks

Ive been searching wide and far and everything i've come across thus far suggests my configuration is correct.... I can see my tasks are being registered in my celery worker container. I don't see them registered in my beat container (but I don…
AlexW
  • 2,843
  • 12
  • 74
  • 156
8
votes
1 answer

How to disable retry in celery?

I am running a celerybeat scheduler every 15 mins where I need to fetch data from API (rate limit = 300 requests/min max) and store the results into the database. I would like to fetch the urls in parallel subject to rate limits at the same time. If…
PirateApp
  • 5,433
  • 4
  • 57
  • 90
8
votes
1 answer

Using celery to build microservices

I am going break down a project into small microservices. All microservices are cron-based. I am thinking of celery as a task distribution as well a mechanism to run periodic tasks (celerybeat). I don't want to build multiple celery app per…
Rakesh Bhatt
  • 115
  • 2
  • 13
8
votes
1 answer

How to pass a class based task into CELERY_BEAT_SCHEDULE

As seen in the docs class based tasks are a fair way to express complex logic. However, the docs do not specify how to add your shiny newly created class based task into you CELERY_BEAT_SCHEDULE (using django) Thing I…
Oleg Belousov
  • 9,981
  • 14
  • 72
  • 127
8
votes
3 answers

Celery beat not starting on Heroku

I have an app that I've launched on Heroku, but the Celery beat process doesn't start when I start the server. Procfile web: gunicorn -w 4 connect.wsgi celery: python manage.py celeryd -c 3 --beat The worker can be seen to be started after the…
Jared Goguen
  • 8,772
  • 2
  • 18
  • 36
1 2
3
…
34 35