Stack Overflow
Stack Overflow

Questions tagged [celerybeat]

The Celery periodic task scheduler

Celery beat is a scheduler for periodic tasks in Celery. It provides useful functions to create and execute tasks on certain intervals, with support for fail-over, retries, status tracking etc. For more info look at project documentation: http://celery.github.com/celery/internals/reference/celery.beat.html

514 questions
0
votes
2 answers

What is the best "architecture" for running celery (and celery beat) in production environment (debian server)?

I"m trying to figure out the best "architecture" so our django projects hosted on debian server could use celery and celery beat. He are my requirements: Celery workers and celery beats should be able to run after server restart…
snakey
  • 637
  • 4
  • 11
0
votes
0 answers

Task stops retrying after random number of tries

As the subject says, tasks that used to retry until they reach defined "max_retries" count, now sometimes stop doing that after random number of times :/. Sometimes they stop retrying after couple hundred times, sometimes after just few times. What…
Lauris
  • 13
  • 2
0
votes
0 answers

How to use Celery with a database of schedule items and not repeat tasks

I'm looking into Celerybeat for launching tasks that are scheduled at various times based upon a database: e.g. Task A fires at 12:00pm Task B fires at 12:05pm There could be many many tasks that fire at the same time. I was thinking I would…
iJames
  • 640
  • 1
  • 7
  • 16
0
votes
0 answers

celery takes too long time to write result to rabbitmq

Recently, I started celery beat to run a task periodically. The task will take about 2 minutes. The beat interval is 3 minutes. The back end use rabbitmq. However, the totally elapsed time of a task become nearly 20 minutes. It looks so strange!…
Jacky1205
  • 3,273
  • 3
  • 22
  • 44
0
votes
1 answer

Rogue CeleyBeat process

We are running a Django site with a Celery worker along with celery beat for cron jobs. On occasion we will have a rogue celery beat process that keeps running when supervisor is restarted, or job in supervisor are restarted (I'm not sure when…
Dustin
  • 3,965
  • 5
  • 27
  • 33
0
votes
0 answers

Efficient recurring tasks in celery?

I have ~250,000 recurring tasks each day; about a fifth of which might be updated with different scheduled datetimes each day. Can this be done efficiently in Celery? - I am worried about this from celery's beat.py: def tick(self): …
A T
  • 13,008
  • 21
  • 97
  • 158
0
votes
1 answer

Unable to get celery worker to work

I have been working on a project which uses Celery beat for scheduling tasks. Locally, I have been using RabbitMQ as the broker and everything was working fine. When I pushed my project to the remote server, I changed the broker to Redis. The celery…
vaidik
  • 2,191
  • 1
  • 16
  • 22
0
votes
1 answer

Nginx(Django) ImportError: cannot import name celeryd

I tested my project in my local machine, and it worked fine. But after uploading to a remote server(CentOS), I cannot execute celerybeat. Here is my command. python manage.py celeryd --events --loglevel=INFO -c 5…
margincall
  • 483
  • 1
  • 6
  • 24
0
votes
0 answers

CeleryBeat issues on Ubuntu

I'm noticing weird issues with CeleryBeat. I use it regularly for running period tasks that are very crucial and important for me. Every so often (almost every 2-5 days) I notice that CeleryBeat silently fails. No warnings or errors in the logs (all…
KVISH
  • 12,923
  • 17
  • 86
  • 162
0
votes
0 answers

zoneinfo data corrupt, how do I compile new data?

Basically the same thing happened again as when I asked this question. However this time I cannot get it right again. I tried the answer of Burhan Khalid again and I get the same errors again. I also tried copy pasting the zoneinfo folder from a…
Allard Stijnman
  • 1,284
  • 11
  • 22
0
votes
1 answer

scheduling start up doesn't work

When setting-up Celery and I want to use scheduling do I add both init scripts below or just the celerybeat…
GrantU
  • 6,325
  • 16
  • 59
  • 89
0
votes
1 answer

Django Celerybeat PeriodicTask running far more than expected

I'm struggling with Django, Celery, djcelery & PeriodicTasks. I've created a task to pull a report for Adsense to generate a live stat report. Here is my task: import datetime import httplib2 import logging from apiclient.discovery import…
Dustin
  • 3,965
  • 5
  • 27
  • 33
0
votes
1 answer

want to find when the job will be started in celery

i am new to celery. i have some configuration in celeryconfig.py as follow: from datetime import…
Rohitashv Singhal
  • 4,517
  • 13
  • 57
  • 105
0
votes
2 answers

Celery/Kombu ignoring run_every

I'm kombu/celery setup that I've recently deployed. The tasks execute fine, but appear to run almost continuously rather than respecting the run_every attribute. Perhaps more oddly, this behavior only appears in production and works fine locally.…
Chris
  • 555
  • 2
  • 9
  • 28
-1
votes
1 answer

RuntimeError: Model class django_celery_beat.models.SolarSchedule doesn't declare an explicit app_label and isn't in an application in INSTALLED_APPS

I'm using my virtualenv and upon executing celery -A app beat -l info -S django, this error always displays. RuntimeError: Model class django_celery_beat.models.SolarSchedule doesn't declare an explicit app_label and isn't in an application in…
Imam Hossain Roni
  • 584
  • 6
  • 12
1 2 3
…
34
35