Stack Overflow
Stack Overflow

Questions tagged [celerybeat]

The Celery periodic task scheduler

Celery beat is a scheduler for periodic tasks in Celery. It provides useful functions to create and execute tasks on certain intervals, with support for fail-over, retries, status tracking etc. For more info look at project documentation: http://celery.github.com/celery/internals/reference/celery.beat.html

514 questions
6
votes
2 answers

python celery - how to add CELERYBEAT_SCHEDULE task at runtime to a worker?

I have created a celery worker with a single celerybeat schedule task which runs at 5 seconds time interval. How can I add another beat task dynamically to the celery worker without stopping it? Example app.conf.update( …
muhil varnan
  • 320
  • 2
  • 9
6
votes
1 answer

Prevent Celery Beat from running the same task

I have a scheduled celery running tasks every 30 seconds. I have one that runs as task daily, and another one that runs weekly on a user specified time and day of the week. It checks for the "start time" and the "next scheduled date". The next…
shizznetz
  • 151
  • 1
  • 2
  • 10
6
votes
1 answer

Daemonize Celerybeat in Elastic Beanstalk(AWS)

I am trying to run celerybeat as a daemon in Elastic beanstalk. Here is my config file: files: "/opt/python/log/django.log": mode: "000666" owner: ec2-user group: ec2-user content: | # Log file encoding:…
Jahongir Rahmonov
  • 13,083
  • 10
  • 47
  • 91
6
votes
1 answer

celery beat doesn't work properly

when i run this command for celery beat. [2013-06-27 02:17:05,936: INFO/MainProcess] Celerybeat: Starting... [2013-06-27 02:17:05,937: INFO/MainProcess] Writing entries... [2013-06-27 02:17:08,711: INFO/MainProcess] DatabaseScheduler: Schedule…
user2357067
  • 73
  • 1
  • 1
  • 6
6
votes
1 answer

Django Celery Beat - How to pass arguments using the DatabaseScheduler

I'm using the "DatabaseScheduler" with the Django Celery Beat, but I can't pass arguments to the function. The settings: # Django celery import djcelery djcelery.setup_loader() BROKER_URL = 'django://' CELERYBEAT_SCHEDULER =…
André
  • 24,706
  • 43
  • 121
  • 178
5
votes
2 answers

celery-beat KeyError: 'scheduler'

I am trying to run a periodic celery task using celery beat and docker for my Flask application. However when I run the container I get the below error: Removing corrupted schedule file 'celerybeat-schedule': error(22, 'Invalid argument') Traceback…
James
  • 307
  • 8
  • 22
5
votes
1 answer

Start celery beat from a python program without using command line arguments

I have a implemented a python command which starts celery @click.command("tasks", help="run this command to start celery task queue") def tasks(): """ Runs the celery task queue """ from celery.bin import worker try: …
not 0x12
  • 19,360
  • 22
  • 67
  • 133
5
votes
4 answers

Running periodic task at time stored in database

Currently, I have periodic tasks set up with a Job Scheduler on my Azure instance. These are triggering API (Django) endpoints at fixed times. I want to make these times dynamic (which will not work with this solution). The plan is to fire these…
Matt
  • 1,017
  • 2
  • 11
  • 27
5
votes
1 answer

How to register Celery task to specific worker?

I am developing web application in Python/Django, and I have several tasks which are running in celery. I have to run task A one at a time so I have created worker with --concurrency=1 and routed task A to that worker using following command. celery…
Darshit
  • 420
  • 2
  • 11
5
votes
1 answer

Django celery beat task not working

celery.py from __future__ import absolute_import, unicode_literals import os from celery import Celery from django.conf import settings os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'TwitterApiProxy.settings') app =…
lch
  • 4,569
  • 13
  • 42
  • 75
5
votes
2 answers

Celery Beat on Amazon ECS

I am using Amazon Web Services ECS (Elastic Container Service). My task definition contains Application + Redis + Celery and these containers are defined in task definition. Automatic scaling is set, so at the moment there are three instances with…
smuctic
  • 51
  • 1
  • 2
5
votes
2 answers

Celery add_periodic_task blocks Django running in uwsgi environment

I have written a module that dynamically adds periodic celery tasks based on a list of dictionaries in the projects settings (imported via django.conf.settings). I do that using a function add_tasks that schedules a function to be called with a…
Tim
  • 1,272
  • 11
  • 28
5
votes
1 answer

periodic task in celery using python without django

Hello all i am newbie to celery and python. i am creating a simple task using rabbitmq-server. But i have no idea how to achieve periodic task using celery beat in python. I search but every where i get periodic task with django. i use this code as…
Manish Yadav
  • 435
  • 2
  • 8
  • 24
5
votes
1 answer

unable to execute Celery beat the second time

I am using Celery beat for getting the site data after every 10 seconds. Therefore I update the settings in my Django project. I am using rabbitmq with celery. settings.py # This is the settings file # Rabbitmq configuration BROKER_URL =…
Chitrank Dixit
  • 3,961
  • 4
  • 39
  • 59
5
votes
1 answer

Run celery worker and celery beat as thread

I am using celery to perform some time triggered tasks. Using normal command line methods I am easily able to generate tasks and execute them. For this I have to create two daemons, one for celery beat and another for celery worker. Now though…
user3185902
  • 117
  • 2
  • 13
1 2 3
…
34 35