Questions tagged [celerybeat]

The Celery periodic task scheduler

Celery beat is a scheduler for periodic tasks in Celery. It provides useful functions to create and execute tasks on certain intervals, with support for fail-over, retries, status tracking etc. For more info look at project documentation: http://celery.github.com/celery/internals/reference/celery.beat.html

514 questions
0
votes
0 answers

Celery PeriodicTask added in runtime wouldn't be received?

try: delete_interval = IntervalSchedule.objects.get(every=1, period='seconds') except ObjectDoesNotExist: delete_interval = IntervalSchedule(every=1, period='seconds') …
Edge
  • 5
  • 3
0
votes
1 answer

scheduling a task at multiple timings(with different parameters) using celery beat but task run only once(with random parameters)

What i am trying to achieve Write a scheduler, that uses a database to schedule similar tasks at different timings. For the same i am using celery beat, the code snippet below would give an idea try: reader = MongoReader() except: …
mayank
  • 11
  • 3
0
votes
1 answer

Using celery beat as a scheduler for irregular intervals?

I have a single django application that allows the user to create multiple distinct blogs. Each blog needs to collect model data (e.g. number of visits, clicks, etc.) hourly/daily/weekly etc. and the interval at which data is collected may be…
FatHippo
  • 177
  • 3
  • 12
0
votes
0 answers

Dynamic Scheduling with Celery Beat

I'm building a testing utility, which runs a bunch of tests periodically, some scheduled to run daily, some hourly, some weekly, etc. I'm trying to build this feature on Celery Beat, with a RabbitMQ broker. However, the list of tests to be run at…
sukrit6
  • 11
  • 1
  • 3
0
votes
1 answer

run celery tasks in random times

i need to run few celery tasks in random times - every run should be at a new random time - the random number should generated every run. what I did in the past is: "my_task": { "task": "path.to.my_task", "schedule":…
amichib
  • 9
  • 2
  • 7
0
votes
1 answer

Celery run task periodically only next 5 days

I have a celery task and i need it to run only next five days at 12.30am. How do i do this using celery-beat. I know how to run it periodically forever but not able to figure out for only next five days Any idea?
Sandeep
  • 53
  • 1
  • 7
0
votes
1 answer

how we can add a new task in celery without stop celery instance in django celery?

@shared_task def forgot_email(subject,user_cipher,key_cipher,to): print "comes here in the mail" try: email_content = {'user_cipher':user_cipher,'key_cipher': key_cipher} message =…
GauravInno
  • 317
  • 1
  • 2
  • 14
0
votes
2 answers

Extended celery.schedules.schedule objects aren't passed extra arguments

The code is here. I wrote an extension of the celery.schedules.schedule interface, and I can't figure out why it's getting instantiated with nothing set in the extra values I created. When I instantiate them before passing to…
0
votes
1 answer

Celery tasks with groups which returns Json error when returning group results

My workflow is a little complex but I hope someone would understand it from explanation or code below. Basically, I am scraping a site/directory of company. When a query is passed it returns mini profile of companies i.e 50 companies per page. Using…
Jide Koso
  • 415
  • 5
  • 17
0
votes
1 answer

Django - User CeleryBeat in Production with Supervisor

An example celerybeat conf file looks like this [program:celerybeat] ; Set full path to celery program if using virtualenv command=celery beat -A myapp --schedule /var/lib/celery/beat.db --loglevel=INFO ; remove the -A myapp argument if you are…
PiccolMan
  • 4,854
  • 12
  • 35
  • 53
0
votes
1 answer

Celery jobs not running

When I run m script like this on ubuntu as root, it works: ./my_celery.sh But when it runs with Upstart like this it does not execute the task: Upstart: description "Django instance" start on runlevel [2345] stop on runlevel [06] respawn respawn…
Harry
  • 13,091
  • 29
  • 107
  • 167
0
votes
1 answer

Celery worker with Redis broker can't execute Django task

I'm learning Python(2.7)/Django(1.5) these days via developing my own Reddit clone (on ubuntu 14.04 LTS). I'm trying to incorporate Celery(3.1) with Redis into the mix, using it to periodically run a ranking algo as a task (on my local set up). But…
Hassan Baig
  • 15,055
  • 27
  • 102
  • 205
0
votes
1 answer

Celerybeat service not starting

I'm trying to get celery running as a service and I'm having a problem with the CELERYBEAT_OPTS parameter. I can start the celery service just fine and I'm able to start celerybeat fine via the command line like this: celery -A base beat -S…
scoopseven
  • 1,767
  • 3
  • 18
  • 27
0
votes
1 answer

Celery, AttributeError: 'module' object has no attribute 'celeryconfig'

I'm trying to setup a periodic-tasks via Python-Celery. Following is my project structure: proj/ proj/__init__.py proj/celeryconfig.py proj/celery.py proj/tasks.py celery.py from __future__ import absolute_import from celery import Celery #…
nimeshkiranverma
  • 1,408
  • 6
  • 25
  • 48
0
votes
1 answer

How to make two tasks mutually exclusive in Celery?

Is there a way to disallow two different tasks to run simultaneously in Celery? I was thinking about defining a new queue with concurrency level=1, and send those tasks to that queue, but I couldn't find an example. Is that possible? Thanks!
Michael Spector
  • 36,723
  • 6
  • 60
  • 88