Questions tagged [celerybeat]

The Celery periodic task scheduler

Celery beat is a scheduler for periodic tasks in Celery. It provides useful functions to create and execute tasks on certain intervals, with support for fail-over, retries, status tracking etc. For more info look at project documentation: http://celery.github.com/celery/internals/reference/celery.beat.html

514 questions
0
votes
1 answer

Celery Beat runs duplicate tasks

I have one celery beat task, that is running other scraping tasks. When those tasks are not processed, queue is starting to grow. I know celery use backend db, but there are only: id, task_id, status, result, date_done, traceback. My ideas is to…
Vladimir Chernenko
  • 423
  • 2
  • 6
  • 10
0
votes
3 answers

Django models and Celery periodic tasks

I am working on a IoT projects with Django.I don't like to do tedious coding.The problem here is I have a model name Period like this: class Period(models.Model): number = models.PositiveIntegerField(primary_key=True) start_time =…
Q.Nguyen
  • 171
  • 1
  • 8
0
votes
1 answer

How to save the task name in extended django_celery_result model

This is the tree of my project. └── elt-ui2 ├── Etl_ui │   ├── celerybeat.pid │   ├── celerybeat-schedule │   ├── celery_tasks │   │   ├── admin.py │   │   ├── apps.py │   │   ├── __init__.py │   │   ├── migrations │   │   │   ├── __init__.py │  …
0
votes
1 answer

'ERROR: relation does not exist at character', error in celery with django

I have a model called UserApp, of which I make a query from an asynchronous task with Celery, but I get the following error from the output of the docker compose. postgres_1 | ERROR: relation "users_userapp" does not exist at character…
Alexis Vera
  • 357
  • 3
  • 10
0
votes
0 answers

Can I use --without-heartbeat and --beat on a celery worker together?

I want to have a celery worker and celery beat on the same process (dyno), however I want to limit the number of messages sent to RabbitMQ broker. Before implementing beat I have been using --without-heartbeat and it has been fine, but I wonder if…
Attack68
  • 4,437
  • 1
  • 20
  • 40
0
votes
0 answers

Celery is not working as daemon

I am trying to use django and celery to automate the task and want to run celery as daemon. I copied the code for celeryd and celerybeat from its official documentation and put it inside the /etc/init.d/ folder. Below is the code of my…
0
votes
3 answers

Flask + Celery + Redis: consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: timed out

I have a simple celery task set up. To run it, i first fired off the redis-server, then activated virtual env and entered "celery beat", opened a new terminal window channeling into the virtual env and entered "celery…
doyz
  • 887
  • 2
  • 18
  • 43
0
votes
1 answer

Exception running celery

I am trying to integrate celery version 4.2 in a django project. As per the docs I have done the changes in init.py and celery.py but when I run celery with: python -m celery -A instaguide beat -l debug I get the exception below. I am not sure…
Divick
  • 1,213
  • 1
  • 20
  • 44
0
votes
1 answer

Django celery beat doesn't see periodic task on Elastic Beanstalk

I have configured celery worker and celery beat on EB. There are no errors in logs during deploy and celery worker works fine, but doesn't see periodic tasks. On local machine everything works smoothly. Here is my config file for the celery files: …
Andrew
  • 735
  • 1
  • 8
  • 19
0
votes
0 answers

Celery not configuring different queues

I've installed celery 4.1.1 and setup queues and routes but the worker accepts data only via name 'celery'. BROKER_URL = 'redis://localhost:6379/0' CELERY_RESULT_BACKEND = 'redis://localhost:6379/0' CELERY_DEFAULT_QUEUE =…
Arjunsingh
  • 703
  • 9
  • 22
0
votes
0 answers

How to use celery with multiple databases?

I am moving my django project from single database to using 2 different mysql databases(master-slave configuration), where all my reads go to the slave, and writes go to the master. I have following configurations in my settings.py DATABASES =…
Tushar
  • 1,117
  • 1
  • 10
  • 25
0
votes
0 answers

Django Celery Beat Schduler sends next task with current one

I have trouble configuring Celery Beat to reliably send tasks at the scheduled time. It sometimes sends the next scheduled task at the same time than the current one, which then messes the whole schedule. Here are the 4 tasks I need to run,…
syl-lo
  • 123
  • 1
  • 1
  • 5
0
votes
1 answer

celery beat timezone problems

So, I have been using celery/beat for a number of years, and have been ofsetting manually, the schedule of my tasks due to DST issues etc. As my codebase has become larger, the script that I run to change the times is getting bigger and bigger, and…
crooksey
  • 8,521
  • 6
  • 30
  • 52
0
votes
2 answers

Issue with django-celery Not running at specific time

I am having issues with django-celery not running at the time specified, but it's always runnning every 1 minute. Below I have pasted the tasks.py, settings.py and celery.py. I have tested with djcelery and as well as celery. I am using…
Sindhujit
  • 51
  • 9
0
votes
2 answers

django celery daemon does work: it can't create pid file

I can't init mi celeryd and celerybeat service, I used the same code on another enviroment (configuring everything from the start) but here don't work. I think this was by permissions but I could'nt run it. please help me. this is my celery conf on…
AsPolar
  • 1
  • 2