Questions tagged [celery-task]

celery-task is a building block of Celery distributed task queue system

celery-task is a building block of Celery distributed task queue system. Basically, it is a python class, but it can be created out of any callable by @celery.task decorator.

727 questions
0
votes
2 answers

How to run celery as daemon with normal celery command

I have a django app for which i am using celery tasks to perform some csv processing in background, and so i installed rabbitmq-server like sudo apt-get install rabbitmq-server, by this command the rabbitmq-server was installed and running…
Shiva Krishna Bavandla
  • 25,548
  • 75
  • 193
  • 313
0
votes
0 answers

Efficient recurring tasks in celery?

I have ~250,000 recurring tasks each day; about a fifth of which might be updated with different scheduled datetimes each day. Can this be done efficiently in Celery? - I am worried about this from celery's beat.py: def tick(self): …
A T
  • 13,008
  • 21
  • 97
  • 158
0
votes
0 answers

Celery Task Chaining/Worker Release

If I write a celery task that calls other celery tasks, can I release the parent task/worker without waiting for the downstream tasks to finish? The situation: I am working with an API that returns some data and the arguments for the next API call. …
bwarren2
  • 1,347
  • 1
  • 18
  • 36
0
votes
1 answer

Celery updates only one field

I want to create task to update ranking. settings.py djcelery.setup_loader() BROKER_URL = "amqp://guest:guest@localhost:5672//" CELERY_TIMEZONE = 'UTC' I use django worker python manage.py celery worker --loglevel=info The…
Bartosz Dabrowski
  • 1,850
  • 2
  • 15
  • 21
0
votes
1 answer

How to call a task at the end of the execution of each chunk in celery?

I'm trying to update some aggregate data at the completion of a chunk of tasks. It's basically the concept of a chord being implemented at the end of a chunk. How do I implement this?
manu
  • 1,072
  • 1
  • 14
  • 26
0
votes
1 answer

Number of celery tasks executed at a given point of time

I am trying to create a bunch of celery tasks asynchronously on the fly. Say there are 1000 tasks I start asynchronously and I have only one celeryd process running to execute tasks. How many threads will be created by celery to handle these…
0
votes
1 answer

result.ready() isn't work as expected in django celery?

I have a django celery view which do the certain task and after the task has been completed successfully write that in database. I am doing this: result = file.delay(password, source12, destination) And, if result.successful() is True: …
pynovice
  • 7,424
  • 25
  • 69
  • 109
0
votes
1 answer

Celery is sending 600K requests in less than two weeks

I received the monthly bill today for Amazon SQS and I was surprised to see 600.000 requests usage to my queue. All I am doing is running one single task every minute. How does this add up to 600.000…
Houman
  • 64,245
  • 87
  • 278
  • 460
0
votes
1 answer

Write cron task from Tuesday 12 pm to Wednesday 12 pm for Celery

I am trying to write a periodic cron task for celery which should execute every hour from Tuesday 12pm to Wednesday 12 pm. That is a 24 hour period but spans two different days. Is it possible to schedule this as a single task like…
aqs
  • 5,632
  • 3
  • 24
  • 24
0
votes
0 answers

Celery scheduled task executing immediately instead of delaying

I am trying to schedule a Celery task for execution using : mytask.apply_async(countdown=120)(mytask is a simple python method with @task decorator). However when I call that, the task is executed immediately instead of executing it after 2 minutes…
aqs
  • 5,632
  • 3
  • 24
  • 24
0
votes
1 answer

Celeryd does not execute my workers

I'm trying to daemonize my tasks in celery, i've tested without daemonizing and it's working very well. But i can't daemonize like the tutorial said (http://docs.celeryproject.org/en/latest/tutorials/daemonizing.html#daemonizing) I have my…
shinjidev
  • 383
  • 1
  • 6
  • 21
0
votes
1 answer

What can I do if celery forgets about tasks on a (apparently) random basis?

I have a flask app with sqlalchemy and a celery worker up and running. I use redis as my broker. Every time someone submits a new message in a conversation, a worker is started and is supposed to send notification mails to all people participating…
0
votes
1 answer

want to find when the job will be started in celery

i am new to celery. i have some configuration in celeryconfig.py as follow: from datetime import…
Rohitashv Singhal
  • 4,517
  • 13
  • 57
  • 105
0
votes
1 answer

TypeError occurring while using Celery 2.6.0rc5

I am using Celery 2.6.0rc5, and getting the following error: [2012-06-22 23:01:42,016: ERROR/MainProcess] Unrecoverable error: TypeError('handle_event() takes exactly 3 arguments (1 given)',) Traceback (most recent call last): File…
Brian M. Hunt
  • 81,008
  • 74
  • 230
  • 343
-1
votes
1 answer

Facing error in installing RabbitMQ on windows

I am trying to install RabbitMQ but it is giving error image of error please help me fix it. I'm using windows-10 64-bit I tried uninstalling and reinstalling RabbitMQ and Erlang/OTP but nothing seems to work. You can also suggest me any…
1 2 3
48
49