Questions tagged [celery-task]

celery-task is a building block of Celery distributed task queue system

celery-task is a building block of Celery distributed task queue system. Basically, it is a python class, but it can be created out of any callable by @celery.task decorator.

727 questions
0
votes
1 answer

Django/Python: import error in celery taks.py

I am facing an import error inside celery task.py. The class StockManager method which is in another package is used to save the details. However i am getting and import error for StockManager(). How can i resolve this issue. Am i doing anything…
Anish
  • 872
  • 5
  • 21
  • 42
0
votes
1 answer

Mysterious unrelated task_id being returned for celery workflow.

I have a rather complex workflow (which is built dynamically) which looks something like this: workflow= chain( signature('workflow.tasks.start_workflow', kwargs= {}), chord( [ signature('workflow.tasks.group_task', kwargs= {}), …
richie
  • 1
  • 2
0
votes
0 answers

Celery tasks failing randomly

I have a Celery shared_task, which is getting called from my view when the user initiates a request on that view. Due to some weird reason, the tasks are not getting registered at random times. What am I missing? Is this behavior…
TeknasVaruas
  • 1,480
  • 3
  • 15
  • 28
0
votes
1 answer

How to make two tasks mutually exclusive in Celery?

Is there a way to disallow two different tasks to run simultaneously in Celery? I was thinking about defining a new queue with concurrency level=1, and send those tasks to that queue, but I couldn't find an example. Is that possible? Thanks!
Michael Spector
  • 36,723
  • 6
  • 60
  • 88
0
votes
1 answer

How to set auto_delete=False for all new queues in Celery?

How can one set the default value of auto_delete to False for all new created queues by Celery using AMQP? I use the default settings. So the default "celery" exchange is auto_delete = False. Adding a task like this result =…
Marius
  • 365
  • 4
  • 18
0
votes
1 answer

Django celery task execution

I have 3 tasks in tasks.py file when demon is working only one task execute . Rest of two display in debug mode but not execute. celery worker --concurrency=1 Is there any changes need ? Edit :…
user3752103
0
votes
0 answers

Running Class based methods as Celery Tasks

Am having problems running tasks when setup as class methods. I've read about celery.contrib.methods from the answer here on SO but am not able to apply it to my case. celery_conf.celeryapp.py from __future__ import absolute_import from celery…
lukik
  • 3,919
  • 6
  • 46
  • 89
0
votes
0 answers

DJANGO Celery on Application Server + Mail server

I am trying to configure DJANGO + Celery on Application server with separate mail server. Both servers has same files: app_name/settings.py BROKER_URL = "sqs://%s:%s@" % (AWS_ACCESS_KEY_ID,AWS_SECRET_ACCESS_KEY) CELERY_TIMEZONE =…
0
votes
1 answer

celery/redis task recieved multiple times rapidly.

I published two countdown task using django-celery, which must run at 2014-10-15 06:45 and 2014-10-15 08:45. here is the log when i run using --loglevel=INFO [2014-10-15 03:58:19,885: WARNING/MainProcess] celery@web468.webfaction.com ready. …
suhailvs
  • 20,182
  • 14
  • 100
  • 98
0
votes
1 answer

Django Celery email, celery is not working

i am working on django celery for sending the regsitration email ,but the celery is not working correct. my error is in celery [2014-09-10 19:11:44,349: WARNING/MainProcess] celery@Jeet-PC ready. [2014-09-10 19:13:38,586: INFO/MainProcess] Received…
Gurjeet Singh
  • 103
  • 2
  • 6
0
votes
1 answer

Celery task PENDING

I basically want to be able to create a chord consisting of a group of chains. Beyond the fact that I can't seem to make that work is the fact that all the sub-chains have to complete before the chord callback is fired. So my thought was to create…
0
votes
0 answers

How to ensure at any given instant, the task from any queue will be executing by only one celery worker

Suppose I have 3 queues and 3 celery workers. I want to ensure at any given instant of time, there will be only one task from any queue executing by any worker. can we do this. is there any locking mechanism or some kind of settings to do this ?
Sandeep
  • 53
  • 1
  • 7
0
votes
1 answer

I want to traverse a list using multiple workers in celery

I have a list: url_list=["abc.com","def.com","xyz.com"."pqr.com"...] - 100,000 entries I want to traverse this list using 100 celery workers to reduce the time it takes to do it. My question is: How do I provide this url_list to the workers, so…
mayankchutani
  • 273
  • 3
  • 14
0
votes
1 answer

Multiple Celery instances consuming a single queue

Is it possible to have multiple celery instances possible on different machines consuming from a single queue for tasks, working with django preferably using django-orm as the backend? How can i implement this if possible, I can't seem to find any…
Shaumux
  • 735
  • 11
  • 25
0
votes
1 answer

Form validation error in django using celery in background

I have a django app in which i have the below form class AddressForm(forms.Form): address = forms.CharField(required=False, widget=forms.TextInput(attrs={'size': 20})) city = forms.CharField(required=False, widget=forms.TextInput(attrs={'size':…
Shiva Krishna Bavandla
  • 25,548
  • 75
  • 193
  • 313