Stack Overflow
Stack Overflow

Questions tagged [celery-task]

celery-task is a building block of Celery distributed task queue system

celery-task is a building block of Celery distributed task queue system. Basically, it is a python class, but it can be created out of any callable by @celery.task decorator.

727 questions
3
votes
1 answer

celery daemon production local config file without django

I am newbie to Celery. I create a project as per instruction provided by the celery4.1 docs.Below is my project folder and files: mycelery | test_celery | celery_app.py …
Manish Yadav
  • 435
  • 2
  • 8
  • 24
3
votes
2 answers

Celery worker not reconnecting on network change/IP Change

I deployed celery for some tasks that need to be performed at my workplace. These tasks are huge and I bought a few high-spec machines for performing these. Before I detail my issue, let me brief about what all I've deployed: RabbitMQ broker on a…
Sarthak Sawhney
  • 432
  • 4
  • 14
3
votes
2 answers

Query task state - Celery & redis

Okay so I have a relatively simple problem I think, and it's like I'm hitting a brick wall with it. I have a flask app, and a webpage that allows you to run a number of scripts on the server side using celery & redis(broker). All I want to do, is…
gdxn96
  • 369
  • 5
  • 16
3
votes
2 answers

Celery send mail for every failed task

I am using celery in my django application and I have set-up celery flower to monitor the tasks of celery. I have setup tasks where emails are send to the user when they register/submit/FP etc events. Now Flower gives me a nice details of the task…
Akshay Shah
  • 490
  • 1
  • 9
  • 25
3
votes
0 answers

Django celery PeriodicTask task under the class?

I want to use some function to be timing task My views.py: class SomeHandler: def __init__(self, user, instance): self.user = user self.instance = instance @task(filter=task_method) def send_some_msg(self, send_type): …
MrFrank
  • 263
  • 1
  • 2
  • 6
3
votes
1 answer

Django celery: scheduling recurring task but with fixed start date

At the moment djcelery allows me to schedule a recurring task via the PeriodicTask model. For example a task that runs on an interval like every minute, or an interval specified by a crontab like every 1st of the month at noon. What I'd really like…
fpghost
  • 2,834
  • 4
  • 32
  • 61
3
votes
2 answers

Celery worker details

I have celery task with 100 input data in queue and need to execute using 5 workers. How can I get which worker is executing which input? Each worker executed how many inputs and its status? If any task is failed how can get failed input data in…
sathish
  • 149
  • 9
3
votes
2 answers

How to run a task with celery in django and save result in django database?

I have made a scraper to scrape some links from web page and want to run this scraper every 1 hours which resides in django app, but django it is impossible to run a scraper every 1 hours because the django views depends on the request response…
shining
  • 1,049
  • 16
  • 31
3
votes
2 answers

Transcode video using celery and ffmpeg in django

I would like to transcode user uploaded videos using celery. I think first I should upload the video, and spawn a celery task for transcoding. Maybe something like this in the tasks.py: subprocess.call('ffmpeg -i path/.../original…
Robin
  • 5,366
  • 17
  • 57
  • 87
3
votes
1 answer

Celery transfer command line arguments to Task

I am struggling with transfering additional command line arguments to celery task. I can set the desired attribute in bootstep however the same attribute is emtpy when accessed directly from task (I guess it gets overriden) class…
realshadow
  • 2,599
  • 1
  • 20
  • 38
3
votes
1 answer

Celery workers not filling concurrency slots

I have one worker with a concurrency of 4. I see 4 processes started in flower and everything looks good. If I do this in a shell then I see the 4 workers take the tasks and the rest are reserved and it processes 4 at a time until the queue is…
Mingle
  • 846
  • 6
  • 13
3
votes
1 answer

Celery Chunks Do Not Execute the Task

celery_tasks.py from celery import Celery app = Celery('tasks') app.config_from_object('celeryconfig') @app.task(default_retry_delay=300, max_retries=5, acks_late=True) def my_task_A(x, y): return x + y if __name__ == '__main__': …
DmitrySemenov
  • 9,204
  • 15
  • 76
  • 121
3
votes
1 answer

Rollback support in Celery

I am planning to use celery as the task management component of my project. It has almost all the features that I need for my project. I will have a set of tasks which can execute independently or in the specified sequence. In the sequential tasks,…
AKG
  • 598
  • 6
  • 18
3
votes
0 answers

Celery task complete django notification

I'm starting with celery for a module in django which will import large csvs. The user will give the file and the some other fields and the csv will be checked and then sent to celery. Now what should i do for the notification? I want the user to be…
Shaumux
  • 735
  • 11
  • 25
3
votes
1 answer

How to load objects in memory and share across different executions of Celery worker?

I have setup celery + rabbitmq for on a 3 cluster machine. I have also created a task which generates a regular expression based on data from the file and uses the information to parse text. However, I would like that the process of reading the file…
Amit Gupta
  • 451
  • 5
  • 18
1 2 3
…
48 49