Questions tagged [kombu]

Kombu is an AMQP messaging framework for Python.

Kombu is an AMQP messaging framework for Python. Kombu provides a high-level API for messaging using the AMQP standard.

Allows application authors to support several message server solutions by using pluggable transports.

  • Supports multiple transports(Redis, Beanstalk, CouchDB, and MongoDB. SQLAlchemy and Django ORM)
  • Supports automatic encoding, serialization and compression of message payloads.
184 questions
0
votes
0 answers

celery+kombu not giving a useful traceback - how to expand it?

I'm working on porting some Python 2.7 code to 3.10 (I know, it's late). The server-side code uses: celery==5.2.3 kombu==5.2.4 ...though the client side is on something much older: celery==3.1.26.post2 kombu==3.0.37 It appears that the server-side…
dstromberg
  • 6,954
  • 1
  • 26
  • 27
0
votes
1 answer

Restarting Heroku Dynos gives Redis SSL connection error for 5 minutes until resolving itself

I started hosting a Redis/Celery/Python(Dash) app on Heroku about 1 month ago. In this time it was working flawlessly, however in my latest update, my datastore credentials changed and somehow a new bug was introduced. It happens every time I…
nasdas asdas
  • 65
  • 1
  • 7
0
votes
0 answers

ImportError: cannot import name 'Connection' from 'kombu'

I've installed kombu. but I get the error defined in the title. my task is to send a message to a rabbitmq queue, amqp 1.0 below is the code from kombu import Connection with Connection('amqp url') as conn: tasks_queue = …
Bharath Pabba
  • 1,725
  • 5
  • 16
  • 24
0
votes
1 answer

What's the difference between the durable and delivery_mode for an exchange?

I'm working on the configuration for some RabbitMQ queues and exchanges configured via Celery and Kombu. The exchange object provided by Kombu can accept two specific options that overlap in the way I understand them: durable delivery_mode What…
Taebow
  • 124
  • 11
0
votes
1 answer

Unable to import Actor from cell.actors

from cell.actors import Actor The above import produces an unresolved error in major IDEs like Pycharm. Tried looking everywhere in the documentation of Celery/cell. The exact problem when ran in terminal looks as follows: ImportError: cannot…
Sai_Vyas
  • 91
  • 1
  • 6
0
votes
1 answer

Avoid Celery retries for unregistered task

We have a Django app with celery to handle an asynchronous tasks. We use AWS SQS as the task broker. We ended up with a bad task to be processed (removed the task implementation without removing the celery-beat entry). This resulted in…
CoatedMoose
  • 3,624
  • 1
  • 20
  • 36
0
votes
1 answer

Configuring Celery + AWS SQS to revoke tasks

I am running Celery+Kombu 4.4.6 on AWS SQS and want to revoke and terminate tasks. Reading through documentation and SO posts, the transport needs to allow broadcast messages. SQS does not do broadcast messages and Celery+Kombu needs to use SimpleDB…
David R.
  • 855
  • 8
  • 17
0
votes
1 answer

How to pass function as an argument to a celery task?

I want to pass a function as a parameter to a celery task. I found two similar questions in stackoverflow (1 and 2). I tried the solutions mentioned in the answers, and this is what I'm currently doing: Inside caller module: import marshal def…
Harris Irfan
  • 208
  • 1
  • 7
0
votes
1 answer

ConcurrentObjectUseError in gevent when using kombu

I'm using kombu in my code, and sometimes I get the following exception from kombu's producer's publish method. I think it is reproduced more in stress conditions, so probably a multithreading issue, and the exception description seems to point that…
Eran Zimmerman Gonen
  • 4,375
  • 1
  • 19
  • 31
0
votes
1 answer

streaming views with django and kombu

i have two queues in kombu; one to submit requests (to do something) and another that spits out via pub/sub the incremental status of said request. therefore in my process it will publish to the request queue and consume on the response queue. as…
yee379
  • 6,498
  • 10
  • 56
  • 101
0
votes
1 answer

amqp exchange types

I'm getting into the whole amqp thing and i have a question regarding which type of exchange type to use under the following scenario's: 1) i have the need to create a worker pool where each worker does something when they receive a message. now i…
yee379
  • 6,498
  • 10
  • 56
  • 101
0
votes
0 answers

Airflow Worker - KeyError: u'No such transport: ampq

I am new to airflow and trying to setup airflow cluster. The issue is when I try starting airflow worker I get error KeyError: u'No such transport: ampq. Did you mean amqp?'. Versions: apache-airflow==1.10.6 celery==4.0.2 kombu==4.0.2 My…
user2060673
  • 459
  • 1
  • 4
  • 8
0
votes
1 answer

Create Queue dynamically with different exchange types

I'm trying to write a method that creates new queues with arguments of an existing exchange name, new queue name and routing key. The exchange might be in different types (direct, fanout, topic). Is there a way to make and bind the queue without…
Payam
  • 1,068
  • 12
  • 15
0
votes
1 answer

How to subscribe a celery task to an existing RabbitMQ exchange?

I'm currently writing a chat messenger using GRPC/RabbitMQ for group chats. I have an API in Django/DRF that handles authentication/message logs/text and email alerts etc. To do this I would like to create a celery task that subscribes to each group…
Dash Winterson
  • 1,197
  • 8
  • 19
0
votes
1 answer

Conflicting versions of celery and kombu while installing airflow

I am installing airflow version 1.9.0 and getting the following error Traceback (most recent call last): .... bcpmrstbssapp1 airflow: from kombu.entity import Exchange, Queue airflow: File "/opt/xxx/lib/airflow/kombu/entity.py", line 9, in…
dimitris lepipas
  • 263
  • 3
  • 15