Stack Overflow
Stack Overflow

Questions tagged [kombu]

Kombu is an AMQP messaging framework for Python.

Kombu is an AMQP messaging framework for Python. Kombu provides a high-level API for messaging using the AMQP standard.

Allows application authors to support several message server solutions by using pluggable transports.

  • Supports multiple transports(Redis, Beanstalk, CouchDB, and MongoDB. SQLAlchemy and Django ORM)
  • Supports automatic encoding, serialization and compression of message payloads.
184 questions
7
votes
1 answer

RabbitMQ heartbeat vs connection drain events timeout

I have a rabbitmq server and a amqp consumer (python) using kombu. I have installed my app in a system that has a firewall that closes idle connections after 1 hour. This is my amqp_consumer.py: try: # connections with…
Mr T.
  • 4,278
  • 9
  • 44
  • 61
6
votes
3 answers

AttributeError running Django site on Mac 11.0.1

I'm getting an error running a django site locally that was working fine before I updated my Mac OS to 11.0.1. I'm thinking this update is the cause of the problem since nothing else was really changed between when it was working and now. 10:15:05…
Alexander
  • 63
  • 1
  • 4
6
votes
3 answers

'Queueing' tutorials and documentation?

I'm looking for articles and references that give an overview of 'queueing' (I'm probably not even using the right term here). I'm hoping for an introductory styled guide through a world of Redis, RabbitMQ, Celery, Kombu, and whatever other…
Trindaz
  • 17,029
  • 21
  • 82
  • 111
6
votes
1 answer

Celery: it ignores the exchange name when sending a task

I have a very simple code: celery = Celery(broker="amqp://guest:guest@172.17.0.1:5672/") …
allan.simon
  • 3,886
  • 6
  • 35
  • 60
6
votes
1 answer

Mock a connection class in pytest

I have a class which inherits from kombu.ConsumerProducerMixin which I would like to test without an actual rabbitmq service running. class Aggregator(ConsumerProducerMixin): def __init__(self, broker_url): exchange_name = 'chargers' …
oz123
  • 27,559
  • 27
  • 125
  • 187
6
votes
2 answers

Python: Kombu+RabbitMQ Deadlock - queues are either blocked or blocking

The problem I have a RabbitMQ Server that serves as a queue hub for one of my systems. In the last week or so, its producers come to a complete halt every few hours. What have I tried Brute force Stopping the consumers releases the lock for a few…
Adam Matan
  • 128,757
  • 147
  • 397
  • 562
6
votes
0 answers

Why does a basic Celery application, doing nothing, require 8 open Redis connections?

Trying to more fully understand how Celery/Kombu and Redis interact under the hood to better project scaling and cost of equipment (particularly in dev environments where I'd like the smallest Redis setup possible and thus the fewest…
10cool
  • 131
  • 1
  • 7
6
votes
1 answer

What's the best way to retry publishing messages with kombu?

I'm testing how kombu works. I'm planning to replace pika in several projects. I see that kombu has a lot of documentation but using what I found in the documentation some messages are lost. Here it's the code: from kombu import Connection,…
Félix
  • 579
  • 4
  • 21
6
votes
2 answers

Kombu in non-blocking way

I am looking for a way to use kombu as MQ adapter between tornado-sockjs and Django application server. I did something like: class BrokerClient(ConsumerMixin): clients = [] def __init__(self): self.connection =…
Dmitry Demidenko
  • 3,427
  • 1
  • 22
  • 22
5
votes
2 answers

Heroku Django Celery: NameError: name 'DATABASES' is not defined

I am following along this tutorial to get celery and django running on heroku. However, I get this error in my logs when I put in the specified code for the worker: 2011-12-22T05:31:56+00:00 heroku[web.1]: Starting process with command `python…
saul.shanabrook
  • 3,068
  • 3
  • 31
  • 49
5
votes
1 answer

Celery task does not get send to broker

When I try to send my task to broker (RabbitMQ) it hangs. # python shell promise = foo.s(first_arg="2").apply_async() # blocking indefinitely. I expected a promise object. If I run the task synchronously it works as expected. # python shell promise…
Anders_K
  • 982
  • 9
  • 28
5
votes
0 answers

What is the difference between Celery and Kombu

I know that is a hard question, and we have a similar question here differentiate-celery-kombu-pyamqp-and-rabbitmq-ironmq But I'm still confused about the difference between each other Celery is a distributed message queue and they cover the…
Daniel Santos
  • 116
  • 5
5
votes
1 answer

Celery RabbitMQ broker failover connect issue

I have 3 RabbitMQ nodes in cluster in HA mode. Each node is on separate Docker container. I am using Celery version 4 and kombu version 4. I have used this command to set HA policy: rabbitmqctl set_policy ha-all ""…
draskomikic
  • 167
  • 2
  • 9
5
votes
3 answers

Getting ImportError: cannot import name OrderedDict

I am getting the error ImportError: cannot import name OrderedDict while installing a server locally on my ubuntu 14.04 machine.I have tried installing ordereddict manually and also tried upgrading kombu but it is still giving the error.The full…
Bing
  • 631
  • 1
  • 8
  • 23
5
votes
1 answer

Kombu+RabbitMQ: Check whether a queue is empty

Architecture Consider a system with DB records. Each record can be in a live or expired status; live records should be processed periodically using an external software module. I have solved this using a classic producer - consumer architecture…
Adam Matan
  • 128,757
  • 147
  • 397
  • 562
1
2
3
…
12 13