Questions tagged [kombu]

Kombu is an AMQP messaging framework for Python.

Kombu is an AMQP messaging framework for Python. Kombu provides a high-level API for messaging using the AMQP standard.

Allows application authors to support several message server solutions by using pluggable transports.

  • Supports multiple transports(Redis, Beanstalk, CouchDB, and MongoDB. SQLAlchemy and Django ORM)
  • Supports automatic encoding, serialization and compression of message payloads.
184 questions
1
vote
1 answer

How to properly use the in-memory transport for unit tests

I'm trying to write some tests where I produce a message to a queue and see if the message gets correctly consumed and handled in the application. For that I'm playing around with the kombu library and especially the in-memory Transport…
c4pone
  • 777
  • 7
  • 17
1
vote
1 answer

kombu not reconnecting to RabbitMQ

I have two servers, call them A and B. B runs RabbitMQ, while A connects to RabbitMQ via Kombu. If I restart RabbitMQ on B, the kombu connection breaks, and the messages are no longer delivered. I then have to reset the process on A to re-establish…
vgoklani
  • 10,685
  • 16
  • 63
  • 101
1
vote
1 answer

Python Kombu consumer get queue message but the callback can't trigger

If I run followed code, I found I can get message from the queue, but the callback can't triggered from kombu.mixins import ConsumerMixin from kombu import Exchange, Queue task_exchange = Exchange('nginx', type='direct') task_queues =…
c1ay
  • 21
  • 3
1
vote
1 answer

consume queue from multiple vhosts with kombu

I have the following situation. I have a list of vhosts. In each vhost i have a queue (same name in all vhosts). Is there a way to simultaneously consume the queues? (i don't want to create a separate process for each vhost) I want to have a single…
Mr T.
  • 4,278
  • 9
  • 44
  • 61
1
vote
0 answers

kombu/librabbitmq: ConnectionError: Couldn't revive channel

I am using the producers pool group to publish a message to rabbitmq, but the publish call is failing with the following error: . File "pubsub.py", line 314, in _publish producer.publish(message, exchange=exchange, routing_key=topic) …
vrtx54234
  • 2,196
  • 3
  • 30
  • 53
1
vote
1 answer

Can I get RabbitMq connection id from my Python/kombu client?

When I run this command: rabbitmqctl list_connections pid I get output like the following: Is there a way to read this pid from my kombu client?
AlexC
  • 3,343
  • 6
  • 29
  • 38
1
vote
0 answers

How do I use a kombu Consumer together with sockjs-cyclone?

I have various applications pushing messages into RabbitMQ and I want my sockjs-cyclone server to consume those messages and push them out to websocket clients. I'd like to use kombu as my RabbitMQ consumer library, but I can't figure out where to…
CJ Gaconnet
  • 1,421
  • 1
  • 12
  • 18
1
vote
0 answers

Want to make a consumer, not sure if kombu is enough or I need to also implement Celery

I'm in the process of making a consumer for rabbtMQ. I'm using python and after research i decided to use Kombu. With Kombu I already connected to a queue in rabbit and read the messages. The code is queue = Queue('someQueue') def process(body,…
Gerardo
  • 13
  • 2
1
vote
1 answer

kombu producer and celery consumer

Is it possible for a kombu producer to queue a message on rabbitmq to be processed by celery workers? It seems the celery workers do not understand the message put by the kombu producer.
Azmi Kamis
  • 891
  • 5
  • 20
1
vote
0 answers

Rabbitmq reaching file descriptor limit causes clients to hang indefinitely

After experiencing an issue where my rabbitmq server reached its file descriptor limit and ceased to accept any new connections, I noticed that my clients consuming from queues behaved in a very undesirable way. When trying to open their connections…
Acorn
  • 49,061
  • 27
  • 133
  • 172
1
vote
1 answer

No module named 'Queue' when I try to start celery

I recently upgraded to Python 3.3.5. I've pretty much got everything working correctly at this point but celery/kombu seem to be pretty unhappy. It appears there may be a bug in kombu, but I'm unsure. I'm hopeful it's something I'm missing. Any help…
Josh
  • 12,896
  • 4
  • 48
  • 49
1
vote
1 answer

Kombu Consumer as Thrift Service

I need to build a Kombu consumer which can be controlled programatically. All the examples I've seen are just trivial ones that tell you to use ctrl-c to stop the program. My main application is running as a Twisted Thrift service and I'm thinking…
Przemek Lach
  • 1,348
  • 2
  • 19
  • 42
1
vote
2 answers

Python Kombu - blocking

I'm using kombu to manage RabbitMQ, via a producer/consumer model. I launched my producer, which placed 100 jobs on a queue (I have only one queue, and one exchange). I would like to launch multiple consumers, simultaneously, and have each consumer…
vgoklani
  • 10,685
  • 16
  • 63
  • 101
1
vote
0 answers

Django Celery throwing runtime warnings for naive times

I run an online game with Django 1.6 and Celery 3.1.11. Kombu is 3.0.15. Recently I had problems with Celery and DST, so I decided to run the whole site on UTC and save myself the bother of worrying about timezones. The relevant parts of my…
heidi
  • 655
  • 6
  • 20
1
vote
1 answer

Setting up a load balancer for HA rabbitmq

I am trying to set up a high availability RabbitMQ cluster with mirrored queues. Actually, I have set that up and that was the easy part. Now comes the part where my producers and consumers need to access the cluster, or specifically, the master…
pbhowmick
  • 1,093
  • 11
  • 26