Stack Overflow
Stack Overflow

Questions tagged [kombu]

Kombu is an AMQP messaging framework for Python.

Kombu is an AMQP messaging framework for Python. Kombu provides a high-level API for messaging using the AMQP standard.

Allows application authors to support several message server solutions by using pluggable transports.

  • Supports multiple transports(Redis, Beanstalk, CouchDB, and MongoDB. SQLAlchemy and Django ORM)
  • Supports automatic encoding, serialization and compression of message payloads.
184 questions
5
votes
0 answers

Asynchronous messaging with AMQP, Kombu, and gevent

I am trying to crate asynchronous kombu consumer using gevents in python. I watched this video https://www.youtube.com/watch?v=nGiBdcIQiMQ which should be it, but it is not complete, those guys did not show what they promised on the beginning. I…
Marko Trajkov
  • 101
  • 1
  • 5
5
votes
1 answer

Django and Celery: Tasks not imported

I am using Django with Celery to run two tasks in the background related to contacts/email parsing. Structure is: project /api /core tasks.py settings.py settings.py file contains: BROKER_URL = 'django://' BROKER_BACKEND =…
user1034697
4
votes
1 answer

Revoke Celery task with SQS

I am using Celery + Kombu with Amazon SQL. The goal is to be able to a remove a task already scheduled for some specific datetime. I've tried from celery.task.control import revoke revoke(task_id) but that didn't change anything. Is revoke not…
AlexA
  • 4,028
  • 8
  • 51
  • 84
4
votes
0 answers

Potential Nameko concurrency issues with pyscopg2 driver for Postgresql

We are building a Python microservices application with Posgresql as service datastore. At first glance Nameko seems a good starting point. However the Nameko documentation section on Concurrency includes this statement: Nameko is built on top of…
Ricibob
  • 7,505
  • 5
  • 46
  • 65
4
votes
0 answers

Celery: Interact/Communicate with a running task

A related (albeit not identical) question appears here: Interact with celery ongoing task It's easy to start a task and get its unique ID: async_result = my_task.delay() task_id = async_result.task_id It's easy to broadcast a message that will…
Bernd Wechner
  • 1,854
  • 1
  • 15
  • 32
4
votes
1 answer

Cannot route message for exchange 'reply.celery.pidbox': Table empty or key no longer exists

I'm trying to spawn a few background, celery beat processes using docker-compose, but they are not working anymore. My configuration: docker-compose-dev.yml worker-periodic: image: dev3_web restart: always volumes: -…
8-Bit Borges
  • 9,643
  • 29
  • 101
  • 198
4
votes
2 answers

Unicode Decode Error in Celery Trying to Read Results from Redis Queue

Trying to run a few simple tasks via celery. The header of the workerfile looks like from celery import Celery, group from time import sleep celery = Celery('workerprocess', broker='redis://localhost:6379/0',…
Della
  • 1,264
  • 2
  • 15
  • 32
4
votes
0 answers

How to use gevent with Kombu

I am writing a basic publish-subscribe script in python using kombu and rabbitmq along with gevent. How can we switch context to the publisher when the consumer is waiting on the queue until a message arrives? I tried using gevent.sleep() but its…
kartikkillawala
  • 146
  • 6
4
votes
0 answers

Celery worker variable sharing & initialization in bootstep

I have a question regarding process shared variables in python 3.4 and celery 4.0.2. I already read a post (Celery worker variable sharing issues) where the goal of the poster was to not share the variable. I currently have the exact opposite of…
Katrin
  • 41
  • 2
4
votes
0 answers

How to handle multiple consumer connections using Kombu?

I'm trying to connect to multiple RabbitMQ hosts using Kombu, however, unlike other examples that I've found, the goal is not to use multiple hosts as a fallback, I just want to be able to deal with the connections on the same thread. I came across…
Gonçalo Cabrita
  • 353
  • 1
  • 5
  • 11
4
votes
2 answers

Using Kombu ConsumerMixin, how to declare multiple bindings?

I have a RabbitMQ topic exchange named experiment. I'm building a consumer where I'd like to receive all messages whose routing key begins with "foo" and all messages whose routing key begins with "bar". According to the RabbitMQ docs, and based on…
smitelli
  • 6,835
  • 3
  • 31
  • 53
4
votes
2 answers

Celery: socket.error timed out

I'm using: celery==3.1.12 kombu==3.0.19 amqp==1.4.5 Celery worker was started: celery worker --without-gossip --without-heartbeat --without-mingle Celery setiings: CELERY_ALWAYS_EAGER = False CELERY_EAGER_PROPAGATES_EXCEPTIONS = True BROKER_URL =…
Begun-A
  • 41
  • 1
  • 4
4
votes
2 answers

Can Kombu do publish and sucscribe to multiple consumers

Using Kombu with RabbitMQ to implement a classic publish/subscribe design pattern. I have created a producer that creates a topic: from kombu import Connection, Exchange, Queue media_exchange = Exchange('media', 'topic', durable=False) video_queue…
user3376274
  • 41
  • 1
  • 3
4
votes
0 answers

Rabbitmq kombu consumer queue losing binding to Exchange after some time

I have a strange problem with my Kombu created queues. After some time they just stop getting messages. no error, but the messages aren't received any more. When I unbind the queue (from the rabbitmq web interface) and rebind it to the same exchange…
alonisser
  • 11,542
  • 21
  • 85
  • 139
3
votes
1 answer

Celery slowing down django

I have a django 1.3 site using SQLite. It works well. I recently install django-celery along with django-kombu. I am using supervisord to launch the celery dameon with the command: python manage.py celeryd -v 2 -B -s celery -E Everything works,…
Chuck
  • 1,089
  • 1
  • 13
  • 18
1 2
3
…
12 13