Questions tagged [kombu]

Kombu is an AMQP messaging framework for Python.

Kombu is an AMQP messaging framework for Python. Kombu provides a high-level API for messaging using the AMQP standard.

Allows application authors to support several message server solutions by using pluggable transports.

  • Supports multiple transports(Redis, Beanstalk, CouchDB, and MongoDB. SQLAlchemy and Django ORM)
  • Supports automatic encoding, serialization and compression of message payloads.
184 questions
1
vote
1 answer

How do I specify an AMQP correlationId with Kombu?

The documentation suggests extra AMQP properties are passed as keyword arguments to publish as according to the AMQP spec, but correlationId="foo" does not seem to have the desired effect.
Mispy
  • 879
  • 8
  • 21
1
vote
0 answers

Django celery, kombu transport, and multiple workers

The documentation for the Django ORM transport for Celery says that using more than a few workers can cause some tasks to be executed more than once. http://docs.celeryproject.org/en/latest/getting-started/brokers/django.html Can anyone quantify…
Krystian Cybulski
  • 10,789
  • 12
  • 67
  • 98
1
vote
3 answers

Django/Celery Quickstart example not working (worker is not executing any tasks)

I'm using Django/Celery Quickstart... or, how I learned to stop using cron and love celery, and it seems the jobs are getting queued, but never run. tasks.py: from celery.task.schedules import crontab from celery.decorators import periodic_task #…
dsm2005
  • 36
  • 1
  • 5
1
vote
1 answer

How do I use kombu with pika async?

I'm trying to use kombu to write a server that will process two messages at the same time. My transport is rabbitmq. I believe the answer is to use kombu with pika-async. However, there doesn't seem to be any documentation on how to do this. Help?
Jon Chu
  • 1,877
  • 2
  • 20
  • 19
1
vote
1 answer

Django-Celery 2.5.3 BROKER_URL Error 'No such transport: mysql'

i upgraded my celery from 2.4.X to celery-2.5.2, then modified the Broker_URL to be BROKER_TRANSPORT = "sqlalchemy" BROKER_URL = "sqla+mysql://root:root@localhost:3306/db" this config can be referred via the page of…
Yooi
  • 13
  • 3
0
votes
1 answer

Connect to Kafka using kombu got class NoBrokersAvailable(confluent_kafka.KafkaException):

I tried to connect to Kafka using kombu(v5.3.1) and started with a very simple test program but got the exception at the connect. I have the kafka and zookeeper up and running locally. I can also use the kafka-python to connect and send message.…
Csun
  • 3
  • 2
0
votes
1 answer

How to use Azure Service Bus as Broker and Result for Celery in Django?

I'm currently using Celery with Redis Cloud and it works fine. I want to move to Azure Service Bus, but i'm not finding any docs that describes how to do this. I've seen that celery will use Kombu instead native transport method like AMQP or Redis.…
0
votes
2 answers

I can’t attach a Rabbit MQ client to Locust user

I am trying to run a load test that injects messages to rabbit mq, but I can get locust user class to get the custom client I created loaded. Has someone managed to do this? import os from locust import HttpUser, task, TaskSet, run_single_user from…
0
votes
1 answer

Kombu - RabbitMQ - Pytest - [Errno 104] Connection reset by peer

I'm using Kombu to connect to RabbitMQ, and found myself in some strange behavior. I have a generic producer function (see below), that I use throughout our code base. This works very well in most cases, but some of our unit tests started failing…
Niels Uitterdijk
  • 713
  • 9
  • 27
0
votes
0 answers

AttributeError: 'EntryPoints' object has no attribute 'get'

I keep on getting the following error when testing a simple celery example. AttributeError: 'EntryPoints' object has no attribute 'get' using the following CLI command: celery -A ctest worker --loglevel=INFO The versions of the main modules I…
AAA
  • 1
  • 1
0
votes
1 answer

Celery - No matching distribution found after pip update

I am unable to install celery/kombu. When installing, I get the following error. ERROR: Could not find a version that satisfies the requirement kombu<6.0,>=5.2.3 (from celery) (from versions: none) ERROR: No matching distribution found for…
Sai Chander
  • 829
  • 1
  • 6
  • 15
0
votes
0 answers

Kombu producer pool error only comes on the next send attempt

I am trying to publish messages to rabbit using kombu's producer pool and by mistake I tried to publish to an in-existing exchange (I know I'm supposed to declare it first). What I see is, I only get the error on the next try. import time from…
Levi
  • 7,313
  • 2
  • 32
  • 44
0
votes
0 answers

Celery with Kombu Consumer does not display worker data in flower

I'm running a Celery using Kombu Consumer, reading messages from a rabbitmq. After I finished coding and ran it well, except for having messages get lost and the consumer doesn't read them. For example, if I send 5 messages to the queue, Kombu…
0
votes
0 answers

ConnectionResetError kombu

we have a producer consumer model on RMQ and from past time I have started getting this error File "newrelic/api/background_task.py", line 117, in wrapper return wrapped(*args, **kwargs) File "crs_consumer.py", line 49, in process_message …
Anup Jain
  • 23
  • 3
0
votes
0 answers

How to unit-test a Kombu (AMQP) exception using pytest on Python

I'm writing some unit tests for a RabbitMQ service I've developed and I'm trying to catch an AMQP exception when the exchange doesn't exist. The method prototype for the RabbitMQ class I've written is publish_message_str(self, exchange_name: str,…
Mario
  • 19
  • 6