Stack Overflow
Stack Overflow

Questions tagged [kombu]

Kombu is an AMQP messaging framework for Python.

Kombu is an AMQP messaging framework for Python. Kombu provides a high-level API for messaging using the AMQP standard.

Allows application authors to support several message server solutions by using pluggable transports.

  • Supports multiple transports(Redis, Beanstalk, CouchDB, and MongoDB. SQLAlchemy and Django ORM)
  • Supports automatic encoding, serialization and compression of message payloads.
184 questions
1
vote
1 answer

Django + Celery "cannot serialize '_io.BufferedReader' object"

While trying to pass a file off to a Celery task, I am sometimes getting the exception "cannot serialize '_io.BufferedReader' object". This seems to be happening with some files and not others. The endpoint is an APIView with the following to launch…
Stuart Buckingham
  • 1,574
  • 16
  • 25
1
vote
0 answers

Celery: communicating between tasks (and clients) with kombu

This is frustrating me some and costing me a great deal of time in research, and reverse engineering for lack of Celery docs on internals. There is a beautiful, tutorial here: https://ask.github.io/celery/tutorials/clickcounter.html that does just…
Bernd Wechner
  • 1,854
  • 1
  • 15
  • 32
1
vote
0 answers

Can not receive message from queues when the Exchange object's type is "direct"

When I change the "direct" type to "fanout" or "topic", it is work.But the "direct" type is not work. I wrote according to the example of the official website. And I tried deleting the code => "from future import absolute_import,…
Zoe
  • 130
  • 1
  • 9
1
vote
1 answer

Multi-threaded Kombu RPC application with single connection and multiple channels

I have an RPC application that has a single connection and multiple channels per thread. Currently, the program works as intended if its used in just a single thread. However, when adding more than one thread an array of unexpected issues occur,…
George Baca
  • 179
  • 1
  • 3
  • 14
1
vote
2 answers

Get RecursionError / KeyError trying to add Periodic Task in Celery beat

I try to setup some periodic tasks with Celery beat on Django. I'm using next setup: python3.6 django==1.11.10 celery==4.2.1 kombu==4.2.1 My schedule worker runs in Docker container via docker-compose and starts with next command: celery -A proj…
scherbakovx
  • 21
  • 1
  • 7
1
vote
0 answers

How to make a database connection(psycopg2) to any consumer in kombu?

I want to create three Kombu consumers, and every consumer has a connection to the database, and each connection is independent of the rest. I want to replace the sentence "connection database of worker" in the task function, the connection of the…
rmaleki
  • 581
  • 1
  • 9
  • 31
1
vote
1 answer

Kombu disconnects on publish

I'm having trouble publishing messages using kombu 4.1. My use case is that I have a server that collects messages from a rabbitmq queue (queue 1), performs some processing task and then republishes them to a different queue, (queue 2). I have no…
emptyMug
  • 142
  • 1
  • 1
  • 7
1
vote
0 answers

Celery with http as a transport layer

I want to use Celery as a task management framework, however my communication channel between the worker and the rabbitMQ broker must be over HTTP due network constraints. I know that RabbitMQ has a HTTP interface which is good enough for low rate…
Guy Ephraim
  • 3,482
  • 3
  • 26
  • 30
1
vote
0 answers

Celery application with no serialization at all

My Django app doesn't need any serialization at all. The data transfered between app and the worker consists purely of ascii strings. Of course default serialization works and json keep them untouched, but I would like to turn it off completely.…
Pommy
  • 381
  • 2
  • 10
1
vote
1 answer

Asynchronous AMQP producer and consumer

I have a bidirectional AMQP service that both consumes messages from a queue and publishes to a fanout exchange. Clients, symmetrically, consume from the exchange and publish to the queue. (This isn't a chat server, but it can be easily thought of…
Rob Napier
  • 286,113
  • 34
  • 456
  • 610
1
vote
0 answers

Celery - Read unstructured message from queue

I'm writing a Django application and I want to read messages from rabbitMQ and apply some changes into my database. My problem is the producer in not using celery and I get an error from celery because the message is invalid. The error…
Bardia Heydari
  • 777
  • 9
  • 24
1
vote
0 answers

python supervisord escape hash (#)

Got a python app using celery configured with a redis backend and am using supervisor to start the services. Issue is, my Redis password has got a hash # character in it and as such am getting an error as below Traceback (most recent call…
lukik
  • 3,919
  • 6
  • 46
  • 89
1
vote
2 answers

Django import error 'no module named django'

When I try to start my django app on openshift I get the following message. Hence deploying fails... File "wsgi/djangoProjectNew/manage.py", line 11, in execute_from_command_line(sys.argv) File…
user3620060
  • 131
  • 1
  • 14
1
vote
1 answer

Kombu - TypeError: Struct() argument 1 must be string, not unicode

I have been using Kombu for sometime now - and today when I readied a new machine for deployment, I am getting TypeError on import from kombu: >>> import kombu >>> from kombu import Connection, Exchange, Queue, Producer Traceback (most recent call…
Nabeel Ahmed
  • 18,328
  • 4
  • 58
  • 63
1
vote
0 answers

Utilizing Celery/Kombu to process simple JSON messages in Django

In the past I have used Celery async python and Django applications where both the sender and receiver understand the task that is being sent to RabbitMQ for processing via Celery (could be same app in cluster, etc). I have a use case right now…
bryan
  • 1,031
  • 2
  • 17
  • 36
1 2 3
…
12 13