Stack Overflow
Stack Overflow

Questions tagged [confluent-kafka-python]

Confluent Kafka Python is a performant implemention of Kafka producers, consumers and the admin client in Python and it is based on librdkafka.

Confluent Kafka Python is a performant implemention of a Kafka client library based on librdkafka. You can use it to connect to Kafka brokers in Python.

219 questions
0
votes
0 answers

confluent-kafka python library is not working with ubutu14 and python3

I am using "confluent-kafka==1.0.1". It works fine when I am using py3 and ubuntu18, but fails with py3 and ubuntu14. I get the following error. Traceback (most recent call last): File…
Technical Shil
  • 181
  • 1
  • 10
0
votes
0 answers

Not able to produce and consume kafka message from my local machine to ubuntu VM

I am trying to produce kafka message from my local machine to Ubuntu vm. Telnet commad says successfully connected to host. PS C:\Users\harshal> Telnet harshal-VirtualBox 9092 Successfully connected to Host: "harshal-VirtualBox" on Port:…
HNM
  • 1
  • 3
0
votes
1 answer

Consume from kafka without infinite loop

I'm currently using the Confluent kafka python client to consume messages from a kafka topic and the code runs fine inside of a while True loop as shown in examples in the documentation. However I would like to set up a cron job that only consumes…
Tatiana Frank
  • 418
  • 5
  • 22
0
votes
1 answer

How to debug AvroConsumer in confluent kafka?

I'm trying to read Kafka from python but recieve message is None , No errors in CLI. I'm using port forwarding to destination host via putty, and than test ports over telnet - it work's fine. Moreover, i'm using kafkacat on Debian (WSL) and it…
shabelski89
  • 19
  • 6
0
votes
1 answer

confluent-kafka Python library consumer.poll(timeout) doesn't work as expected

when I set msg = consumer.poll(timeout=10.0) the consumer waits 10 seconds and return None as expected, but when I change this to msg = consumer.poll(timeout=3600.0) this consumer just return None immidiately instead of waiting 3600 seconds as…
JamesWang
  • 1,175
  • 3
  • 14
  • 32
0
votes
1 answer

Confluent Kafka Python Error: Metadata request failed

Getting below error. Not Sure whats wrong. %5|1591739081.630|REQTMOUT|rdkafka#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator/290: Timed out HeartbeatRequest in flight (after 10622ms, timeout #0) %4|1591739081.630|REQTMOUT|rdkafka#consumer-1|…
Hardik Patira
  • 3
  • 3
0
votes
1 answer

Confluent Python Avro Producer: The datum {'..'} is not an example of the schema

I'm unable to produce data for a specific schema and I'm unable to understand why. The Example data inlcuded as dictionary in the code was created directly from using the confluent "avro-random-generator", so the example data must be correct, since…
Mayak
  • 533
  • 1
  • 5
  • 17
-1
votes
1 answer

KafkaError{code=_UNKNOWN_TOPIC,val=-188,str="Unable to produce message: Local: Unknown topic"} error while using kafka producer in Python

I am using python script for kafka producer and getting the following error: cimpl.KafkaException: KafkaError{code=\_UNKNOWN_TOPIC,val=-188,str="Unable to produce message: Local: Unknown topic"} I am getting the following…
Deepanshu Kaushik
  • 7
  • 2
-3
votes
1 answer

Read data from incoming kafka message or database and put it into Email Template using python then publish Email template on kafka topic

email_template = """ Opportunity Summary {{ OpptyNumber }}
Client: {{ clientName }}
Opportunity Desc: {{ opptyDesc }}
Total TCV (USD): {{ TCV }}
Country: {{ country }}
Geo: {{ geo…
Karan Rathore
  • 1
  • 2
1 2 3
…
14
15