How to improve kafka consumer performance PHP/RDKafka

Asked Sep 04 '19 at 11:37

Active Oct 18 '19 at 20:28

Viewed 779 times

I'm consuming messages from kafka using php rdkafka and high-level consuming approach as it is described here https://arnaud.le-blanc.net/php-rdkafka/phpdoc/rdkafka.examples-high-level-consumer.html

The issue I have is that I have to wait for message approx around 3s to be read by consumer, topic has 20 partitions and there are 10 consumers in same group, even if there is only 1 consumer it is taking 3s to read message from kafka

asked Sep 04 '19 at 11:37

Kamil

Increase consumers to number of partitions. – Ashish Bhosle Sep 05 '19 at 11:24
I did, but time for 1 consumer to get message is 3s thats quite long – Kamil Sep 09 '19 at 10:41
Did you use kafka terminal command:kafka-console-consumer? What's your Kafka server settings? – Amy.hl Oct 18 '19 at 20:28
I did not, I'm using PHP RdKafka library, configuration is basic. Running it in dev mode in docker. – Kamil Oct 22 '19 at 09:40

How to improve kafka consumer performance PHP/RDKafka

0 Answers0