Questions tagged [kafka-burrow]
4 questions
0
votes
0 answers
Monitoring apache-Kafka lag using Prometheus. Kafka_exporter or linkedin Burrow
I am trying to monitor Kafka consumer group or topic lag. I want to fire an alert every time the lag of a topic doesn't reduce for 30 minutes or so and only keeps on increasing.
I have been trying to use kafka_exporter.
And have also tried Linkedin…
Utkarsh Kalra
- 3
- 1
0
votes
0 answers
Kafka: Using multiple consumers to reduce consumer lag doesn't work
hi I have a Kafka cluster using 3 Brokers (EC2 instances)
and there is a topic with 100 partitions.
I wanted to observe how much a messages per second
a certain number of consumers can handle.
So I've sent messages by [20, 100, 500, 1000, 5000,…
lee
- 1
0
votes
1 answer
reason for adding console consumer in deny list in burrow configuration
I recently started using burrow and for burrow configuration, I see below configuration for group-deny list at lots of places including AWS MSK documentation: https://docs.aws.amazon.com/msk/latest/developerguide/consumer-lag.html
But I cannot find…
Vikash Mishra
- 123
- 2
- 10
0
votes
0 answers
Kafka Lag Monitoring System
I've researched the Kafka monitoring systems and found out that there are two types of them.
First is consuming __consumer_offsets topic and Second is using kafka api.
It seems using kafka broker api is much more accurate, if cluster has many…
david
- 1
- 3