0

I want to monitor Kafka broker health with the help of Kafka Consumer JMX metrics. I am running a Kafka Consumer application which generates the JMX metrics. Is there any metrics which can tell us the Kafka broker health?

I know, we can monitor the broker health with the help of Broker metrics but I want to monitor with the help Consumer JMX metrics.

Please let me know if it is possible.

Thanks

Rishi
  • 1,279
  • 3
  • 20
  • 37
  • 1
    The consumer metrics essentially outlines the parameters for the Kafka Consumer and they give you a quantitative representation of some important internal parameters for the consumer only , there is no way to know about the Broker . – Soumen Mukherjee Apr 04 '19 at 11:29
  • yeah, @SoumenMukherjee, agree on that but there are some metrics which looks like that it can help me out i.e. type_consumer-node-metrics. I am trying to explore it more but not reached to a positive conclusion yet. Btw, Thanks for the reply. – Rishi Apr 04 '19 at 12:11
  • Not clear what you mean by "health". The consumer would only know a connection is made to the leader brokers, and status of authorization to its topics. It wouldn't know if a brokers disks were filling up, for example – OneCricketeer Apr 07 '19 at 20:44
  • @cricket_007 Here, health means whether the brokers are up or not. I just want to determine whether any of the broker is down. – Rishi Apr 11 '19 at 04:37
  • Any of them, or just those holding data of the topic you're reading from? – OneCricketeer Apr 11 '19 at 15:23
  • In my case, we have 3 brokers and the partitions are distributed across the brokers so ideally, all the brokers are holding the data. – Rishi Apr 16 '19 at 07:51

0 Answers0