Is there any way to recognize the last kafka message of every partition in multi partition topic and multiple consumers apart from lag?

Question

Is there any way to recognize the last kafka message of every partition in multi-partitioned topic and multiple consumers apart from lag?

I know one way to identify the last message which is through AdminClient API/ kafka consumer API. But need to use different method.

Why do you need different method? What are you requirements? — Gaël J, Nov 26 '22 at 14:17
Everything you can do from the CLI you can do it from code with Kafka Java API or even some other libraries. — Gaël J, Nov 29 '22 at 19:30
Can you please tell some libraries? I need to integrate in scala project. — Sakshi K, Dec 01 '22 at 06:38

score 0 · Answer 1 · answered Nov 26 '22 at 15:52

The only ways are to query the end offset of the partitions using admin/consumer, as you've found.

You could install Confluent REST Proxy and use HTTP calls, maybe, or use shell scripts, and parse the output, but it's just an abstraction over the same methods

Is there any way to recognize the last kafka message of every partition in multi partition topic and multiple consumers apart from lag?

1 Answers1