Kafka-python retrieve the list of topics

Question

I'm using kafka-python and I'm wondering if there is a way for showing all the topics.

Something like this:

./bin/kafka-topics.sh --list --zookeeper localhost:2181

did you try with http://kafka-python.readthedocs.org/en/1.0.2/apidoc/KafkaConsumer.html#kafka.KafkaConsumer.topics ? — Markon, Apr 15 '16 at 08:31
Many thanks, is what i was looking for. If you want to write an answer I will mark it as correct. Maybe could be useful also for others. — teoreda, Apr 15 '16 at 08:33

score 56 · Accepted Answer · edited Oct 26 '17 at 07:54

56

import kafka
consumer = kafka.KafkaConsumer(group_id='test', bootstrap_servers=['server'])
consumer.topics()

edited Oct 26 '17 at 07:54

answered Jul 27 '17 at 10:20

secfree

1

Sounds good, doesn't work "ValueError: Topic name "*" is illegal, it contains a character other than ASCII alphanumerics, ".", "_" and "-"" – Ravindranath Akila Oct 26 '17 at 07:29

score 3 · Answer 2 · answered Mar 29 '22 at 22:42

3

You need to use the KafkaAdminClient, not KafkaConsumer:

import kafka
admin_client = kafka.KafkaAdminClient(bootstrap_servers=['server'])
admin_client.list_topics()

answered Mar 29 '22 at 22:42

Artem Amirbekov

score 1 · Answer 3 · answered Apr 15 '16 at 08:35

1

answered Apr 15 '16 at 08:35

Markon

1

This does not seem to poll Kafka for the available topics, only lists the topics that a consumer instance is subscribed to. – Aaron McMillin Jan 19 '17 at 20:10
This is not a static method, so must create an instance of KafkaConsumer to use it, but it turns out you can do that without a topic list, and it will in fact list the topics from kafka – Aaron McMillin Jan 20 '17 at 14:51

3 Answers3