0

Is there any option or configuration which will facilitate a single Kafka consumer to consume messages from two different clusters simultaneously? While creating producer and consumer, I mention both the clusters as comma-separated. I have been observing the the consumer is consuming messages from a single cluster only.

Please see below the elucidation: Consumer C1 is configured to listen to the clusters: Cluster-1: Zookeeper-1 with Broker-1 Cluster-2: Zookeeper-2 with Broker-2

I am looking for a solution wherein the consumer C1 can consume messages from Cluster-1 and Cluster-2 simultaneously.

Iqbal
  • 73
  • 3
  • 14
  • 1
    Possible duplicate of [How to consume from two different clusters in Kafka?](https://stackoverflow.com/questions/41457254/how-to-consume-from-two-different-clusters-in-kafka) – Bartosz Wardziński Mar 18 '19 at 08:04
  • There is some relevance there but it doesn't addresses my query completely. There's is a just a small reference mentioning that it's not possible for a consumer to connect more than one cluster. But is there no way around it? – Iqbal Mar 18 '19 at 09:41

1 Answers1

0

Consuming data from two or more different clusters is not possible. Any instance of a Kafka consumer can consume messages only from a single Kafka cluster.

Giorgos Myrianthous
  • 36,235
  • 20
  • 134
  • 156