how to create consumer group with multiple consumers in confluent-kafka-go?

Question

As i'm new to Go and kafka , i need to implement consumer groups using confluent-kafka-go module. can anyone help me out?

Thanks in advance

score 2 · Accepted Answer · answered Nov 11 '19 at 12:14

2

With confluent-kafka-go, you just need to set group.id in your consumer configuration to have it join/create a group.

For example:

c, err := kafka.NewConsumer(&kafka.ConfigMap{
        "bootstrap.servers": "localhost:9092",
        "group.id":          "my-group"})

answered Nov 11 '19 at 12:14

Mickael Maison

what to do if i want to add multiple consumers to that group? – Vani Polnedi Nov 11 '19 at 12:21
1

Just start multiple consumers, all with the same value for `group.id` – Mickael Maison Nov 11 '19 at 12:36
Thank you Mickael Maison. one more doubt ... what to do if i want multiple consumers for multiple groups? – Vani Polnedi Nov 11 '19 at 12:46
1

A consumer can only be a member of a single group. So you need to start some consumers with `group.id` set to `group-1` and some with `group-2` for example. – Mickael Maison Nov 11 '19 at 13:15
can I have more than one consumer in specific go thread? – Maryam Jul 26 '22 at 20:10
Also when I close the consumer, the offsets are changed. (without consuming) – Maryam Jul 26 '22 at 20:11
@MickaelMaison it would be nice of you to help me in this issue. – Maryam Jul 26 '22 at 20:14
@MickaelMaison, thats clear from doc, but how to read messages from many consumers? – ramory-l Mar 22 '23 at 16:03

1 Answers1