Stack Overflow
Stack Overflow

Questions tagged [kafka-cluster]

39 questions
0
votes
1 answer

Is it possible to lose Consumer group Offsets by Kafka brokers?

I was consuming from a Kafka topic (with a retention of 21 days) in a Kafka Cluster as a consumer (earliest/from beginning) for 15 days continously with x consumer group and on 15th day producer's team stopped producing and I stopped consumer on my…
Srikarsh Vardhanreddy Kolanu
  • 63
  • 9
0
votes
1 answer

What is the difference between Kafka Cluster and Kafka Broker?

Has Kafka cluster and Kafka broker the same meaning? I know cluster has multiple brokers (Is this wrong?). But when I write code to produce messages, I find awkward option. props.put("bootstrap.servers", "kafka001:9092, kafka002:9092,…
JoonT
  • 1,106
  • 1
  • 13
  • 29
0
votes
3 answers

Create Kafka cluster for testing Java-based Kafka clients

I have a Kafka client and I need to test the functionalities of it. For this I need to create a Kafka Cluster locally, and connect to it. As per the limitations, I can't use a Docker image or K8s for this. I did a search, and found This class used…
ThisaruG
  • 3,222
  • 7
  • 38
  • 60
0
votes
2 answers

How can I control request/message send by a Kafka cluster?

Suppose, I have 3 Kafka broker, a zookeeper, 50 producers, 50 consumers, and 1 topics (testTopic1). And All the consumer are subscribed to testTopic1. Now I will send 50 messages at the same time with the 50 producers to the same topic (testTopic1)…
SNA Nilim
  • 211
  • 1
  • 3
  • 8
0
votes
1 answer

ACLs for cluster resource in kafka

What are the cluster operations in kafka and what all operations can be allowed/denied by specifying --cluster option in kafka-acls.sh script? From this The inter-broker operations are split into two classes: cluster and topic. Cluster operations…
Markiv
  • 317
  • 1
  • 5
  • 13
0
votes
1 answer

Kafka cluster increasing replica factor doesn't work

Hi I run into a strange issue with increasing Kafka's replica factor when following the steps in this document: https://kafka.apache.org/documentation/#basic_ops_increase_replication_factor The symptom looks like replica factor increase doesn't work…
Bob
  • 291
  • 2
  • 8
0
votes
1 answer

How to check the number and IPs of kafka servers running in the cluster via kafka client?

I have a requirement where we have to validate the health check of the system via one single rest point. The idea is to get the number of kafka nodes and their IP's in the cluster running actively via a kafka client.Does kafka provide any API in…
user2966021
  • 423
  • 1
  • 7
  • 20
-1
votes
2 answers

Can't write data to kafka cluster

I deployed a three-node kafka cluster with docker-compose. here is my file version: '2' services: zookeeper: image: bitnami/zookeeper container_name: zook_kafka ports: - "192.168.0.90:2181:2181" environment: -…
Kirill Sawoyen
  • 1
-1
votes
1 answer

AZ deploy ARM template returns exceptions

After weeks of successful deployment of KafkaCluster from AZ command line using ARM template, recently its not working anymore and no changes happened to ARM template or to parameter. after running the AZ deployment command it throws exceptions. az…
ikenahim
  • 331
  • 1
  • 3
  • 15
1 2
3