Stack Overflow
Stack Overflow

Questions tagged [leader-election]

55 questions
1
vote
0 answers

KafkaStreams stop consuming partitions after partition leader rebalance

We have experimented an issue that could be caused by the parameter auto.leader.rebalance.enable, which is set to true by default on brokers. In detail, when the automatic rebalance occurs, for example after a broker restart, some partition leaders…
Giorgio Tavecchia
  • 11
  • 1
1
vote
1 answer

Apache Curator : No leader is getting selected intermittently

I am using Apache Curator Leader Election Recipe : https://curator.apache.org/curator-recipes/leader-election.html in my application. Zookeeper version : 3.5.7 Curator : 4.0.1 Below are the sequence of steps: 1. Whenever my tomcat server instance is…
Viniti
  • 125
  • 2
  • 9
1
vote
2 answers

Hazelcast master node election in EKS / AWS is possible?

We have a spring boot application running in physical boxes. Planning to migrate to EKS (AWS). We have hazelcast used for multiple purposes listed below. Is it possible to use hazelcast itself in AWS to make use of the same features.? Or should I…
smilyface
  • 5,021
  • 8
  • 41
  • 57
1
vote
1 answer

Does my algorithm for Leader Election bypasses FLP result?

Based on FLP result, any consensus problem cannot be solved in asynchronous network system, and selecting a unique leader is a kind of consensus problem. Therefore, in theory, leader election is a unsolvable problem in asynchronous network…
Sheng Wang
  • 33
  • 3
1
vote
1 answer

Leader election- Pod is not selecting as a leader

I have implemented leader election using kubernetes/client-go leader election. I have 2 replicas. For the first time both pod is selecting as leader, but same pod is not elected as leader after this. And the leader election get stopped after some…
chakku
  • 57
  • 1
  • 12
1
vote
1 answer

Can we update k8s leader immediately when the leader pod is dead?

I followed this article to use k8s leader election for HA of my app. But I met one issue. Could any one have the same experience? For example, I have 4 pod replicas. One of the pod has already been selected as leader. When this leader pod is down…
Howard
  • 3,638
  • 4
  • 32
  • 39
0
votes
0 answers

Using Hashicorp Raft Implementation Not Working

First I was trying to implement it for my own application but was not able to so, then I cloned the this template repo https://github.com/Jille/raft-grpc-example/tree/master but this all gives the same error. ./raft-grpc-example --raft_bootstrap…
Arpit Pruthi
  • 177
  • 10
0
votes
2 answers

Can raft leader election algorithm run on serverless (lambda)?

Is it possible to run Raft on serverless lambdas instead of a cluster? The main benefit would be not having to maintain a cluster or VMs.
marti H
  • 45
  • 5
0
votes
2 answers

Use kubernetes leases as service selector

My setup is similar to a active/passive deployment but I'd like to use the kubernetes lease and leader election to manage the active pod. The leader election is all working as intended and the Lease object is created and maintained (roughly based on…
arjen_s
  • 1
0
votes
0 answers

3-node Zookeeper ensemble unable to recover if leader fails

I've configured a 3-node Kafka (2.13) cluster with Zookeeper (3.6.3), with each Zookeeper instance living in the same machine as each Kafka broker (Java 11.0.18). Everything worked fine for a long long time. However, the first time a machine failed…
jaasilva
  • 1
  • 1
0
votes
0 answers

Preferred leader in Apache Curator?

In the Leader Election feature of the Apache Curator framework, is it possible to "prefer" a leader for a given latch group, so that if it's online, it takes precedence (leadership) over the others (that would lose leadership when the "preferred"…
Thomas
  • 1,053
  • 2
  • 11
  • 20
0
votes
0 answers

disable leader election in etcd

I'm running etcd on a single server and wanted to disable leader election. Couldn't find any config parameters to achieve this from config guide, https://etcd.io/docs/v3.4/op-guide/configuration/ Was looking for a config parameter to disable leader…
reynoldpj
  • 79
  • 6
0
votes
0 answers

Distributed lock & leader election -- how to ensure leader only does work when it holds lock?

When using a distributed lock library for example Consul to implement leader election ( there are 2 nodes consuming messages. However only 1 of them must acquire a lease on a distributed lock and become leader and actually process messages. The…
starbucks pete
  • 1
  • 1
0
votes
2 answers

Cannot get leader of topic "test" partition

I was performing a rolling kafka broker upgrade from 2.2.1 to 3.2.0(from cp 5.2.2 to 7.2.1).This was done as a rolling upgrade on kafka cluster.There are three pods i.e, kafka-0,kafka-1 and kafka-2.The replication factor for this topic is 2.During…
purvi ijantkar
  • 13
  • 3
0
votes
1 answer

Does Spring Integration have any features for leader election with respect to IntegrationFlow "ownership"?

I've been learning Spring Integration for about a month now, and it suddenly dawned on me: what if you have the requirement to only have one instance of an IntegrationFlow at any point in time, but you have multiple instances of the Spring…
hotmeatballsoup
  • 385
  • 6
  • 58
  • 136
1
2
3 4