Questions tagged [splitbrain]
17 questions
5
votes
1 answer
What is Kubernetes HA cluster failure behaviour in split-brain scenarios between racks?
I am interested in the behaviour of multi-master Kubernetes in the event of different types of failure, particularly if the masters are on different racks.
Scenario:
2 racks, R1, R2.
API Masters:
M1 on R1, M2 on R2.
Worker nodes:
W1 on R1, W2…

John
- 10,837
- 17
- 78
- 141
3
votes
1 answer
How Redis with sentinels behave after split brain?
Question is about Redis server and sentinels configuration.
There are two subnetworks and I want to have 4 redis servers in total, 2 in each subnet. Since there might be connectivity issue I would like to configure sentinels in order to allow brain…

Nikolay Kuznetsov
- 9,467
- 12
- 55
- 101
1
vote
0 answers
Apache Ignite utilities for handling split brain
I have a simple Ignite cluster with two nodes. It is a Java API based in-memory cluster and only uses IgniteCaches that are REPLICATED and SYNC, nothing fancy.
I'm trying to see how I can handle a potential split-brain case when there is a long gc…

PentaKon
- 4,139
- 5
- 43
- 80
1
vote
0 answers
Elasticsearch cluster with two nodes only
I have a two-node scale ES cluster. In the configuration of the ES, I set the discovery.zen.minimum_master_nodes to 2, and all the other settings are left to default (both nodes are master node, both nodes are data node, and both nodes are…

SaWo
- 1,515
- 2
- 14
- 32
0
votes
0 answers
Apache Ignite split brain scenario
I deploy 3 instances (pods) of a java app in Kubernetes (EKS) with an in-process replicated cache.
using labels I have 2 of the 3 pods assigned to group:A and 1 pod assigned to group:B
I use Chaos mesh to simulate a loss of communication between the…

Rod
- 375
- 4
- 19
0
votes
0 answers
Why is it that KeepAlived does not offer a separate witness/quorum node to accommodate split brain scenarios?
To establish HA for one of our services, we used Keepalived. However, there is no suitable solution for split brain. Even if we keep a dedicated network between the interfaces, failure is always possible and could lead to split brain. Is there…

Anand
- 51
- 4
0
votes
1 answer
Akka Cluster: Down all when unstable & SBR's role
I have a lot of worker nodes in my akka-cluster, which cause Down all when unstable decision due to their instability; But they don't have SBR's role.
Why Down all when unstable decision in not taken based on SBR's
role?
To solve this problem,…

Arya
- 2,809
- 5
- 34
- 56
0
votes
1 answer
Is DRBD split-brain handler called only when after-sb-Xpri is set to disconnect?
I wanted to run a script if a split brain is detected. In the documentation, it is mentioned that we can do that by providing the path of the script like
resource
handlers {
split-brain ;
...
}
But, below that, for…

Manish Agrawal
- 3
- 1
0
votes
1 answer
Hazelcast, recovering a MessageListener member after termination due to message loss
We have a ReliableMessageListener that synchronizes some data structures that it holds across the cluster by the onMessage implementation.
The cluster is composed of three nodes. We noticed that one of the topics gets out of sync, and had been…

Ido Gal
- 528
- 10
- 26
0
votes
1 answer
What are the unusable scenarios of TDengine?
I was testing the brain split brain issue of TDengine these days with different configurations which prevents me from continuing to deploy cluster. In order to reduce the possibility of encountering bottlenecks, the unusable scenarios of TDengine…

naissance
- 36
- 12
0
votes
2 answers
Hazelcast Near Cache is not controlled by Split Brain Protection(Quorum)
I used the embedded hazelcast 4.0.1 in the spring boot project to manage the cache of the project. I set up Near Cache, and also set up the split-brain protection function, which was called Quorum before 4.0.
However, I found a problem. For…

TJwoods
- 65
- 3
0
votes
2 answers
Apache Ignite Cluster with ZooKeeper discovery behavior in network segmentation situation
We are developing architecture of the distributed system based on Apache Ignite.
The system has strict requirements for fault tolerance.
We have three data centers (DCs) for this: two of them are main DCs (DC1 and DC2) and one is reserve DC…

Eugene
- 1
0
votes
1 answer
DRBD Split Brain best scenario
I have 2 drbd node (primary/secondary) and I try to solve split brain without any lost data.
Running : Drbd(8.9.10-2), Pacemaker, Corosync, Postgresql
My auto solve config:
net {
after-sb-0pri discard-zero-changes;
after-sb-1pri…

Mr. Tux
- 145
- 3
- 8
0
votes
0 answers
ES 2 nodes Master Master Cluster
ES Config:
Node 1:
cluster.name: mycluster
node.name: "node1"
node.master: true
node.data: true
discovery.zen.ping.unicast.hosts: ["192.168.100.103"] # IP of node2
Node 2:
cluster.name: mycluster
node.name: "node2"
node.master: true
node.data:…

Groovy
- 57
- 1
- 10
0
votes
0 answers
ReplicatedMap EntryListener event on Split Brain Merge
I use a ReplicatedMap in my Hazelcast cluster. Each node has its key (hazelcastInstance.getLocalEndpoint().getUuid()) and some data (JSON string) in this map. Using this map I implemented a service such that each node has its data…

a1337q
- 770
- 3
- 10
- 20