Questions tagged [etcd]

A highly-available key value store for shared configuration and service discovery

etcd is a distributed key value store that provides a reliable way to store data across a cluster of machines. It’s open-source and available on GitHub. etcd gracefully handles master elections during network partitions and will tolerate machine failure, including the master.

Your applications can read and write data into etcd. A simple use-case is to store database connection details or feature flags in etcd as key value pairs. These values can be watched, allowing your app to reconfigure itself when they change.

Advanced uses take advantage of the consistency guarantees to implement database master elections or do distributed locking across a cluster of workers.

76 questions
1
vote
3 answers

Recover from failed etcd2 / CoreOS cluster

I've got a cluster of 3 CoreOS machines running on Azure. I rebooted two at the same time and the cluster failed as expected. I need to replace the discovery token, cloud-config is read on every bootup, but according to the CoreOS docs: Once an…
Mark
  • 13
  • 3
1
vote
1 answer

Removing a stale CoreOS node from discovery.etcd.io

I removed a node from a CoreOS cluster and brought up a fresh one in its place. Unfortunately, it picked up the same IP as the old machine. This stopped etcd from discovering the rest of the cluster, with messages like this in the journal: "failed:…
Paul Dixon
  • 1,516
  • 3
  • 23
  • 37
1
vote
0 answers

Changing out all Control Plane Nodes safely - Best Practice

I have a 3 control plane node HA kubeadm cluster that I need to completely replace. I have already replaced the worker nodes. How do I completely replace the control plane without downtime? I use a LB in front for the api endpoint. This is a…
Daxcor
  • 11
  • 1
1
vote
1 answer

What exactly is Kubernetes API datastore?

THis page mentioned Kubernetes API datastore -- https://projectcalico.docs.tigera.io/getting-started/kubernetes/flannel/flannel -- and it seems to suggest that Kubernetes API datastore is a replacement of etcd. But I have not found more info on this…
Jing He
  • 121
  • 3
1
vote
2 answers

kubernetes: how to check pod IP range allocated to node

Every node in a kubernetes cluster has a dedicated range of IP addresses that it can allocate to the pods. How can one check what that IP range is?
1
vote
2 answers

ETCD restore granularity

I'm studying some backup and restore solutions for Kubernetes and Openshift, typically with Velero. So, I'm not familiar with ETCD backups, but I would like to ask about the granularity level of etcd snapshots restore. Does ETCD snapshots only allow…
Vphdreamer
  • 11
  • 1
1
vote
0 answers

Error from server: etcdserver: request timed out - error after etcd backup and restore

I have done the etcd backup and then a restore on the same cluster and now I'm having these issues where I can list resources but I can't create or delete. It's a 1 master and 2 workers setup , installed using kubeadm. I was running this cluster for…
Tomas.R
  • 121
  • 1
  • 3
1
vote
0 answers

ETCD snapshots causing etcdserver: leader changed

For a while now we've experienced regular errors from operations on kube API in AKS resulting in etcdserver: leader changed message. From what we've learned there is an ETCD snapshot performed every 2h on AKS resulting in this leader change. This 2h…
1
vote
1 answer

systemd terminates etcd service started with podman - reception only permitted for main PID

I try to start etcd as a systemd service run in a container with podman. After start I get this error log from systemd: systemd[1]: etcd.service: Got notification message from PID 4696, but reception only permitted for main PID 4868 But etcd seem…
Jonas
  • 1,187
  • 5
  • 19
  • 33
1
vote
1 answer

How to start etcd in docker from systemd?

I want to start etcd (single node) in docker from systemd, but something seems to go wrong - it gets terminated about 30 seconds after start. It looks like the service starts in status "activating" but get terminated after about 30 seconds without…
Jonas
  • 1,187
  • 5
  • 19
  • 33
1
vote
0 answers

How to spin up a ETCD docker container and restore a backup obtained from a kubernetes ETCD Cluster node?

I am trying to spin up a ETCD node in docker and restore a backup obtained from the Kubernetes Cluster node. ETCDCTL_API=3 etcdctl --endpoints=https://127.0.0.1:2379 --user=root:'root' snapshot save snapshot.db I have obtained the snapshot and…
1
vote
1 answer

ETCD Cluster configuration for Kubernetes: Which one should be considered?

I would like to know how to deploy a ETCD cluster for Kubernetes. It seems like there are two different documentation and I don't know which one must be considered or the impact of each of them. From the Kubernetes documentation for a multi-cluster…
Mael Fosso
  • 121
  • 2
1
vote
3 answers

Kubernetes OCI runtime exec failed - starting container process caused "exec: \"etcdctl\": executable file not found in $PATH": unknown

Background Created a fresh Kubernetes cluster using kubeadm init --config /home/kube/kubeadmn-config.yaml --upload-certs and then joining the 2nd control plane node by running the below. kubeadm join VIP:6443 --token \ …
PieDev
  • 71
  • 1
  • 5
1
vote
1 answer

TLS handshake issues with etcd

We are using external etcd cluster for k8s cluster. We connected master to this etcd server but receive "tls: first record does not look like a TLS handshake" How to fix this issues? (for eksctl side all is working correctly on etcd servers with…
1
vote
2 answers

Own etcd cluster for Kubernetes

I want to build my own Kubernetes cluster across two locations (300 km distance) and integrate it into GitLab. Let me list my ideas. My question is if I have a mistake in my thinking somewhere and ask to solve it. Since I can only set up VMs and…
uav
  • 534
  • 5
  • 20