Stack Overflow
Stack Overflow

Questions tagged [apache-zookeeper]

Apache ZooKeeper is a distributed service that provides configuration information storage, naming, synchronization, coordination, and group services.

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. It was inspired by Chubby, Google's distributed lock system.

All of these kinds of services are used in some form or another by distributed applications. Each time they are implemented there is a lot of work that goes into fixing the bugs and race conditions that are inevitable. Because of the difficulty of implementing these kinds of services, applications initially usually skimp on them, which makes them brittle in the presence of change and difficult to manage. Even when done correctly, different implementations of these services lead to management complexity when the applications are deployed.

ZooKeeper is used by a variety of other software projects to maintain configuration information including Apache Storm, Apache Flink, Solr Cloud, Apache Kafka and Apache Hadoop.

Links

Related Tags

3686 questions
15
votes
2 answers

ZooKeeper alternative for .net

Is there any alternative of ZooKeeper in .net? Other than database which we all use for similar stuff. We need it for leader selection and to make sure one item is getting processed only once and various distributed status sharing.
mamu
  • 12,184
  • 19
  • 69
  • 92
15
votes
5 answers

not attempt to authenticate using SASL (unknown error)

I am trying to setup zookeeper on ec2 two instances. as given here and here. I am trying to run zookeeper which fails with an error: command: bin/zkCli.sh -server localhost:2181 > 2015-03-15 00:22:35,644 [myid:] - INFO [main:ZooKeeper@438] -…
Bharat
  • 407
  • 2
  • 7
  • 16
15
votes
2 answers

Delete/remove Solr configuration from ZooKeeper using zkcli?

We have some old Solr configs in ZK and that we need to cleanup/delete. The configs are at /configs/AAA, /configs/BBB, etc. (There are other configs under /configs as well.) The Solr zkcli.sh script and docs provide no direction for deleting a…
user2029783
  • 591
  • 1
  • 6
  • 19
15
votes
2 answers

ZooKeeper and RabbitMQ/Qpid together - overkill or a good combination?

Greetings, I'm evaluating some components for a multi-data center distributed system. We're going to be using message queues (via either RabbitMQ or Qpid) so agents can make asynchronous requests to other agents without worrying about addressing,…
Chris Sears
  • 6,502
  • 5
  • 32
  • 35
14
votes
6 answers

Invalid Config, Exiting abnormally when launching zookeper from Kafka tutorial

I'm following this tutorial trying to set up kafka, https://kafka.apache.org/quickstart And I get this error when doing the part on zookeeper. It certainly has something to do with the config, but I don't understand to what…
Ilan
  • 163
  • 1
  • 1
  • 5
14
votes
2 answers

Apache Storm: Could not find leader nimbus from seed hosts

I installed Apache Storm 1.0 by following this tutorial but I am not able to access to the Storm UI from the Internet. Accessing localhost:8080 gives the following error: org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader…
h.zak
  • 1,407
  • 5
  • 21
  • 40
14
votes
4 answers

Kafka : How to connect kafka-console-consumer to fetch remote broker topic content?

I have setup a kafka zookeeper and 3 brokers on one machine on ec2 with ports 9092..9094 and am trying to consume the topic content from another machine. The ports 2181 (zk), 9092, 9093 and 9094 (servers) are open to the consumer machine. I can even…
notrai
  • 696
  • 1
  • 5
  • 15
14
votes
5 answers

Unable to start Zookeeper server - Kafka Setup

I am trying to setup Kafka referring to the quick start guide on the apache kafka page and while starting the zookeeper server it gets stuck at this step...Would appreciate if someone can help guide me through on how to start the zookeeper…
tobeornotobe
  • 151
  • 1
  • 1
  • 4
14
votes
13 answers

Zookeeper issue in setting kafka

To install kafka , I downloaded the kafka tar folder. To start the server I tried this command : bin/zookeeper-server-start.sh config/zookeeper.properties The following error occured on entering the above command: INFO Reading configuration from:…
user3823859
  • 469
  • 1
  • 7
  • 20
14
votes
12 answers

FAILED TO WRITE PID installing Zookeeper

I am new to Zookeeper and it has being a real issue to install it and run. I am not sure what is wrong in here but I will explain what I've being doing to make it more clear: 1.- I've followed the installation guide provided by Apache. This means…
Rodrigo
  • 199
  • 1
  • 3
  • 8
14
votes
2 answers

LeaderLatch vs LeaderSelector

what is the difference between LeaderLatch and LeaderSelector in the apache curator framework? http://curator.incubator.apache.org/curator-recipes/leader-election.html
user2474033
  • 155
  • 1
  • 5
13
votes
4 answers

how to integrate cassandra with zookeeper to support transactions

I have a Cassandra cluster and Zookeeper server installed. Now I want to support transactions in cassandra using zookeeper. How do i do that. Zookeeper creates znodes to perform read and write operations and data to and fro goes through znodes in…
Vaibhav Singh
  • 131
  • 1
  • 1
  • 4
13
votes
1 answer

KAFKA broker throwing Wrong request type 18 and Wrong request type 16

System: EC2 Instance Type: m5.2xlarge OS: Ubuntu 14.04.5 LTS Kernel Version: 4.4.0-1022-aws vCPU: 8 Cores Memory: 32Gib Java Version: 1.8.0_171 We are running KAFKA in cluster mode with two kafka brokers(10.0.51.1 & 10.0.51.2) and three…
Pinakin Shethna
  • 131
  • 2
13
votes
1 answer

What is the interaction between Solr and Zookeeper?

I've been working on a system where they use SolrCloud, which entails a Zookeeper ensemble that helps "manage the overall structure so that both indexing and search requests can be routed properly" (straight out of the Solr documentation). What…
Lucio Assis
  • 403
  • 1
  • 5
  • 14
13
votes
2 answers

How to install zookeeper as service on CentOS 7

I am trying to install zookeeper on CentOS 7 using yum install zookeeper or yum install zookeeperd but it throws: There is no zookeeper package available.
Asier Gomez
  • 6,034
  • 18
  • 52
  • 105
1 2 3
…
99 100