Stack Overflow
Stack Overflow

Questions tagged [apache-zookeeper]

Apache ZooKeeper is a distributed service that provides configuration information storage, naming, synchronization, coordination, and group services.

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. It was inspired by Chubby, Google's distributed lock system.

All of these kinds of services are used in some form or another by distributed applications. Each time they are implemented there is a lot of work that goes into fixing the bugs and race conditions that are inevitable. Because of the difficulty of implementing these kinds of services, applications initially usually skimp on them, which makes them brittle in the presence of change and difficult to manage. Even when done correctly, different implementations of these services lead to management complexity when the applications are deployed.

ZooKeeper is used by a variety of other software projects to maintain configuration information including Apache Storm, Apache Flink, Solr Cloud, Apache Kafka and Apache Hadoop.

Links

Related Tags

3686 questions
21
votes
12 answers

HBase standalone failed to connect (fail to create table)

I am trying to deploy Hbase in standalone mode following this article: http://hbase.apache.org/book.html#quickstart. The version is 0.92.1-cdh4.1.2 But I am getting these errors when try to create a table: Error message: 13/04/01 14:07:10 ERROR…
Hypnos
  • 285
  • 1
  • 3
  • 10
20
votes
6 answers

ZooKeeper for Java/Spring Config?

Are there any well documented use cases of Apache ZooKeeper being used to distribute configuration of Java applications, and in particular Spring services? Like many users of cloud services I have a requirement to change the configuration of a…
DeejUK
  • 12,891
  • 19
  • 89
  • 169
20
votes
1 answer

How to send message to a particular partition in Kafka?

I have created a topic that has many partitions. Using the console producer I want to send messages to particular partitions and view the through the console consumer. On the console producer I have tried this, kafka-console-producer.bat…
Amrutha Jaya Raj
  • 612
  • 2
  • 10
  • 32
20
votes
2 answers

What exactly is the zookeeper quorum setting in hbase-site.xml?

What exactly is the zookeeper quorum setting in hbase-site.xml?
raj
  • 3,769
  • 4
  • 25
  • 43
20
votes
2 answers

What's the difference between ZooKeeper and any distributed Key-Value stores?

I am new to zookeeper and distributed systems, and am learning it myself. From what I understand for now, it seems that ZooKeeper is simply a key-value store whose keys are paths and values are strings, which is nothing different from, say, Redis.…
OneZero
  • 11,556
  • 15
  • 55
  • 92
20
votes
3 answers

How to configure dynamic properties while using spring boot?

I'm planning to use Spring Boot for my assignment. Its a typical server application with connection to database. I know I can use Spring Configuration to externalize my properties e.g. db connection details. But I also have other dynamic properties…
eton dolittle
  • 221
  • 1
  • 2
  • 5
20
votes
2 answers

Why can't my Zookeeper server rejoin the Quorum?

I have three servers in my quorum. They are running ZooKeeper 3.4.5. Two of them appear to be running fine based on the output from mntr. One of them was restarted a couple days ago due to a deploy, and since then has not been able to join the…
fpearsall
  • 627
  • 2
  • 7
  • 14
20
votes
2 answers

Zookeeper - three nodes and nothing but errors

I have three zookeeper nodes. All ports are open. The ip address are correct. Below is my config file. All nodes where booted by chef and all have the same install and config file. # The number of milliseconds of each tick tickTime=3000 # The…
Tampa
  • 75,446
  • 119
  • 278
  • 425
19
votes
2 answers

Using ACL with Curator

Using CuratorFramework, could someone explain how I can: Create a new path Set data for this path Get this path Using username foo and password bar? Those that don't know this user/pass would not be able to do anything. I don't care about SSL or…
Molten Ice
  • 2,715
  • 1
  • 27
  • 37
19
votes
4 answers

Kafka on Kubernetes multi-node

So my objective here is to set up a cluster of several kafka-brokers in a distributed fashion. But I can't see the way to make the brokers aware of each other. As far as i understand, every broker needs a separate ID in their config, which I cannot…
NegatioN
  • 667
  • 2
  • 9
  • 24
19
votes
5 answers

How to implement distributed rate limiter?

Let's say, I have P processes running some business logic on N physical machines. These processes call some web service S, say. I want to ensure that not more than X calls are made to the service S per second by all the P processes combined. How can…
Dhrumil Upadhyaya
  • 1,014
  • 2
  • 10
  • 14
19
votes
2 answers

Zookeeper/Chubby -vs- MySql NDB

I have been reading the Paxos paper, the FLP theorem etc. recently and evaluating Apache Zookeeper for a project. I have also been going thru Chubby (Google's distributed locking service) and the various literature on it that is available online. My…
arun_suresh
  • 2,875
  • 20
  • 20
18
votes
3 answers

"java.net.ConnectException: Connection refused" in zookeeper

I installed zookeeper as follows : wget http://archive.cloudera.com/cdh/3/zookeeper-3.3.3-cdh3u1.tar.gz Here is my zoo.cf: # The number of milliseconds of each tick tickTime=2000 # The number of ticks that the initial # synchronization phase can…
XMen
  • 29,384
  • 41
  • 99
  • 151
18
votes
3 answers

Something like Apache Zookeeper with no java?

Is there some library or project out there that works like Zookeeper but has no java dependency? I'm looking at putting this on an embedded linux system, and need minimal footprint... something like a megabyte or less. I have Lua, C and C++…
Andrew McGregor
  • 31,730
  • 2
  • 29
  • 28
18
votes
5 answers

Rebalancing issue while reading messages in Kafka

I am trying to read messages on Kafka topic, but I am unable to read it. The process gets killed after sometime, without reading any messages. Here is the rebalancing error which I get: [2014-03-21 10:10:53,215] ERROR Error processing message,…
divinedragon
  • 5,105
  • 13
  • 50
  • 97
1 2 3
…
99 100