Stack Overflow
Stack Overflow

Questions tagged [apache-zookeeper]

Apache ZooKeeper is a distributed service that provides configuration information storage, naming, synchronization, coordination, and group services.

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. It was inspired by Chubby, Google's distributed lock system.

All of these kinds of services are used in some form or another by distributed applications. Each time they are implemented there is a lot of work that goes into fixing the bugs and race conditions that are inevitable. Because of the difficulty of implementing these kinds of services, applications initially usually skimp on them, which makes them brittle in the presence of change and difficult to manage. Even when done correctly, different implementations of these services lead to management complexity when the applications are deployed.

ZooKeeper is used by a variety of other software projects to maintain configuration information including Apache Storm, Apache Flink, Solr Cloud, Apache Kafka and Apache Hadoop.

Links

Related Tags

3686 questions
1
vote
1 answer

Kafka - consumers / producers works with all Zookeper instances down

I've configured a cluster of Kafka brokers and a cluster of Zk instances using kafka_2.11-1.1.0 distribution archive. For Kafka brokers I've configured config/server.properties broker.id=1,2,3 zookeeper.connect=box1:2181,box2:2181,box3:2181 For Zk…
Cristi
  • 180
  • 15
1
vote
2 answers

Storage plugin configuration on Zookeeper for Apache Drill + Zookeeper in Kubernetes cluster

I am running Apache Drill and Zookeeper on a Kubernetes cluster. Drill is connecting to zookeeper through a zookeeper-service running on port 2181. I am trying the persist storage plugin configuration on zookeeper. On the Apache Drill docs…
Jyotsana Walia
  • 11
  • 2
1
vote
0 answers

Kafka with SASL_PLAINTEXT authentication

I'm using the following docker-compose configuration: app-zookeeper: image: wurstmeister/zookeeper container_name: app-zookeeper ports: - 2181:2181 app-kafka: build: ../images/kafka container_name: app-kafka …
Leonel
  • 2,796
  • 5
  • 25
  • 36
1
vote
0 answers

What is 'zookeeper.znode.parent'?

I'm currently trying to run a Nutch job under Hadoop on a single-node cluster (just the master, no slaves). I run the following: hadoop jar /var/www/html/nutch/nutch4/build/apache-nutch-2.3.job org.apache.nutch.crawl.InjectorJob urls But, every…
Anthony Frizalone
  • 143
  • 1
  • 7
1
vote
0 answers

How to setup SASL authentication for Zookeeper

I have successfully setup SASL PLAIN and PLAINTEXT security for Kafka brokers, in a sense that clients cannot consume or produce successfully without providing kafka_client_jaas.conf with valid username and password credentials, due to…
hdjur_jcv
  • 686
  • 1
  • 12
  • 30
1
vote
1 answer

Spring cloud zookeeper Config - Set ACL for zookeeper

According to the documentation , I can add authentication information for Zookeeper ACLs by calling the addAuthInfo. But in the Curator Framework bean I don't find the method itself. It throws complilation issue !! . My POM has …
nav3916872
  • 978
  • 13
  • 20
1
vote
1 answer

Zookeeper doesn't work with JRE installed on 32 bit Windows

I have installed JRE on a 32-bit Windows machine and trying to run Zookeeper. It shows following error: Error: missing `server' JVM at `C:\Program Files\Java\jre1.8.0_181\bin\server\jvm.dll'. Please install or use the JRE or JDK that contains these…
BabyDuck
  • 1,249
  • 1
  • 9
  • 22
1
vote
1 answer

How to run os.system to start a process through a different pid?

import os from kazoo.client import KazooClient signal.signal(signal.SIGINT, signal_handler) def signal_handler(signal,frame): print('\nYou pressed Ctrl+C!') print("Stopping...Process "+process_id) print() children =…
Prudhvi raj
  • 11
  • 1
1
vote
1 answer

Exception in thread "main" java.net.UnknownHostException: zookeeper: Name or service not known

I have copied a working docker/kafka-environment from my local Ubuntu machine to a Google cloud VM. Stuff so far behaves the same - as expected - but on GCP this command docker run --net=confluent --rm confluentinc/cp-kafka:4.1.0 kafka-topics --list…
EggInMyFace
  • 11
  • 2
1
vote
1 answer

kafka bootstrap broker disconnected using docker-compose

Good morning. First of all, I've created a docker swarm with 2 physical hosts and an overlay network. In the same host I've created 2 containers (postgres and ambari servers) and one with ambari agent in which I'll install kafka, zookeeper,…
sartions
  • 113
  • 1
  • 4
  • 15
1
vote
1 answer

How to upgrade zookeeper from from 3.4.8 to 3.4.13?

I am trying to upgrade zookeeper from 3.4.8 to 3.4.13. Before upgrade the content of /usr/lib/zookeeper drwxr-xr-x 5 root root 4.0K Aug 23 08:39 . drwxr-xr-x 77 root root 12K Aug 23 08:50 .. drwxr-xr-x 2 root root 4.0K Aug 23 08:39…
tuk
  • 5,941
  • 14
  • 79
  • 162
1
vote
1 answer

Accumulo Tracer hangs on startup

I am using Apache Ambari to manage HDFS, Zookeeper and Accumulo. I am having issues with Accumulo Tracer starting up. Ambari starts Accumulo Tracer using this command. Execute['cat /var/lib/ambari-agent/tmp/pass |…
Cody Adams
  • 11
  • 1
1
vote
0 answers

Confluent-Kafka "Consumer instance not found" error even-if consumer instance is not timedout

I'm observing Consumer instance not found error, at the time of consumer registration even if consumer instance is not timedout. Using Confluent API's. Following are steps followed for this negative testing: Running a script for consumer…
Pooja
  • 481
  • 1
  • 8
  • 15
1
vote
0 answers

Why i am getting SolrException and TimeoutException then Could not connect to ZooKeeper localhost:6511 within 10000 ms

i am trying to connect from application layer to solr search layer i get this error in liferay log file, could you please help me on this ## Heading ##List item 00:00:06,363 ERROR [liferay/search_writer/SYSTEM_ENGINE-5][SolrIndexWriter:134]…
samba
  • 11
  • 1
1
vote
2 answers

Is there a way to start a Zookeeper server using my static ip instead of localhost

I've started learning some big data tools for a new project, and right now I'm on Kafka and Zookeeper. I have them both install on my local machine, and I can start them up and start producing and consuming messages just fine. Now, I want to try it…
Eoin
  • 330
  • 1
  • 3
  • 15
1 2 3
…
99
100