Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [zookeeper]

49 questions
2
votes
2 answers

Unable to convert HDFS from non-HA to HA

Introduction Aim: Convert HDFS from non-HA to HA. Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration: /etc/hadoop/conf/hdfs-site.xml …
030
  • 5,901
  • 13
  • 68
  • 110
2
votes
2 answers

How to use nagios to monitor Zookeeper nodes

Sorry this may be a basic question, but I am new to both nagios, and zookeeper. My company has an application that uses zookeeper to track job status, by creating/destroying nodes. I need to be able to monitor that the number of nodes is always…
NSA
  • 123
  • 1
  • 5
2
votes
2 answers

Zookeeper starts using bin/zkServer.sh but not with service nor zookeeper-server

On Linux Scientific I have installed ZooKeeper from CDH5. When starting zookeeper using sudo service zookeeper-server start or zookeeper-server start it reports the server running, but fails silently. If I start it using bin/zkServer.sh it runs…
Bayes
  • 21
  • 2
1
vote
1 answer

Zookeeper best practice - using only SSD disks

we have HDP clusters version 2.6.0 / 2.6.1 ( hortonworks ) , and maybe in the future the version 3.0 I searched a lot in HORTONWORKS documentation , but not found the details about using SSD disks for zookeeper but on confluent , we can see that…
shalom
  • 461
  • 13
  • 29
1
vote
2 answers

init script for zookeeper

i have seen that the developers of zookeeper have a great zkServer.sh script to start,stop, restart etc zookeeper, but i have no idea why in the world they decided to skip init script to use. With the zkServer.sh script no way to set zookeeper to…
uberrebu
  • 503
  • 6
  • 17
  • 36
1
vote
1 answer

Zookeeper - faulty cluster member replacement

I am aware that as long as there is quorum my zookeeper ensemble will keep working. But does the missing server have any notable impact on the cluster performance? Let's suppose 1 of 3 servers crashes (and gets hdd destroyed). I guess I can join a…
fiction
  • 143
  • 1
  • 5
1
vote
1 answer

Issuing a single command from a cluster of servers?

I have a cluster of servers that will be running a simple ruok command with fallover. The command will be something simple like curl -X POST http://foo.com/status. Due to the fact that I will have anywhere from 3 to 300 nodes in this pool, I want to…
ehime
  • 597
  • 2
  • 7
  • 15
1
vote
1 answer

How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3

I am having trouble with a zookeeper ensamble where one node is not able to join the quorum. Zookeeper will not join the cluster. How to apply patch/upgrade? This seems to be related to a bug which has been fixed in 3.4.6 Now the question is, how to…
merlin
  • 2,093
  • 11
  • 39
  • 78
1
vote
0 answers

Unable to create index on solr, when using Zookeeper

Evening, I've created a what I believe to be a simple SOLR cluster, with Zookeeper (external binaries instead of the embeded). For simplicity, this cluster is: Master: SOLR1 Slave: SOLR2 Both device have Zookeeper running on them until I start to…
The NinjaSysadmin
  • 436
  • 5
  • 10
1
vote
1 answer

Gracefully take down a Zookeeper Node

I have had a hard disk begin to fail on one of my Zookeeper nodes in a cluster of 3 nodes. It is only a matter of time until the disk dies completely. Rather than waiting for this, I'd like to remove this node from the cluster gracefully as it is…
BlackVegetable
  • 139
  • 8
1
vote
1 answer

Define marathon services listening interface

I have a mesos install with 3 VPS. I use a virtual private network for internal networking. Everytime marathon starts and bind a service to a new port, it binds it to 0.0.0.0. No matter if I had a http(s) load balancy security in front, every user…
Dimitri Kopriwa
  • 177
  • 2
  • 11
1
vote
1 answer

How to maintain zookeeper ensemble?

I have a 3 node zookeeper ensemble running from where I had trouble with one node showing a corrupt db. Now I found in the docs that it has to be cleared regularily with the help of cron running this command: java -cp zookeeper.jar:log4j.jar:conf…
merlin
  • 2,093
  • 11
  • 39
  • 78
1
vote
1 answer

Error 127 when trying to run Zookeeper through supervisord?

I'm getting (exit status 127; not expected) when I try to run Zookeeper through supervisord, and the errors I'm getting back aren't helpful. Running it as the normal user works just fine: [ec2-user@ip-10-1-90-214 zookeeper-3.4.6]$ sudo…
greggilbert
  • 111
  • 4
1
vote
2 answers

Apache Kafka 0.8.1.1 clean shutdown not working

I have a: single instance of Apache Kafka (2.9.2-0.8.1.1) installed from the source, using the default configuration (server.properties etc.), Zookeeper (3.4.5+dfsg-2) stand-alone, installed from the package ..running on a Ubuntu 14.04 LTS host…
Greg Dubicki
  • 1,239
  • 1
  • 17
  • 33
1
vote
1 answer

Apache Kafka consumer client connecting to Apache Zookeeper: EndOfStreamException

I get an error when trying to 'consume' messages from Kafka (2.9.2-0.8.1) with a Zookeer stand-alone (3.4.5). You can see the source code below as well as the error message and logfile from Zookeeper. I'm not sure if the Java libraries are…
sema
  • 121
  • 1
  • 2
  • 7
1
2
3 4