Questions tagged [apache-whirr]

Apache Whirr is a set of libraries for running cloud services.

Whirr provides:

  • A cloud-neutral way to run services, abstracting provider differences.
  • A common service API. The details of provisioning are particular to the service.
  • Smart defaults for services.

You can also use Whirr as a command line tool for deploying clusters.

19 questions
4
votes
1 answer

How to install JDK 7 on EC2 cluster via whirr?

I have some map-reduce programs compiled by Oracle JDK 7. And I'm trying to use whirr 0.8.1 to setup an EC2 cluster to run them. However, the default JDK installed by whirr 0.8.1 seems to be Open JDK 6, and I encountered the following error while…
3
votes
1 answer

Is there any way to create an autoscaling Hadoop Hbase cluster

I used aws autoscaling for my webserver and Apache whirr for hadoop habse cluster. Do Apache whirr has an autoscaling property.
najeeb
  • 813
  • 12
  • 25
3
votes
0 answers

Whirr: Cannot connect to Hadoop cluster on EC2 after lauch-cluster

I am new to Whirr and I'm trying to setup a Hadoop cluster on EC2 with Whirr,I have followed the tutorial on Cloudera https://ccp.cloudera.com/display/CDHDOC/Whirr+Installation Before install Whirr, I install Hadoop (0.20.2-cdh3u3), then install…
Arcobaleno
  • 484
  • 1
  • 5
  • 14
2
votes
1 answer

apache hama on EC2 through whirr 0.8

I am trying to take a look at Apache Hama and I followed the instructions at http://hama.apache.org/hama_on_clouds.html and downloaded whirr 0.8.2 but in this version there is not any hama-ec2.properties in the folder recipes, therefore i cannot try…
giulatona
  • 137
  • 2
  • 9
1
vote
0 answers

Hbase on EC2 using Whirr. How?

I'm trying to create a test cluster on EC2 with Hadoop and Hbase using Whirr. Following instructions from some…
AOvejero
  • 149
  • 1
  • 12
1
vote
3 answers

Yarn in Aazon EC2 with whirr

i am trying to configue Yarn 2.2.0 with whirr in Amazon EC2. however I am having some problems. I have modified the whirr services to support yarn 2.2.0. As a result I am able to start the jobs and run them successfully. however I am facing n issue…
1
vote
0 answers

Whirr: hadoop-proxy.sh not working

I have installed Whirr and created an EC2 cluster. The cluster is created correctly and I can ssh to the nodes and check that Hadoop is working correctly. However, whenever I try to use the hadoop-proxy.sh, I get the following message: bind: Cannot…
Balduz
  • 3,560
  • 19
  • 35
0
votes
1 answer

Launching hadoop cluster on amazon ec2 using whirr: Action handler not found

I want to launch an instance using whirr on amazon instance.But when I am trying to launch a cluster using the standardised whirr command , its searching in some directory name after my hadoop cluster name as "myclutster" which does not exist.Could…
0
votes
1 answer

Booting a Druid Cluster using Whirr

I am trying to boot a Druid cluster using Whirr following the steps in Druid website http://druid.io/docs/latest/Booting-a-production-cluster.html The cluster is instantiated, but the different Druid nodes (overlord, middleManager, historical and…
deepkimo
  • 3,187
  • 3
  • 23
  • 21
0
votes
1 answer

Cant start whirr on ec2 - describeAvailabilityZonesInRegion(Unknown Source)

Below is my properties file and error. How do I resolve? Thanks whirr.cluster-name=myhadoopcluster whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,2…
Tampa
  • 75,446
  • 119
  • 278
  • 425
0
votes
4 answers

How do I make a patch from a github repo if I failed to make a feature branch?

I forked/cloned apache whirr on Github, and began work on the trunk branch. During the work, I pulled two commits from origin/trunk. When I generate a patch by running a git diff first_feature_commit HEAD, I get a patch that has these two commits in…
rjurney
  • 4,824
  • 5
  • 41
  • 62
0
votes
1 answer

whirr unable to connect to custom AMI - EC2

Hi I am trying to do a Hadoop deployment on EC2 using whirr. If I use one of the publicly available Ubuntu AMI, my cluster gets deployed and everything runs fine. However, if I use my own custom RHEL AMI, then my launch fails because of ssh. Here is…
user654320
  • 41
  • 1
  • 1
  • 4
0
votes
1 answer

AWS instance was deployed with Whirr. How do I get a key pair of the instance?

I run AWS instance automatically with Apache Whirr. Then I wanted to connect to this instance with ssh, and I need a key pair to connect. I went to AWS console and I found, that new key pair was created for this instance. Since I deployed it…
sunny
  • 1,887
  • 3
  • 29
  • 40
0
votes
1 answer

Whirr could not download hadoop

following the example of the quickstart guide http://whirr.apache.org/docs/0.8.1/quick-start-guide.html I wanted to start a whirr hadoop cluster. Unfortunately I get the same errors as this entry here Whirr: Cannot connect to Hadoop cluster on EC2…
js84
  • 3,676
  • 2
  • 19
  • 23
0
votes
1 answer

JPS not showing hbase or hadoop?

I set up a hbase/hadoop cluster on ec2 using Apache Whirr but when I ssh into the namenode (hbase master) and run $JAVA_HOME/bin/jps all I see running is jps, no mention of hbase or namenode. They are running, however, because I was able to work…
Philip O'Brien
  • 4,146
  • 10
  • 46
  • 96
1
2