Questions tagged [hadoop-plugins]

Plugins for the Apache™ Hadoop™ project.

Plugins for the Apache™ Hadoop™ project.

141 questions
0
votes
1 answer

How can I solve this problem : hadoop namenode -format gives error?

I setup Hadoop HA Cluster. I try to format hadoop as below code: hdfs --loglevel DEBUG namenode -format -force then when I see the log ( it is not DEBUG mode and this is another problem which i ve not solved) it gives error as below: error…
CompEng
  • 7,161
  • 16
  • 68
  • 122
0
votes
0 answers

Using libhdfs.so to perform hdfsConnect and Open File or Read leading to hdfsConnect call goes in to hung state

I am trying to create sample which uses client - server model to remotely deploy server component which uses libhdfs.so to perform hdfsConnect call which needs CLASSPATH and LIBHDFS_OPTS to be set to perform the sucessful connection and get hadoop…
0
votes
2 answers

Using MultipleTextOutputFormat to control output filename in MapReduce

Hadoop(and Java) neophyte here. I needed some help with using MultipleTextOutputFormat to control the output filename in MapReduce. Currently I am using it this way. And it seems to work fine. However what I am trying to change is the usage of the…
decimus phostle
  • 1,040
  • 2
  • 13
  • 28
0
votes
1 answer

HBql :: Any tips on how to limit query based on row ID?

Thanks for reading this one =) I'm trying to figure out how to figure out how to limit query in HBql based on row ID. I've spent hours, looking up to see if there's any relevant article online. So far, I haven't found any helpful document regarding…
Chul Kwon
  • 167
  • 1
  • 3
  • 11
0
votes
0 answers

ERROR: Cannot set priority of datanode process 16536 (datanode and namenode Deamons not running)

This is the output of my terminal: The errors showing up are the following: ERROR: Cannot set priority of datanode process 16536 ERROR: Cannot set priority of namenode process 16556
0
votes
1 answer

The type Mapper is not generic, hadoop eclipse pluggin

I am using eclipse to write mapreduce program. I imported hadoop library (hadoop-0.13.0-core.jar) I imported Mapper class import org.apache.hadoop.mapred.Mapper; there is no error in this but when I wrote this program source of this is…
big
  • 1,888
  • 7
  • 28
  • 48
0
votes
2 answers

HBase Key-Value Compression?

Thanks for taking interest in my question. Before I begin, I'd like to let you know that I'm very new to Hadoop & HBase. So far, I find Hadoop very interesting and would like to contribute more in the future. I'm primarily interested in improving…
Chul Kwon
  • 167
  • 1
  • 3
  • 11
0
votes
0 answers

Modify Hadoop NameNode web interface

Is there a proper and/or minimally intrusive way to extend the NameNode web interface of Hadoop (I am using version 2.8.5), for example, by adding a new tab with a view of the cluster in a different way/a way that is specifically tailored to my…
Zehanort
  • 458
  • 2
  • 10
0
votes
1 answer

How to set user login credentials to Spark webUI in apache spark open source cluser

We are using open source apache spark cluster in our project. Need some help on following ones. How to enable login credentials for spark web ui login? How to disable “kill button” option from spark webui?. Can someone help me solutions to…
Chandra
  • 199
  • 2
  • 20
0
votes
0 answers

Incorrect JAVA_HOME path when Installation of Approx-Mapreduce

I am trying to install ApproxMapreduce on Hadoop 3.0.0 on my Mac. And I followed the instructions from this link that worked for Hadoop 1.1.2. https://github.com/goiri/ApproxHadoop And I got an error message saying: Error: `JAVA_HOME` is not…
JDDD
  • 61
  • 2
  • 2
  • 7
0
votes
1 answer

SpatialHadoop: no scaling with multiple computing nodes

I am using SpatialHadoop to store and index a dataset with 87 million points. I then apply various range queries. I tested on 3 different cluster configurations: 1 , 2 and 4 nodes. Unfortunately, I don't see a runtime decrease with growing node…
0
votes
1 answer

Unable to write on hive on HDP2.4.0.0-169 sandbox when running scala application job from eclipse

I am facing a weird issue which working with HDP2.4.0.0-169 sandbox. I have HDP with host name - sandbox.hortonworks.com and ip 192.168.159.129, I have all default hadoop and other services up and running on that. I have written a spark code for…
0
votes
3 answers

Using Spark Job for putting file/data into HDFS from shared/NFS mounted location giving intermittent issues

I have a three node Spark Cluster using Yarn as cluster manager [running on three node hadoop cluster]. Consider that, My Hadoop Cluster is having three nodes [Master, Slave1 and Slave2] Resourcemanager is running on Master and NodaManager on Slave1…
Chauhan B
  • 461
  • 8
  • 27
0
votes
1 answer

Hadoop installation issue

After installing hadoop on oracle virtual box using ubuntu, everything is working fine . But when I am running localhost:50070 on browser, I am getting namenode health but not Legacy UI option at right bottom corner,through which I could browse the…
0
votes
2 answers

Making storage plugin on Apache Drill to HDFS

I'm trying to make storage plugin for Hadoop (hdfs) and Apache Drill. Actually I'm confused and I don't know what to set as port for hdfs:// connection, and what to set for location. This is my plugin: { "type": "file", "enabled": true, …
iMajna
  • 489
  • 4
  • 28