Questions tagged [hadoop-plugins]

Plugins for the Apache™ Hadoop™ project.

Plugins for the Apache™ Hadoop™ project.

141 questions
1
vote
0 answers

How to keep track of time elapsed during a Hadoop Job?

I am attempting to make an open-source contribution to the Apache Hadoop DSL plugin. Basically I am making a new job class (let's call it xyzJob) that extends Job, and I need a way to keep track of the time elapsed during an xyzJob. Once a certain…
C N
  • 13
  • 3
1
vote
2 answers

What is stateless node? How Hadoop nodes are stateless?

Does stateless node mean just being independent of each others? can you explain this concept w.r.t to hadoop
Vidya
  • 154
  • 1
  • 17
1
vote
0 answers

Running the temperature example on EMR hadoop cluster using Hadoop Development tools on eclipse

I'm still a newbie in hadoop. I'm trying to run the common temperature example on an Amazon EMR hadoop 2.6.0 cluster using Hadoop Development Tools on eclipse, I'm connecting through an SSH Tunnel and don't have connection problems so far since I…
Learner
  • 60
  • 12
1
vote
1 answer

eclipse plugin for hadoop 2.4.1 version

I have installed hadoop 2.4.1 which is working and i am trying to configure eclipse for hadoop. I dont see an eclipse plugin for hadoop 2.4.1 version. Does anyone know where to pick that plugin and use it eclipse. I understand that most hadoop…
Viswa
  • 1,357
  • 3
  • 18
  • 30
1
vote
1 answer

Loading CSV using Custom Line break

I have a CSV as follows, where the line is terminated by "+++" instead of new line. How to load the csv by doing a line break where the string "+++" is…
Anas A
  • 199
  • 4
  • 19
1
vote
2 answers

ERROR 1128: Cannot find field dryTemp

my pig was run code temperature and me an error, put the code below and the error to facilitate the understanding of my problem occurred. the error is in line 38 column 15, tried to delete the dryTemp, but also gave another error. Code: --Load…
Eduardo Asafe
  • 129
  • 2
  • 10
1
vote
0 answers

Can we read built-in counters in Hadoop for individual tasks

Can we read built-in counters in Hadoop for individual tasks and in a periodic manner (say every 500 ms or 1 sec) and record in a file. If we can do that then how to do that? How to get the individual task pids?
1
vote
0 answers

Job failed with large volume of small data: java.io.EOFException

I have encounter a weird problem, I got a hive MR job which would always failed if there are large number of input file(e.g. 1500 input files), but always succeed if there is only a little input files(e.g. 50 input files). according to the running…
user2950086
  • 135
  • 1
  • 1
  • 13
1
vote
1 answer

Hbase 0.96 integration with Mahout 0.9

Is it possible to use H base version 0.96 as data source for Mahout 0.9 version? Example :- Running Mahout on a Hbase Table. I am using system having configurations:- Ubuntu 14.04 -64 bit architecture. Thanks in advance.
1
vote
0 answers

initscript hadoop-0.20-mapreduce-tasktracker,action "start" failed

initscript hadoop-0.20-mapreduce-tasktracker,action "start" failed. This is happening for namenode as well. I tried finding an answer but unable to do so. This happened when I tried installing task tracker using apt-get.
1
vote
1 answer

X12 parsing using hadoop mapreduce

I have to parse x12 file using hadoop mapreduce code. Could some one please suggest me to how to do this? The parsed output should consumable by some other hadoop tool like hive Thanks, Rocto
user1321939
  • 319
  • 2
  • 6
  • 18
1
vote
0 answers

How to store and process Video data on HDFS hadoop

I have a video file.I have converted this video to set of Image frames with Xuggler now I have to read each frame of image and needs to do some processing. Say we got 2000 such images (i am using Xuggler- This converts Video to Image and then Image…
Karn_way
  • 1,005
  • 3
  • 19
  • 42
1
vote
3 answers

Not able to run Hadoop from eclipse saying Hadoop location in eclipse(Error:NULL)

I have downloaded Hadoop VM from Yahoo site and started Hadoop VM through VMware player. I saw no issues. As been mentioned in Yahoo, I made use of Eclipse Europa (v 3.3.1) and I downloaded a jar file (hadoop-0.18.3-eclipse-plugin) to make MapReduce…
Viswa
  • 1,357
  • 3
  • 18
  • 30
1
vote
1 answer

Hadoop v1.1.2 plug-in for Eclipse v4.3 (kepler) on Ubuntu12.10

I've downloaded the Hadoop v1.1.2 plugin for Eclipse from this site and have put it in the Eclipse plugins directory. The MapReduce view is available but I cannot include any 'org.apache.hadoop' libraries in my code - I get the following error; …
jastallard
  • 13
  • 1
  • 3
1
vote
1 answer

Hadoop webuser: No such user

While running a hadoop multi-node cluster , i got below error message on my master logs , can some advise what to do..? do i need to create a new user or can i gave my existing Machine user name over here 2013-07-25 19:41:11,765 WARN …