Questions tagged [hadoop-plugins]

Plugins for the Apache™ Hadoop™ project.

Plugins for the Apache™ Hadoop™ project.

141 questions
1
vote
1 answer

How to set the preferences to run PIG script in Eclipse?

I downloaded and installed the pigpen plugin in my eclipse, i followed the steps from this link) but it little bit confusing when I set the Pig's ConfigurationPath. can anyone tell me how to set the preferences to run the pig scripts in eclipse. I…
Prabhu
  • 840
  • 11
  • 28
1
vote
1 answer

pig installation in windows using cygwin

I am using cygwin in windows xp to install pig-0.11.1.I extracted and placed my pig_home folder in user directory of cygwin.When i try commanding in prompt ./pig help, it shows me the following error. which: no hadoop in…
user2082765
  • 41
  • 1
  • 1
  • 4
1
vote
2 answers

How to get completed job's statistics executed by Hadoop?

When we run data intensive job over Hadoop. Hadoop executes the job. Now what i want is when the job is completed. it will give me the statistics regarding executed job i.e; time consumed, mapper quantity, reducer quantity and other useful…
Khizar Ali
  • 486
  • 2
  • 12
  • 26
1
vote
0 answers

Run time environment for Hadoop Pig

I am building a hadoop pig editor, similar like sql editor where user can write execute their pig command, and view history of commands executed.There is intelligence as well. I need to know how do i parse my pig command and run it. Thanks in…
Pavan Tiwari
  • 3,077
  • 3
  • 31
  • 71
1
vote
1 answer

Hadoop configuration using both MongoDB and MySQL

any one can give sample code from mongodb to rdbs ... I tried already , fetching data from mongodb and output store in mongodb.For that i knew how to do hadoop configuration in java job. And i want to know three things... which hadoop version…
Coe Lnt
  • 31
  • 4
1
vote
1 answer

Eclipse MapReduce plugin Error: Server IPC version 7 cannot cannot communicate with client version 3

When I try to connect to MapReduce location which is cluster with one namenode and datanode from my laptop (where I have my eclipse and mapreduce plugin) I get the Error: Server IPC version 7 cannot cannot communicate with client version 3. I tried…
FourOfAKind
  • 2,298
  • 5
  • 31
  • 34
1
vote
2 answers

Is it possible to use several jars to specify job in hadoop?

I usually have common/shared libraries and actual job code in different jar files. Is it possible to recompile only one job jar file to execute hadoop command hadoop jar asd? If not is there workaround to simplify jar packaging?
yura
  • 14,489
  • 21
  • 77
  • 126
1
vote
1 answer

How can I compile custom hadoop native codec to libhadoop.so?

I have written a native hadoop compression codec. To let it work with hadoop I need to compile native (C code) it to libhadoop.so. How can I achieve this?
samarth
  • 3,866
  • 7
  • 45
  • 60
0
votes
1 answer

hadoop with mongodb plugin - read data

I know that it is possible read and write data from mongodb via hadoop. I want know if this adapter when read data from mongodb collection use native driver of mongodb, so it use mongod instance or this adapter read directy data collection? Also…
paganotti
  • 5,591
  • 8
  • 37
  • 49
0
votes
2 answers

how to access and manipulate pdf file's datas in Hadoop?

I want to read the PDF file using hadoop, how it is possible? I only know that hadoop can process only txt files, so is there anyway to parse the PDF files to txt. Give me some suggestion.
Balaji
  • 757
  • 7
  • 16
0
votes
1 answer

Integrate Map/Reducer and Java Project Eclipse

I have a Java Project & Map/Reducer Project in eclipse Workspace, I want to use a class file of Map/Reducer Project from java project to perform computation, I am new to Apache Hadoop & Map/Reducer thing, please Suggest.
Vardan Gupta
  • 3,505
  • 5
  • 31
  • 40
0
votes
1 answer

In Hadoop how to handle daily increasing data

In Hadoop how to handle daily increasing data: For example: 1st day I may have 1 million files in some input folder (e.g. hadoop/demo) 2nd day in the same folder, files may increase from existing 1 million files + another new 1 million files so…
Balaji
  • 757
  • 7
  • 16
0
votes
1 answer

Building hadoop mapreduce in Eclipse indigo

I can't compile Hadoop MapReduce on Eclipse. Can anyone help me?
pm3310
  • 119
  • 1
  • 2
  • 9
0
votes
1 answer

hadoop plugin for eclipse

I downloaded and setup hadoop-cdh3u2 from cloudera. inside hadoop-0.20.2-cdh3u2/src/contrib i found a project called "eclipse-plugin" and I imported it in eclipse, got error, and added hadoop-core.jar runed as a eclipse application, but i can't add…
Nageswaran
  • 7,481
  • 14
  • 55
  • 74
0
votes
1 answer

hadoop mapreduce error

I am facing some ERROR when i am runnig hadoop on map reduce environment in eclipse error, An internal error occurred during:"Refresh DFS Children". org.eclipse.team.internal.ccvs.ssh2.CVSSSH2Plugin.get PreferenceStore()Lorg…