I downloaded and installed the pigpen plugin in my eclipse, i followed the steps from this
link)
but it little bit confusing when I set the Pig's ConfigurationPath.
can anyone tell me how to set the preferences to run the pig scripts in eclipse. I…
I am using cygwin in windows xp to install pig-0.11.1.I extracted and placed my pig_home folder in user directory of cygwin.When i try commanding in prompt ./pig help, it shows me the following error.
which: no hadoop in…
When we run data intensive job over Hadoop. Hadoop executes the job.
Now what i want is when the job is completed. it will give me the statistics regarding
executed job i.e; time consumed, mapper quantity, reducer quantity and other useful…
I am building a hadoop pig editor, similar like sql editor where user can write execute their pig command, and view history of commands executed.There is intelligence as well.
I need to know how do i parse my pig command and run it.
Thanks in…
any one can give sample code from mongodb to rdbs ... I tried already , fetching data from mongodb and output store in mongodb.For that i knew how to do hadoop configuration in java job.
And i want to know three things...
which hadoop version…
When I try to connect to MapReduce location which is cluster with one namenode and datanode from my laptop (where I have my eclipse and mapreduce plugin) I get the Error: Server IPC version 7 cannot cannot communicate with client version 3. I tried…
I usually have common/shared libraries and actual job code in different jar files. Is it possible to recompile only one job jar file to execute hadoop command hadoop jar asd?
If not is there workaround to simplify jar packaging?
I have written a native hadoop compression codec. To let it work with hadoop I need to compile native (C code) it to libhadoop.so.
How can I achieve this?
I know that it is possible read and write data from mongodb via hadoop.
I want know if this adapter when read data from mongodb collection use native driver of mongodb, so it use mongod instance or this adapter read directy data collection?
Also…
I want to read the PDF file using hadoop, how it is possible?
I only know that hadoop can process only txt files, so is there anyway to parse the PDF files to txt.
Give me some suggestion.
I have a Java Project & Map/Reducer Project in eclipse Workspace, I want to use a class file of Map/Reducer Project from java project to perform computation, I am new to Apache Hadoop & Map/Reducer thing, please Suggest.
In Hadoop how to handle daily increasing data:
For example:
1st day I may have 1 million files in some input folder (e.g. hadoop/demo)
2nd day in the same folder, files may increase from existing 1 million files + another new 1 million files so…
I downloaded and setup hadoop-cdh3u2 from cloudera. inside hadoop-0.20.2-cdh3u2/src/contrib i found a project called "eclipse-plugin" and I imported it in eclipse, got error, and added hadoop-core.jar runed as a eclipse application, but i can't add…
I am facing some ERROR when i am runnig hadoop on map reduce environment in eclipse error,
An internal error occurred during:"Refresh DFS Children".
org.eclipse.team.internal.ccvs.ssh2.CVSSSH2Plugin.get PreferenceStore()Lorg…