1

Why is the R Mapreduce library 'rmr2' generating a warning message ?

I have installed 'rmr2' library to execute Mapreduce programs in R. But when

library(rmr2)

is specified in R, it generates the following warning message:

Please review your hadoop settings. See help(hadoop.settings)
Warning message:
S3 methods ‘gorder.default’, ‘gorder.factor’, ‘gorder.data.frame’,  ‘gorder.matrix’, ‘gorder.raw’ 
were declared in NAMESPACE but not found 

What could be the reason ?

User456898
  • 5,704
  • 5
  • 21
  • 37
  • I am not sure and I wrote the thing. `gorder` is a generic used in test only, so no worries about this, but yes, I'd love to make that go away too. Pull requests welcome. – piccolbo Apr 16 '15 at 19:44
  • @piccolbo: So the 'gorder' messages won't affect the program execution in any way right ? – User456898 Apr 17 '15 at 04:36
  • 1
    Well, "the program" is a little vague, but no, in general this should be of no consequence. gorder is only used in the tests and the tests pass. – piccolbo Apr 17 '15 at 15:41
  • Thanks piccolbo for the help :) – User456898 Apr 20 '15 at 04:23

2 Answers2

3

The main reason, you didn't include the path. before run library(rmr2), you must include the given 4 paths to prevent these type warnings.

Sys.setenv(HADOOP_HOME="/home/hadoop/hadoop-1.1.2") //Its hadooop path

Sys.setenv(HADOOP_CMD="/home/hadoop/hadoop-1.1.2/bin/hadoop") //It's CMD path

Sys.setenv(HADOOP_STREAMING="/home/hadoop/work/hadoop-1.1.2/contrib/streaming/hadoop-streaming-1.1.2.jar") //It's streaming path

Sys.setenv(JAVA_HOME="/usr/lib/jvm/java-1.6.0-openjdk-amd64") //Java path it is.

Than you include library(rmr2) and library(rhdfs) to do further process. All the best.

Venu A Positive
  • 2,992
  • 2
  • 28
  • 31
1

I think you didn't write the paths as it should be:

HADOOP_CMD='/usr/local/hadoop-2.7.2/bin/hadoop' HADOOP_STREAMING='/usr/local/hadoop-2.7.2/share/hadoop/tools/lib/hadoop-streaming-2.7.2.jar' HADOOP_HOME='/usr/local/hadoop-2.7.2'

the '' are very important, check if you forgot them.

manie
  • 355
  • 1
  • 5
  • 13