setting up configuration in mrunit

Question

I have been searching in mrunit documentation but hasnt been able to find it so far.. How do i pass configuration parameters in my mrunit.

So for example, if i take the wordcount example.

Lets say, in my driver code I am setting this parameter...

conf.set("delimiter",args[2])

And in my mapper code I am calling this as:

String delimiter = conf.get("delimiter");
String [] tokens = value.toString().split(delimiter);
for (String token:tokens)
   context.write(token,one);

How do I set up this configuration parameter.

I have been looking into this example: https://github.com/wpm/Hadoop-Word-Count/blob/master/src/test/java/wpmcn/hadoop/WordCountTest.java

Thanks

score 2 · Answer 1 · answered Oct 27 '13 at 03:14

2

Use MapDriver.withConfiguration

 Configuration conf = new Configuration();
 conf.set("delimiter", someValue);
 myMapDriver.withConfiguration(conf);

answered Oct 27 '13 at 03:14

John B

32,493
6
77
98

`withConfiguration` is now deprecated in new version. – Gyanendra Dwivedi Nov 23 '16 at 08:57

score 1 · Answer 2 · answered Nov 23 '16 at 09:01

I had similar problem and I solved it as given in below code.

mapDriver.withInput(key, value);
mapDriver.getConfiguration().set("my.config.param", "my.config.param.value");
.....
.....
mapDriver.run();

Please note that mapDriver.getContext().getConfiguration may not work in this case, because the context object is a mocked object in the API.

setting up configuration in mrunit

2 Answers2