0

I am trying to configure and run a Hadoop Streaming job from Java (the system I'm working with wants the Hadoop jobs to be callable by Java method).

I did find the createJob method in org.apache.hadoop.streaming.StreamJob (http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/streaming/StreamJob.html#createJob(java.lang.String[])), but this method returns a JobConf object, which has been deprecated. Is there any way to create a Job object for streaming, or to convert the JobConf to a Job?

Zach
  • 1,263
  • 11
  • 25

1 Answers1

1

There are a few JIRA tickets about porting the Streaming code to support the new API, but to my knowledge it has yet to be made generally available

Note that even though the method of submitting old-api jobs using JobConf is deprecated, it's still supported in the latest 1.0.3 release of Hadoop.

Chris White
  • 29,949
  • 4
  • 71
  • 93
  • Wow, very disappointing that a patch for this was first submitted nearly 2 years ago, and it still hasn't made it into trunk. Thanks for this reference, though. – Zach Jun 22 '12 at 18:48