0

I need to run a simple Java based deeplearning4j example in hadoop cluster and I found one here. My need to specify the input from command line (which should be a path on HDFS) and output should go to HDFS, for later view

However, in the example there is no mention, it is hard coding the input from local file system and output goes to local file system.

Can anyone help me here?

CuriousMind
  • 8,301
  • 22
  • 65
  • 134

1 Answers1

1

Maybe some combination of this recent pull request on our examples: https://github.com/deeplearning4j/dl4j-examples/pull/384

and Spring-hadoop could help you? http://projects.spring.io/spring-hadoop/

I mean conceptually all you'd do is change the file system type.

The FileSystem api in hadoop can point to either local or an hdfs url so there shouldn't be much change.

Adam Gibson
  • 3,055
  • 1
  • 10
  • 12