2

Through the UI Amazon's framework allows me to create jobs with multiple inputs by specifying multiple --input lines. e.g.:

-input s3n://something -input s3n://something-else

Similarly the Ruby EMR client has been very helpful to me so far: http://aws.amazon.com/developertools/2264

However, I'm trying to script a nightly job that requires multiple inputs and I can't seem to find any way to do this. It won't let me pass multiple -input parameters and when I use --arg or --args the job that is created does not contain the -input lines. It is almost as if it is stripping it out.

Has anybody used this tool for this purpose successfully?

henry
  • 1,716
  • 3
  • 15
  • 27

1 Answers1

5

Turns out you do use --args but it has to follow the --stream or --bootstrap-action options. It can't be tacked on to the end of the commandline:

http://www.henrycipolla.com/blog/2011/09/how-to-create-an-emr-job-with-multiple-inputs-using-the-ruby-client/

--Henry

henry
  • 1,716
  • 3
  • 15
  • 27