0

I learned to create job flows through command line interface. I am using amazon elastic mapreduce cli to create and run job flows. My doubt is that I want to place my source files into the master node from s3 bucket using Bootstrap actions at creation time of the job flows created. I am using Pig Program in interactive mode to run my job flows .

I read documents for bootstrap actions but those things was not clear to me.

Thanks in advance can any one tell me how to copy my files from s3 bucket to the master node by using Bootstrap actions.

Prabhu
  • 840
  • 11
  • 28

1 Answers1

1

Bootstrap actions are just standard unix scripts. Ensure the shebang points to an interpreter on the machines in your cluster and you're good to go.

When you say source files do you mean your pig scripts? These can be ran directly off s3. If you are talking about data, you should read these directly off s3 unless you have a use case for copying to the cluster first(like scanning the same data multiple times)

prestomation
  • 7,225
  • 3
  • 39
  • 37
  • Thanks @prestomation I have some source codes with python to perform a job. I want to place the source files into the master node and I want to ran the python script to run the job flow automatically each day. – Prabhu Jul 27 '13 at 11:40