0

How do u make sure only 4 map and 2 reduce are there because when i use 1 large instance it sometimes give me 6 map 2 reduce random no. i tried putting mapred.map.tasks=4 in the extra args while settingup the job that also didn`t work

RamPrasadBismil
  • 579
  • 2
  • 10
  • 30

1 Answers1

0

Try to set number of mapper and reducers with bootstrap action.

     elastic-mapreduce --create \
     --name "cluster_name" \
     --bootstrap-action s3://elasticmapreduce/bootstrap-actions/configure-hadoop --args -m,mapred.map.tasks=4,-m,mapred.reduce.tasks=2,-m,mapred.tasktracker.map.tasks.maximum=4,-m,mapred.tasktracker.reduce.tasks.maximum=2
mat_vee
  • 85
  • 1
  • 10