0

I'm trying to add a new scheduler in Hadoop. Its not the default ones (FairScheduler/CapacityScheduler). I checked out the source with svn. Now, which source file/class should I edit to get this functionality?

Sreejith Ramakrishnan
  • 1,332
  • 2
  • 13
  • 22

1 Answers1

1

You should extend the class TaskScheduler in order to write your own scheduler. Once done, you can plug it in your code via the JobTracker property mapred.jobtracker.taskScheduler. You can find TaskScheduler inside org.apache.hadoop.mapred.

HTH

Tariq
  • 34,076
  • 8
  • 57
  • 79
  • I think Jar of the created scheduler is needed.... I have my scheduler code but dont know how to create jar of this scheduler and where to put in hadoop source folder(o.20.0 version). Can you help me with this – Rushikesh Garadade May 09 '14 at 14:45
  • 1
    This answer is for Hadoop 1. For Hadoop 2 and newer, you need to customize org.apache.hadoop.yarn.resourcemanager.scheduler. – Erkin Alp Güney Oct 03 '18 at 17:49