Search code examples
hadoopschedulerhadoop-plugins

How to Add a New Scheduler in Hadoop?

I'm trying to add a new scheduler in Hadoop. Its not the default ones (FairScheduler/CapacityScheduler). I checked out the source with svn. Now, which source file/class should I edit to get this functionality?

Solution

  • You should extend the class TaskScheduler in order to write your own scheduler. Once done, you can plug it in your code via the JobTracker property mapred.jobtracker.taskScheduler. You can find TaskScheduler inside org.apache.hadoop.mapred.

    HTH