[jira] Updated: (HADOOP-5090) The capacity-scheduler should assign multiple tasks per heartbeat

["Vinod K V (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod K V updated HADOOP-5090:
------------------------------

    Attachment: HADOOP-5090-20090504.txt

Attaching patch. With this patch, CapacityTaskScheduler assigns multiple tasks in a single heartbeat. It assigns multiple maps just like the default scheduler - multiple local tasks and at-most one off-switch tasks; and multiple reduces. It also keeps track of the tasks decided to be assigned in a particular scheduling iteration so as that high memory jobs are blocked for scheduling and user-limits are respected while giving away multiple tasks.

The patch also has test-cases. Benchmarking is in progress.

> The capacity-scheduler should assign multiple tasks per heartbeat
> -----------------------------------------------------------------
>
>                 Key: HADOOP-5090
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5090
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>            Reporter: Arun C Murthy
>            Priority: Critical
>         Attachments: HADOOP-5090-20090504.txt
>
>
> HADOOP-3136 changed the default o.a.h.mapred.JobQueueTaskScheduler to assign multiple tasks per TaskTracker heartbeat, the capacity-scheduler should do the same.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.