You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Patrick Wendell (Updated) (JIRA)" <ji...@apache.org> on 2012/01/04 01:50:39 UTC

[jira] [Updated] (MAPREDUCE-3601) Add Delay Scheduling to MR2 Fair Scheduler

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Patrick Wendell updated MAPREDUCE-3601:
---------------------------------------

    Attachment: MAPREDUCE-3601.v1.patch

Attached is a patch to implement delay scheduling in MR2, similar to how delay scheduling works in the MR1 Fair Scheduler. 

This patch allows schedulers to triage locality levels from node-local, to rack-local, to off-switch requests over time. In the Fair schedulers, users can configure a threshold to dictate when this relaxation happens.

The Capacity Scheduler is left untouched (it currently uses a separate heuristic to failover to off-switch scheduling).

This patch assumes the patch attached to MAPREDUCE-3600 has already been applied.



                
> Add Delay Scheduling to MR2 Fair Scheduler
> ------------------------------------------
>
>                 Key: MAPREDUCE-3601
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3601
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: scheduler
>            Reporter: Patrick Wendell
>            Assignee: Patrick Wendell
>         Attachments: MAPREDUCE-3601.v1.patch
>
>
> JIRA for delay scheduling component.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira