You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Patrick Wendell (Created) (JIRA)" <ji...@apache.org> on 2011/12/27 02:02:30 UTC
[jira] [Created] (MAPREDUCE-3601) Add Delay Scheduling to MR2 Fair
Scheduler
Add Delay Scheduling to MR2 Fair Scheduler
------------------------------------------
Key: MAPREDUCE-3601
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3601
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Reporter: Patrick Wendell
JIRA for delay scheduling component.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3601) Add Delay Scheduling to MR2 Fair
Scheduler
Posted by "Patrick Wendell (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell reassigned MAPREDUCE-3601:
------------------------------------------
Assignee: Patrick Wendell
> Add Delay Scheduling to MR2 Fair Scheduler
> ------------------------------------------
>
> Key: MAPREDUCE-3601
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3601
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
>
> JIRA for delay scheduling component.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3601) Add Delay Scheduling to MR2 Fair
Scheduler
Posted by "Patrick Wendell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell resolved MAPREDUCE-3601.
----------------------------------------
Resolution: Fixed
Fixed with parent ticket.
> Add Delay Scheduling to MR2 Fair Scheduler
> ------------------------------------------
>
> Key: MAPREDUCE-3601
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3601
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3601.v1.patch
>
>
> JIRA for delay scheduling component.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3601) Add Delay Scheduling to MR2 Fair
Scheduler
Posted by "Patrick Wendell (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated MAPREDUCE-3601:
---------------------------------------
Attachment: MAPREDUCE-3601.v1.patch
Attached is a patch to implement delay scheduling in MR2, similar to how delay scheduling works in the MR1 Fair Scheduler.
This patch allows schedulers to triage locality levels from node-local, to rack-local, to off-switch requests over time. In the Fair schedulers, users can configure a threshold to dictate when this relaxation happens.
The Capacity Scheduler is left untouched (it currently uses a separate heuristic to failover to off-switch scheduling).
This patch assumes the patch attached to MAPREDUCE-3600 has already been applied.
> Add Delay Scheduling to MR2 Fair Scheduler
> ------------------------------------------
>
> Key: MAPREDUCE-3601
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3601
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3601.v1.patch
>
>
> JIRA for delay scheduling component.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira