You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Patrick Wendell (Created) (JIRA)" <ji...@apache.org> on 2011/12/27 02:02:30 UTC
[jira] [Created] (MAPREDUCE-3600) Add Minimal Fair Scheduler to MR2
Add Minimal Fair Scheduler to MR2
---------------------------------
Key: MAPREDUCE-3600
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3600
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Reporter: Patrick Wendell
Assignee: Patrick Wendell
This covers the addition of the Fair Scheduler to the MR2 infrastructure. This patch will represent the minimum functional FairScheduler in MR2. It will be limited to a configuration file reader, functionality to calculate fair shares, and hooks into the actual MR2 scheduling code.
It will not include delay scheduling, preemption, or a web UI, which will be handled in separate JIRA's.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3600) Add Minimal Fair Scheduler to MR2
Posted by "Patrick Wendell (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated MAPREDUCE-3600:
---------------------------------------
Attachment: MAPREDUCE-3600.v1.patch
This is a preliminary patch including basic FairScheduling functionality and tests. Would benefit from review by anyone familiar with existing MR2 RM and scheduling code.
I had some trouble running dev-support/test-patch.sh (it wanted to build and examine every sub-project which was taking > 1 hour). Any advise on how to use that tool with a narrower scope is appreciated.
> Add Minimal Fair Scheduler to MR2
> ---------------------------------
>
> Key: MAPREDUCE-3600
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3600
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3600.v1.patch
>
>
> This covers the addition of the Fair Scheduler to the MR2 infrastructure. This patch will represent the minimum functional FairScheduler in MR2. It will be limited to a configuration file reader, functionality to calculate fair shares, and hooks into the actual MR2 scheduling code.
> It will not include delay scheduling, preemption, or a web UI, which will be handled in separate JIRA's.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3600) Add Minimal Fair Scheduler to MR2
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3600:
-------------------------------------
Component/s: mrv2
> Add Minimal Fair Scheduler to MR2
> ---------------------------------
>
> Key: MAPREDUCE-3600
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3600
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2, scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3600.v1.patch, MAPREDUCE-3600.v2.patch
>
>
> This covers the addition of the Fair Scheduler to the MR2 infrastructure. This patch will represent the minimum functional FairScheduler in MR2. It will be limited to a configuration file reader, functionality to calculate fair shares, and hooks into the actual MR2 scheduling code.
> It will not include delay scheduling, preemption, or a web UI, which will be handled in separate JIRA's.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3600) Add Minimal Fair Scheduler to MR2
Posted by "Patrick Wendell (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated MAPREDUCE-3600:
---------------------------------------
Attachment: MAPREDUCE-3600.v2.patch
removing one piece of cruft from previous patch.
> Add Minimal Fair Scheduler to MR2
> ---------------------------------
>
> Key: MAPREDUCE-3600
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3600
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3600.v1.patch, MAPREDUCE-3600.v2.patch
>
>
> This covers the addition of the Fair Scheduler to the MR2 infrastructure. This patch will represent the minimum functional FairScheduler in MR2. It will be limited to a configuration file reader, functionality to calculate fair shares, and hooks into the actual MR2 scheduling code.
> It will not include delay scheduling, preemption, or a web UI, which will be handled in separate JIRA's.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3600) Add Minimal Fair Scheduler to
MR2
Posted by "Patrick Wendell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell resolved MAPREDUCE-3600.
----------------------------------------
Resolution: Fixed
Fixed by parent ticket.
> Add Minimal Fair Scheduler to MR2
> ---------------------------------
>
> Key: MAPREDUCE-3600
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3600
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2, scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3600.v1.patch, MAPREDUCE-3600.v2.patch
>
>
> This covers the addition of the Fair Scheduler to the MR2 infrastructure. This patch will represent the minimum functional FairScheduler in MR2. It will be limited to a configuration file reader, functionality to calculate fair shares, and hooks into the actual MR2 scheduling code.
> It will not include delay scheduling, preemption, or a web UI, which will be handled in separate JIRA's.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira