You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2011/05/06 00:19:03 UTC
[jira] [Created] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
--------------------------------------------------------------------------------
Key: MAPREDUCE-2476
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: build
Affects Versions: 0.20.203.1
Environment: Redhat 5.5, Java 6
Reporter: Eric Yang
Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029625#comment-13029625 ]
Koji Noguchi commented on MAPREDUCE-2476:
-----------------------------------------
In addition to Todd's point, do many users really need the features from capacity scheduler (and/or fair scheduler) ?
> Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2476
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: build
> Affects Versions: 0.20.203.1
> Environment: Redhat 5.5, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029636#comment-13029636 ]
Arun C Murthy commented on MAPREDUCE-2476:
------------------------------------------
-1
It's fine to ask the user the option for the scheduler: default, capacity, fair.
It can be improved further to ask for queues, capacities, max-capacities etc. for capacity-scheduler.
Similarly for pools etc. for fair-share.
> Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2476
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: build
> Affects Versions: 0.20.203.1
> Environment: Redhat 5.5, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029621#comment-13029621 ]
Todd Lipcon commented on MAPREDUCE-2476:
----------------------------------------
Why should the RPM/Deb install have a different default than the tarball?
If Capacity Scheduler should be the default, why is it part of contrib?
> Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2476
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: build
> Affects Versions: 0.20.203.1
> Environment: Redhat 5.5, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029638#comment-13029638 ]
Todd Lipcon commented on MAPREDUCE-2476:
----------------------------------------
(on the other hand I would probably support a long term vision of combining some of the features of capacity and fairshare and making the One Scheduler To Rule Them All part of core)
> Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2476
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: build
> Affects Versions: 0.20.203.1
> Environment: Redhat 5.5, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang reassigned MAPREDUCE-2476:
------------------------------------
Assignee: Eric Yang
> Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2476
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: build
> Affects Versions: 0.20.203.1
> Environment: Redhat 5.5, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-2476) Set mapreduce scheduler to
capacity scheduler for RPM/Debian packages by default
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy resolved MAPREDUCE-2476.
--------------------------------------
Resolution: Won't Fix
As I mentioned, we shouldn't do this.
I'm happy to have the configure script ask the user his option for the scheduler. The default should remain the 'fifo' scheduler.
I'm closing this jira. Please use a different one for enhancements along the line I suggested. Thanks.
> Set mapreduce scheduler to capacity scheduler for RPM/Debian packages by default
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2476
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2476
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: build
> Affects Versions: 0.20.203.1
> Environment: Redhat 5.5, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Hadoop RPM/Debian package is default to use the default scheduler. It would be nice to setup the packages to use capacity scheduler instead.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira