You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2011/12/02 21:09:40 UTC
[jira] [Created] (MAPREDUCE-3504) capacity scheduler allow capacity
greater then 100% as long as its less then 101%
capacity scheduler allow capacity greater then 100% as long as its less then 101%
---------------------------------------------------------------------------------
Key: MAPREDUCE-3504
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3504
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/capacity-sched
Affects Versions: 0.20.205.0
Reporter: Thomas Graves
When sum of all capacities >=101 or <100, we got the following error when starting jobtracker. However, when the 100 <= sum < 101, jobtracker does not report exception and started with all queues initialized.
for instance (capacity sum = 29.5+60+11.4 = 100.9) does not cause exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3504) capacity scheduler allow capacity
greater then 100% as long as its less then 101%
Posted by "Bh V S Kamesh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bh V S Kamesh updated MAPREDUCE-3504:
-------------------------------------
Status: Patch Available (was: Open)
> capacity scheduler allow capacity greater then 100% as long as its less then 101%
> ---------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3504
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3504
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.205.0
> Reporter: Thomas Graves
> Attachments: MAPREDUCE-3504-1.patch, MAPREDUCE-3504.patch
>
>
> When sum of all capacities >=101 or <100, we got the following error when starting jobtracker. However, when the 100 <= sum < 101, jobtracker does not report exception and started with all queues initialized.
> for instance (capacity sum = 29.5+60+11.4 = 100.9) does not cause exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3504) capacity scheduler allow
capacity greater then 100% as long as its less then 101%
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170236#comment-13170236 ]
Hadoop QA commented on MAPREDUCE-3504:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12507349/MAPREDUCE-3504-1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1459//console
This message is automatically generated.
> capacity scheduler allow capacity greater then 100% as long as its less then 101%
> ---------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3504
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3504
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.205.0
> Reporter: Thomas Graves
> Attachments: MAPREDUCE-3504-1.patch, MAPREDUCE-3504.patch
>
>
> When sum of all capacities >=101 or <100, we got the following error when starting jobtracker. However, when the 100 <= sum < 101, jobtracker does not report exception and started with all queues initialized.
> for instance (capacity sum = 29.5+60+11.4 = 100.9) does not cause exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3504) capacity scheduler allow capacity
greater then 100% as long as its less then 101%
Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-3504:
------------------------------------------------------
Affects Version/s: 1.0.0
> capacity scheduler allow capacity greater then 100% as long as its less then 101%
> ---------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3504
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3504
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.205.0, 1.0.0
> Reporter: Thomas Graves
> Attachments: MAPREDUCE-3504-1.patch, MAPREDUCE-3504.patch
>
>
> When sum of all capacities >=101 or <100, we got the following error when starting jobtracker. However, when the 100 <= sum < 101, jobtracker does not report exception and started with all queues initialized.
> for instance (capacity sum = 29.5+60+11.4 = 100.9) does not cause exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3504) capacity scheduler allow capacity
greater then 100% as long as its less then 101%
Posted by "Bh V S Kamesh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bh V S Kamesh updated MAPREDUCE-3504:
-------------------------------------
Attachment: MAPREDUCE-3504.patch
Sanity check has been done using *Math.floor* to verify totalCapacityPercent is 100 or not. This is causing the problem.
Attached patch which does comparision using *Double.compare*
> capacity scheduler allow capacity greater then 100% as long as its less then 101%
> ---------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3504
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3504
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.205.0
> Reporter: Thomas Graves
> Attachments: MAPREDUCE-3504.patch
>
>
> When sum of all capacities >=101 or <100, we got the following error when starting jobtracker. However, when the 100 <= sum < 101, jobtracker does not report exception and started with all queues initialized.
> for instance (capacity sum = 29.5+60+11.4 = 100.9) does not cause exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3504) capacity scheduler allow capacity
greater then 100% as long as its less then 101%
Posted by "Bh V S Kamesh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bh V S Kamesh updated MAPREDUCE-3504:
-------------------------------------
Attachment: MAPREDUCE-3504-1.patch
Patch containing testcase
> capacity scheduler allow capacity greater then 100% as long as its less then 101%
> ---------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3504
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3504
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.20.205.0
> Reporter: Thomas Graves
> Attachments: MAPREDUCE-3504-1.patch, MAPREDUCE-3504.patch
>
>
> When sum of all capacities >=101 or <100, we got the following error when starting jobtracker. However, when the 100 <= sum < 101, jobtracker does not report exception and started with all queues initialized.
> for instance (capacity sum = 29.5+60+11.4 = 100.9) does not cause exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira