You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (Created) (JIRA)" <ji...@apache.org> on 2012/01/05 20:54:40 UTC
[jira] [Created] (MAPREDUCE-3625) CapacityScheduler web-ui display
of queue's used capacity is broken
CapacityScheduler web-ui display of queue's used capacity is broken
-------------------------------------------------------------------
Key: MAPREDUCE-3625
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Thomas Graves
Assignee: Jason Lowe
Priority: Critical
Fix For: 0.23.1
The resource manager web ui page for scheduler doesn't have all the information about the configuration like the jobtracker page used to have. The things it seems to show you are the current queues - each queues used, set, and max percent and then what apps are running in that queue.
It doesn't list any of yarn.scheduler.capacity.maximum-applications, yarn.scheduler.capacity.maximum-am-resource-percent, yarn.scheduler.capacity.<queue-path>.user-limit-factor, yarn.scheduler.capacity.<queue-path>.minimum-user-limit-percent, queue state, active users and percent used by user
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184613#comment-13184613 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #360 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/360/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev) - Merging r1230336 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230338
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184933#comment-13184933 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #158 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/158/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev) - Merging r1230336 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230338
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3625) CapacityScheduler web-ui display
of queue's used capacity is broken
Posted by "Jason Lowe (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-3625:
----------------------------------
Attachment: CapacityScheduler.png
Based on discussions with Arun, we decided to rework the UI a bit. Attached is a sample screenshot of new capacity scheduler UI.
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184619#comment-13184619 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #370 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/370/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev) - Merging r1230336 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230338
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184618#comment-13184618 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1606 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1606/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230336
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Jason Lowe (Work started) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on MAPREDUCE-3625 started by Jason Lowe.
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184574#comment-13184574 ]
Mahadev konar commented on MAPREDUCE-3625:
------------------------------------------
+1 for the patch. I tried it out, and it looks good. THe only issue I had was when refreshing the CS page it shows some application status (for a very short time) before it renders again. I guess this is an issue with all the pages. We'll have to see how we can fix that.
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Jason Lowe (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182857#comment-13182857 ]
Jason Lowe commented on MAPREDUCE-3625:
---------------------------------------
Findbugs warnings are unrelated to this patch.
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3625) CapacityScheduler web-ui display
of queue's used capacity is broken
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3625:
-------------------------------------
Description:
The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
was:
The resource manager web ui page for scheduler doesn't have all the information about the configuration like the jobtracker page used to have. The things it seems to show you are the current queues - each queues used, set, and max percent and then what apps are running in that queue.
It doesn't list any of yarn.scheduler.capacity.maximum-applications, yarn.scheduler.capacity.maximum-am-resource-percent, yarn.scheduler.capacity.<queue-path>.user-limit-factor, yarn.scheduler.capacity.<queue-path>.minimum-user-limit-percent, queue state, active users and percent used by user
Affects Version/s: (was: 0.24.0)
Reporter: Arun C Murthy (was: Thomas Graves)
Fix Version/s: (was: 0.23.1)
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184594#comment-13184594 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #381 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/381/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev) - Merging r1230336 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230338
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3625) CapacityScheduler web-ui display
of queue's used capacity is broken
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3625:
-------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
Target Version/s: 0.23.1, 0.24.0 (was: 0.24.0, 0.23.1)
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Just committed this. Thanks Jason!
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184944#comment-13184944 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #956 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/956/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230336
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182846#comment-13182846 ]
Hadoop QA commented on MAPREDUCE-3625:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12509960/MAPREDUCE-3625.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1573//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1573//artifact/trunk/hadoop-mapreduce-project/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1573//console
This message is automatically generated.
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184635#comment-13184635 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1551 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1551/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230336
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184910#comment-13184910 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #136 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/136/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev) - Merging r1230336 from trunk.
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230338
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184624#comment-13184624 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1533 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1533/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230336
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3625) CapacityScheduler web-ui
display of queue's used capacity is broken
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13184898#comment-13184898 ]
Hudson commented on MAPREDUCE-3625:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #923 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/923/])
MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1230336
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesCapacitySched.java
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3625) CapacityScheduler web-ui display
of queue's used capacity is broken
Posted by "Jason Lowe (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-3625:
----------------------------------
Attachment: MAPREDUCE-3625.patch
Patch reworks capacity scheduler UI to fix the reported problem and make the UI a bit easier to read in general.
Green now represents used capacity instead of spare capacity and always grows from left to right. The color of the bar changes to orange if the used capacity goes over 100%, and it doesn't streak off the right end of the page as it did previously.
Also added a legend so it's clear what the colors indicate and added a used capacity column for quick reference.
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3625) CapacityScheduler web-ui display
of queue's used capacity is broken
Posted by "Jason Lowe (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-3625:
----------------------------------
Target Version/s: 0.23.1, 0.24.0 (was: 0.23.1)
Status: Patch Available (was: In Progress)
> CapacityScheduler web-ui display of queue's used capacity is broken
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-3625
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3625
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Jason Lowe
> Priority: Critical
> Attachments: CapacityScheduler.png, MAPREDUCE-3625.patch
>
>
> The display of the queue's used capacity at runtime is broken because it display's 'used' relative to the queue's capacity and not the parent's capacity as shown in the above attachment.
> The display should be relative to parent's capacity and not leaf queues as everything else in the display is relative to parent's capacity.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira