You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2018/06/25 01:51:00 UTC
[jira] [Commented] (YARN-8443) Total #VCores in cluster metrics is
wrong when CapacityScheduler reserved some containers
[ https://issues.apache.org/jira/browse/YARN-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521763#comment-16521763 ]
Hudson commented on YARN-8443:
------------------------------
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14472 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14472/])
YARN-8443. Total #VCores in cluster metrics is wrong when (wwei: rev 440140cea6718229094a3d2b97b9b9bd28b95d9b)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/ClusterMetricsInfo.java
> Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers
> -----------------------------------------------------------------------------------------
>
> Key: YARN-8443
> URL: https://issues.apache.org/jira/browse/YARN-8443
> Project: Hadoop YARN
> Issue Type: Bug
> Components: webapp
> Affects Versions: 2.9.0, 3.1.0, 3.2.0
> Reporter: Tao Yang
> Assignee: Tao Yang
> Priority: Major
> Fix For: 3.2.0, 3.1.1, 3.0.4
>
> Attachments: YARN-8443.001.patch
>
>
> Cluster metrics on the web UI will give wrong Total Vcores when there is reserved container for CapacityScheduler.
> Reference code:
> {code:java|title=ClusterMetricsInfo.java}
> if (rs instanceof CapacityScheduler) {
> CapacityScheduler cs = (CapacityScheduler) rs;
> this.totalMB = availableMB + allocatedMB + reservedMB;
> this.totalVirtualCores =
> availableVirtualCores + allocatedVirtualCores + containersReserved;
> ...
> }
> {code}
> The key of this problem is the calculation of totalVirtualCores, {{containersReserved}} is the number of reserved containers, not reserved VCores. The correct calculation expression of totalVirtualCores should be (availableVirtualCores + allocatedVirtualCores + reservedVirtualCores)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org