You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Haibo Chen (JIRA)" <ji...@apache.org> on 2018/10/18 20:51:00 UTC
[jira] [Commented] (YARN-8911) NM incorrectly account for container
cpu utilization by their number of vcores
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655859#comment-16655859 ]
Haibo Chen commented on YARN-8911:
----------------------------------
CC [~asuresh] We found this during functional testing of YARN-1011 with fair scheduler.
> NM incorrectly account for container cpu utilization by their number of vcores
> ------------------------------------------------------------------------------
>
> Key: YARN-8911
> URL: https://issues.apache.org/jira/browse/YARN-8911
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Reporter: Haibo Chen
> Assignee: Haibo Chen
> Priority: Major
> Attachments: YARN-8911.00.patch
>
>
> ResourceUtilization represents the cpu utilization with a float number in [0, 1.0], i.e. the percentage of cpu usage across the node. However, when Containers Monitor tracks the total aggregate resource utilization of all containers, it adds up the total number of vcores used by all running containers.
>
> (If you have 6 containers running, each consuming 1 vcore, you'd see the aggregated cpu container utilization being 6.0, but it's supposed to be always between 0 and 1.0) See [the code|https://github.com/apache/hadoop/blob/beb850d8f7f1fefa7a6d9502df2b4a4eea372523/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java#L672]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org