You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "qiuliang (JIRA)" <ji...@apache.org> on 2019/05/05 03:41:00 UTC
[jira] [Commented] (YARN-9437) RMNodeImpls occupy too much memory
and causes RM GC to take a long time
[ https://issues.apache.org/jira/browse/YARN-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833205#comment-16833205 ]
qiuliang commented on YARN-9437:
--------------------------------
Hi,[~eepayne],[~cheersyang],Could you please check my earlier comment and share your thoughts.
Thank you.
> RMNodeImpls occupy too much memory and causes RM GC to take a long time
> -----------------------------------------------------------------------
>
> Key: YARN-9437
> URL: https://issues.apache.org/jira/browse/YARN-9437
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager
> Affects Versions: 2.9.1
> Reporter: qiuliang
> Priority: Minor
> Attachments: 1.png, 2.png, 3.png, YARN-9437-v1.txt
>
>
> We use hadoop-2.9.1 in our production environment with 1600+ nodes. 95.63% of RM memory is occupied by RMNodeImpl. Analysis of RM memory found that each RMNodeImpl has approximately 14M. The reason is that there is a 130,000+ completedcontainers in each RMNodeImpl that has not been released.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org