You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2016/07/08 20:49:11 UTC

[jira] [Created] (YARN-5341) Nodemanager leaks ContainerResource names in UniqueNames for each container

Jason Lowe created YARN-5341:
--------------------------------

             Summary: Nodemanager leaks ContainerResource names in UniqueNames for each container
                 Key: YARN-5341
                 URL: https://issues.apache.org/jira/browse/YARN-5341
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.7.2
            Reporter: Jason Lowe
            Priority: Critical


Ran across a nodemanager that was spending most of its time in GC.  Upon examination of the heap most of the memory was going to the map of names in org.apache.hadoop.metrics2.lib.UniqueNames.  In this case the map had almost 2 million entries.  Looking at a few of the map showed entries like "ContainerResource_container_e01_1459548490386_8560138_01_002020", "ContainerResource_container_e01_1459548490386_2378745_01_000410", etc.

Looks like the ContainerMetrics for each container will cause a unique name to be registered with UniqueNames and the name will never be unregistered.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org