You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "vishal.rajan (JIRA)" <ji...@apache.org> on 2017/04/12 10:56:42 UTC

[jira] [Created] (YARN-6470) node manager offheap memory leak

vishal.rajan created YARN-6470:
----------------------------------

             Summary: node manager offheap memory leak
                 Key: YARN-6470
                 URL: https://issues.apache.org/jira/browse/YARN-6470
             Project: Hadoop YARN
          Issue Type: Bug
          Components: yarn
    Affects Versions: 2.7.1
            Reporter: vishal.rajan


In our production environment we are seeing NM process leaking memory, this is off heap memory.NM jvm seems to be using memory within xmx limits.

output of top

 PID USER      PR  NI  VIRT  RES  SHR S  %CPU %MEM    TIME+  COMMAND                                                                                                                
32668 yarn      20   0 18.1g  16g 7244 S    19 17.0  55659:03 java    

output of ps

yarn     32668     1 33  2016 ?        38-15:39:18 /usr/lib/jvm/jdk-8-oracle-x64/bin/java -Dproc_nodemanager -Xmx4096m -Dhdp.version=2.4.0.0-169 -Dhadoop.log.dir=/grid/1/log/hadoop-yarn/yarn


we use debian 7 OS and our java version is java8u25.
Yarn nodemanager-recovery is enabled.

Have attached smaps and heapdump file



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org