You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2016/08/23 04:43:21 UTC

[jira] [Created] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

Rajesh Balamohan created YARN-5551:
--------------------------------------

             Summary: Ignore deleted file mapping from memory computation when smaps is enabled
                 Key: YARN-5551
                 URL: https://issues.apache.org/jira/browse/YARN-5551
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Rajesh Balamohan
            Assignee: Rajesh Balamohan
            Priority: Minor


Currently deleted file mappings are also included in the memory computation when SMAP is enabled. For e.g

{noformat}
7f612004a000-7f612004c000 rw-s 00000000 00:10 4201507513                 /dev/shm/HadoopShortCircuitShm_DFSClient_NONMAPREDUCE_-521969216_162_734673185 (deleted)
Size:                  8 kB
Rss:                   4 kB
Pss:                   2 kB
Shared_Clean:          0 kB
Shared_Dirty:          4 kB
Private_Clean:         0 kB
Private_Dirty:         0 kB
Referenced:            4 kB
Anonymous:             0 kB
AnonHugePages:         0 kB
Swap:                  0 kB
KernelPageSize:        4 kB
MMUPageSize:           4 kB


7f6123f99000-7f6163f99000 rw-p 00000000 08:41 211419477                  /grid/4/hadoop/yarn/local/usercache/root/appcache/application_1466700718395_1249/container_e19_1466700718395_1249_01_000003/7389389356021597290.cache (deleted)
Size:            1048576 kB
Rss:              637292 kB
Pss:              637292 kB
Shared_Clean:          0 kB
Shared_Dirty:          0 kB
Private_Clean:         0 kB
Private_Dirty:    637292 kB
Referenced:       637292 kB
Anonymous:        637292 kB
AnonHugePages:         0 kB
Swap:                  0 kB
KernelPageSize:        4 kB
{noformat}

It would be good to exclude these from getSmapBasedRssMemorySize() computation.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org