You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Naganarasimha G R (JIRA)" <ji...@apache.org> on 2017/04/25 02:30:04 UTC

[jira] [Created] (YARN-6524) Avoid storing unnecessary information in the Memory for the finished apps

Naganarasimha G R created YARN-6524:
---------------------------------------

             Summary: Avoid storing unnecessary information in the Memory for the finished apps
                 Key: YARN-6524
                 URL: https://issues.apache.org/jira/browse/YARN-6524
             Project: Hadoop YARN
          Issue Type: Bug
          Components: RM
    Affects Versions: 2.7.3
            Reporter: Naganarasimha G R


Avoid storing unnecessary information in the Memory for the finished apps
In case of cluster with large number of finished apps, more memory is required to store the unused information i.e. related AM's Container launch like Localization resources, tokens etc. 
In one such scenario we had around 9k finished apps each with 257 LocalResource amounting to 108 kbytes per app and just for 9k apps it was nearly taking ~ 0.8 GB of memory. In Low end machines this would create resource crunch in RM




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org