[jira] [Created] (YARN-4540) Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not working as expected

["Mark S (JIRA)" <ji...@apache.org>]

Mark S created YARN-4540:
----------------------------

             Summary: Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not working as expected
                 Key: YARN-4540
                 URL: https://issues.apache.org/jira/browse/YARN-4540
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.7.1
         Environment: Ambari – Version 2.1.2.1
YARN - Version 2.7.1.2.3
HDP - Version 2.3.2.0
            Reporter: Mark S
            Priority: Minor


I manually add specific YARN configuration to reduce my YARN cache size, however it does not get updated for the interval specified by:
{code}
yarn.nodemanager.localizer.cache.cleanup.interval-ms
{code}
I did notice that eventually my server did reduce my YARN cache size over the weekend.


h5. Set Values (Should update size in 1 minute):
{code}
yarn.nodemanager.localizer.cache.target-size-mb=4096
yarn.nodemanager.localizer.cache.cleanup.interval-ms=60000
{code}

h5. Default values (Should update size in 10 minutes):
{code}
yarn.nodemanager.localizer.cache.target-size-mb=10240
yarn.nodemanager.localizer.cache.cleanup.interval-ms=600000
{code}

h5.  Confirming YARN cache size
{code}
date && du -m /hadoop/yarn | sort -nr | head -n 20
#date && du -m . | sort -nr | head -n 20
{code}

h5. See also:
* https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-common/yarn-default.xml
* http://hortonworks.com/blog/resource-localization-in-yarn-deep-dive/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)