You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Kihwal Lee (JIRA)" <ji...@apache.org> on 2013/05/31 20:28:20 UTC

[jira] [Created] (YARN-742) Log aggregation causes a lot of redundant setPermission calls

Kihwal Lee created YARN-742:
-------------------------------

             Summary: Log aggregation causes a lot of redundant setPermission calls
                 Key: YARN-742
                 URL: https://issues.apache.org/jira/browse/YARN-742
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.0.4-alpha, 0.23.7
            Reporter: Kihwal Lee


In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/<user>/logs. Also mkdirs calls are made before this.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira