You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Sandy Ryza (JIRA)" <ji...@apache.org> on 2013/05/31 20:30:21 UTC

[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls

    [ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13671724#comment-13671724 ] 

Sandy Ryza commented on YARN-742:
---------------------------------

Does the cluster have YARN-24?
                
> Log aggregation causes a lot of redundant setPermission calls
> -------------------------------------------------------------
>
>                 Key: YARN-742
>                 URL: https://issues.apache.org/jira/browse/YARN-742
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.7, 2.0.4-alpha
>            Reporter: Kihwal Lee
>            Assignee: Jason Lowe
>
> In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/<user>/logs. Also mkdirs calls are made before this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira