[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

["Bibin A Chundatt (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906884#comment-16906884 ] 

Bibin A Chundatt commented on YARN-9080:
----------------------------------------

Thank you [~Prabhu Joseph] for working on this 

Have a query regarding this . Sorry to come in really late 

{code}
 while (iter.hasNext()) {
      FileStatus stat = iter.next();
      Path clusterTimeStampPath = stat.getPath();
      if (isValidClusterTimeStampDir(clusterTimeStampPath)) {
        MutableBoolean appLogDirPresent = new MutableBoolean(false);
{code}
{ fs.getFileStatus(clusterTimeStampPath);}} in  *isValidClusterTimeStampDir** creates additional Namenode RPC call.

Can we pass the FileStatus instead of path .. {{if (isValidClusterTimeStampDir(clusterTimeStampPath))}} to reduce Namenode RPC call.. 

Thoughts??









> Bucket Directories as part of ATS done accumulates
> --------------------------------------------------
>
>                 Key: YARN-9080
>                 URL: https://issues.apache.org/jira/browse/YARN-9080
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Major
>             Fix For: 3.3.0
>
>         Attachments: 0001-YARN-9080.patch, 0002-YARN-9080.patch, 0003-YARN-9080.patch, YARN-9080-004.patch, YARN-9080-005.patch, YARN-9080-006.patch, YARN-9080-007.patch, YARN-9080-008.patch
>
>
> Have observed older bucket directories cluster_timestamp, bucket1 and bucket2 as part of ATS done accumulates. The cleanLogs part of EntityLogCleaner removes only the app directories and not the bucket directories.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org