You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/06/01 13:11:59 UTC
[jira] [Commented] (HADOOP-13162) Consider reducing number of
getFileStatus calls in S3AFileSystem.mkdirs
[ https://issues.apache.org/jira/browse/HADOOP-13162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310269#comment-15310269 ]
Steve Loughran commented on HADOOP-13162:
-----------------------------------------
+1
* tested against s3a ireland, parallel threads=2; all clear
* as it changed a base test case, checked with the other implementation outside hadoop-common, here {{TestFcHdfsCreateMkdir}}. All well.
> Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs
> -----------------------------------------------------------------------
>
> Key: HADOOP-13162
> URL: https://issues.apache.org/jira/browse/HADOOP-13162
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Rajesh Balamohan
> Priority: Minor
> Attachments: HADOOP-13162-branch-2-002.patch, HADOOP-13162-branch-2-003.patch, HADOOP-13162-branch-2-004.patch, HADOOP-13162.001.patch
>
>
> getFileStatus is relatively expensive call and mkdirs invokes it multiple times depending on how deep the directory structure is. It would be good to reduce the number of getFileStatus calls in such cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org