You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/07/26 18:04:20 UTC

[jira] [Created] (HADOOP-13427) Eliminate needless uses of FileSystem.exists, iisFile, isDirectory

Steve Loughran created HADOOP-13427:
---------------------------------------

             Summary: Eliminate needless uses of FileSystem.exists, iisFile, isDirectory 
                 Key: HADOOP-13427
                 URL: https://issues.apache.org/jira/browse/HADOOP-13427
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
    Affects Versions: 2.8.0
            Reporter: Steve Loughran


We're cleaning up Hive and Spark's use of FileSystem.exists, because it is often the case we see code of exists+open, exists+delete, when the exists probe is needless. Against object stores, expensive needless.

Hadoop can set an example here by stripping them out. It will also show where there are opportunities to optimise things better and/or improve reporting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org