You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/07/26 18:04:20 UTC
[jira] [Created] (HADOOP-13427) Eliminate needless uses of
FileSystem.exists, iisFile, isDirectory
Steve Loughran created HADOOP-13427:
---------------------------------------
Summary: Eliminate needless uses of FileSystem.exists, iisFile, isDirectory
Key: HADOOP-13427
URL: https://issues.apache.org/jira/browse/HADOOP-13427
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Affects Versions: 2.8.0
Reporter: Steve Loughran
We're cleaning up Hive and Spark's use of FileSystem.exists, because it is often the case we see code of exists+open, exists+delete, when the exists probe is needless. Against object stores, expensive needless.
Hadoop can set an example here by stripping them out. It will also show where there are opportunities to optimise things better and/or improve reporting.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org