You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Eron Wright (JIRA)" <ji...@apache.org> on 2015/05/17 01:37:02 UTC

[jira] [Commented] (HADOOP-9769) Remove org.apache.hadoop.fs.Stat when JDK6 support is dropped

    [ https://issues.apache.org/jira/browse/HADOOP-9769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14546982#comment-14546982 ] 

Eron Wright  commented on HADOOP-9769:
--------------------------------------

Looking forward to this.  LocalFileSystem performance is quite bad (when dealing with file existence, status, ownership, etc) assumedly due to shelling out.  Using MR FileInputFormat with thousands of local files is unbearably slow.

> Remove org.apache.hadoop.fs.Stat when JDK6 support is dropped
> -------------------------------------------------------------
>
>                 Key: HADOOP-9769
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9769
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 3.0.0
>            Reporter: Andrew Wang
>            Priority: Minor
>
> HADOOP-9652 introduces a new class which shells out to stat(1) because of the lack of lstat(2) in Java 6. Java 7 has support for reading symlink targets via {{Files#readSymbolicLink}}.
> When Hadoop drops Java 6 support, let's use this more portable method instead.
> See:
> http://docs.oracle.com/javase/7/docs/api/java/nio/file/Files.html#readSymbolicLink(java.nio.file.Path)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)