You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Colin Patrick McCabe (JIRA)" <ji...@apache.org> on 2013/08/20 21:28:51 UTC

[jira] [Commented] (HDFS-5098) Enhance FileSystem.Statistics to have locality information

    [ https://issues.apache.org/jira/browse/HDFS-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13745308#comment-13745308 ] 

Colin Patrick McCabe commented on HDFS-5098:
--------------------------------------------

You can get the local read and short-circuit statistics for each input stream from {{HdfsDataInputStream#getReadStatistics}}.  This was added by HDFS-4698.  Any objections to marking this as a duplicate of HDFS-4698, which added this feature?
                
> Enhance FileSystem.Statistics to have locality information
> ----------------------------------------------------------
>
>                 Key: HDFS-5098
>                 URL: https://issues.apache.org/jira/browse/HDFS-5098
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Bikas Saha
>             Fix For: 2.1.1-beta
>
>
> Currently in MR/Tez we dont have a good and accurate means to detect how much the the IO was actually done locally. Getting this information from the source of truth would be much better.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira