[jira] Commented: (HADOOP-2754) Path filter for Local file system list .crc files

["Doug Cutting (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12564442#action_12564442 ] 

Doug Cutting commented on HADOOP-2754:
--------------------------------------

I think perhaps the bug is that ChecksumFileSystem (on which LocalFileSystem is based) does not implement listStatus().  It has a listPaths() implementation that filters checksum files.  Probably this listPaths() implementation should be replaced with a listStatus() implementation that filters checksum files.  The default implementation of listPaths() is in terms of listStatus(), so that will still be filtered.  Right now, listStatus() is implemented by the FilterFileSystem base class, which just forwards to the RawLocalFileSystem, and thus includes the checksum files.

> Path filter for Local file system list .crc files
> -------------------------------------------------
>
>                 Key: HADOOP-2754
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2754
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Amareshwari Sri Ramadasu
>             Fix For: 0.16.1
>
>
> If we write a path filter for local file system, it  lists .crc files also.
> If dont pass any filter, it lists paths properly without any .crc files. But we write a filter, it does list .crc files also.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.