You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by GitBox <gi...@apache.org> on 2021/05/18 15:07:41 UTC

[GitHub] [tez] harishjp commented on pull request #124: TEZ-4296 - Use listStatusIterator instead of listStatus in DatePartitionedLogger.

harishjp commented on pull request #124:
URL: https://github.com/apache/tez/pull/124#issuecomment-843251991


   The LocalFileSystem does not override listStatusIterator to remove the .crc files from the listing and that is returning the .crc as file which it should not. For now I'm setting it to RawLocalFileSystem which does not create the crc file and hence works. This has to be fixed in hadoop by overriding listStatusIterator which applies the PATH_FILTER, I'll file a bug in hadoop for this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org