You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2014/01/23 19:14:40 UTC
[jira] [Commented] (PIG-3717) AvroStorage is not filtering hidden
files on directory recursion
[ https://issues.apache.org/jira/browse/PIG-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880165#comment-13880165 ]
Xuefu Zhang commented on PIG-3717:
----------------------------------
+1
> AvroStorage is not filtering hidden files on directory recursion
> ----------------------------------------------------------------
>
> Key: PIG-3717
> URL: https://issues.apache.org/jira/browse/PIG-3717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.12.0
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 0.13.0
>
> Attachments: PIG-3717.patch, PIG-3717.patch
>
>
> We've noticed that when we generate couple of sub-directories with Oozie and then use AvroStorage (the older version from PiggyBank) to load those directories, hidden files such as {{_SUCCESS}} won't get ignored as they should be and in turn will cause failures in the Pig job. This seems to be regression caused by PIG-3223.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)