You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Yan Zhou (JIRA)" <ji...@apache.org> on 2010/10/05 00:11:33 UTC

[jira] Resolved: (PIG-1664) [zebra] leading '_' in directory/file names should be ignored; the "pigtest" build target should include all pig-related zebra tests.

     [ https://issues.apache.org/jira/browse/PIG-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou resolved PIG-1664.
---------------------------

    Resolution: Fixed

zebra nightly tests pass ok.

Patch committed to the trunk and the 0.8 branch.

> [zebra] leading '_' in directory/file names should be ignored; the "pigtest" build target should include all pig-related zebra tests.
> -------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: PIG-1664
>                 URL: https://issues.apache.org/jira/browse/PIG-1664
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Yan Zhou
>            Assignee: Yan Zhou
>            Priority: Trivial
>             Fix For: 0.8.0
>
>         Attachments: PIG-1664.patch
>
>
> Disk entries of names prefixed with '_' is excluded during split generation, and should be excluded from CG's data file processing too. Furthermore, FileInputFormat treats those files as hidden files. Zebra should ignore them to be safe.
> At writing, zebra creates _temporary directory under the table (PIG-1115). The directory may not be totally cleaned up due to lagging speculative executions. To avoid  any confusions resulting from attempt to access the _temporary directory, the disk entries of names with the '_' prefix should also be excluded by Zebra processing.
> On the other hand, now that Zebra's pig tests run much faster using PIG's local mode, all pig-related should be included in the "pigtest" target to complete PIG's test coverage.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.