You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Benjamin Reed (JIRA)" <ji...@apache.org> on 2008/04/25 09:31:55 UTC

[jira] Updated: (PIG-151) Zero length BZip files are not generated correctly

     [ https://issues.apache.org/jira/browse/PIG-151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Benjamin Reed updated PIG-151:
------------------------------

    Attachment: bz.patch

This patch adds a unit test specifically for reading zero length bzip files and well as another end-to-end test.

The patch also fixes an error related to figuring out the name of the output directory when determining whether this is a bzip file. Note, the source of this error was Hadoop-16, so the fix is specific to Hadoop-16. This will not work with Hadoop-15.

> Zero length BZip files are not generated correctly
> --------------------------------------------------
>
>                 Key: PIG-151
>                 URL: https://issues.apache.org/jira/browse/PIG-151
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Benjamin Reed
>            Assignee: Benjamin Reed
>         Attachments: bz.patch, bz.patch
>
>
> If a zero length BZIp file is created as a result of a store, the resulting BZIp file will be invalid: it will have part of the BZip header, but it will be missing everything else. The BZip library does not behave correctly when a BZip file is created and nothing is written before the close.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.