You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Vivek Padmanabhan (JIRA)" <ji...@apache.org> on 2011/06/20 10:03:48 UTC
[jira] [Commented] (PIG-2130) Piggybank:MultiStorage is not
compressing output files
[ https://issues.apache.org/jira/browse/PIG-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051841#comment-13051841 ]
Vivek Padmanabhan commented on PIG-2130:
----------------------------------------
Please note that , if compression is used, then the subfolders and output files will be having the corresponding extension.
For example, if output001.bz2 is output path and f1,f2 are the keys, the files will look like;
/tmp/output001.bz2
/tmp/output001.bz2/f1.bz2
/tmp/output001.bz2/f1.bz2/f1-0.bz2
/tmp/output001.bz2/f2.bz2
/tmp/output001.bz2/f2.bz2/f2-0.bz2
> Piggybank:MultiStorage is not compressing output files
> ------------------------------------------------------
>
> Key: PIG-2130
> URL: https://issues.apache.org/jira/browse/PIG-2130
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Vivek Padmanabhan
> Assignee: Vivek Padmanabhan
> Attachments: PIG-2130_1.patch
>
>
> MultiStorage is not compressing the records while writing the output. Even though it takes a compression param, when the record is written it ignores the compression.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira