You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Lorand Bendig (JIRA)" <ji...@apache.org> on 2014/02/02 18:44:11 UTC

[jira] [Updated] (PIG-3299) Provide support for LazyOutputFormat to avoid creating empty files

     [ https://issues.apache.org/jira/browse/PIG-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lorand Bendig updated PIG-3299:
-------------------------------

    Attachment: PIG-3299-3.patch

[~daijy], this modification is backward compatible.

> Provide support for LazyOutputFormat to avoid creating empty files
> ------------------------------------------------------------------
>
>                 Key: PIG-3299
>                 URL: https://issues.apache.org/jira/browse/PIG-3299
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.11.1
>            Reporter: Rohini Palaniswamy
>            Assignee: Lorand Bendig
>         Attachments: PIG-3299-2.patch, PIG-3299-3.patch, PIG-3299.patch
>
>
> LazyOutputFormat (HADOOP-4927) in hadoop is a wrapper to avoid creating part files if there is no records output. It would be good to add support for that by having a configuration in pig which wraps storeFunc.getOutputFormat() with LazyOutputFormat. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)