You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Sylvain Menu (JIRA)" <ji...@apache.org> on 2013/08/01 16:09:50 UTC

[jira] [Commented] (PIG-2143) Make PigStorage optionally store schema; improve docs.

    [ https://issues.apache.org/jira/browse/PIG-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726454#comment-13726454 ] 

Sylvain Menu commented on PIG-2143:
-----------------------------------

I try to launch the store command 2 times in the same query :

   pigServer.registerQuery("
      STORE data1 INTO 'store1' USING PigStorage('\\t', '-schema');
      STORE data2 INTO 'store2' USING PigStorage('\\t', '-schema');
   ");

'store1' have his schema but not 'store2', have you got the same problem ?

                
> Make PigStorage optionally store schema; improve docs.
> ------------------------------------------------------
>
>                 Key: PIG-2143
>                 URL: https://issues.apache.org/jira/browse/PIG-2143
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Dmitriy V. Ryaboy
>             Fix For: 0.10.0
>
>         Attachments: PIG-2143.2.diff, PIG-2143.3.patch, PIG-2143.4.patch, PIG-2143.5.patch, PIG-2143.diff
>
>
> I'd like to propose that we allow for a greater degree of customization in PigStorage.
> An incomplete list features that we might want to add:
> - flag to tell it to overwrite existing output if it exists
> - flag to tell it to compress output using gzip|bzip|lzo (currently this can be achieved by setting the directory name to end in .gz or .bz2, which is a bit awkward)
> - flag to tell it to store the schema and header (perhaps by merging in PigStorageSchema work?)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira