[jira] Commented: (AVRO-592) Pig to Avro translation -- Pig DatumReader/Writer

["Scott Carey (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AVRO-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899008#action_12899008 ] 

Scott Carey commented on AVRO-592:
----------------------------------

Hopefully Pig will have their Maven story worked out for 0.8

https://issues.apache.org/jira/browse/PIG-1334

Until then I'll keep working on this in jar-limbo.  I'm not sure if this best goes in the Pig project or here from a user perspective, but I feel like the majority of the actual work is Avro related and best reviewed and understood by the comitters here.

> Pig to Avro translation -- Pig DatumReader/Writer
> -------------------------------------------------
>
>                 Key: AVRO-592
>                 URL: https://issues.apache.org/jira/browse/AVRO-592
>             Project: Avro
>          Issue Type: New Feature
>          Components: java
>            Reporter: Scott Carey
>            Assignee: Scott Carey
>             Fix For: 1.4.0
>
>         Attachments: AVRO-592.patch
>
>
> It would be great to use Avro to store Pig outputs.   Because Avro persists the schema as well, one can store data in one script, then load it in another and preserve the schema.
> Additionally, one can serialize pig Tuples to Avro and read Avro into pig Tuples.  Avro Schemas are significantly more rich than Pig schemas, but a limited translation is possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.