You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Josh Wills (JIRA)" <ji...@apache.org> on 2012/09/05 23:57:07 UTC

[jira] [Updated] (CRUNCH-52) Writing to a text file with avro types fills a file with the tostring of AvroWrapper

     [ https://issues.apache.org/jira/browse/CRUNCH-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills updated CRUNCH-52:
-----------------------------

    Attachment: 0001-CRUNCH-52-Determine-the-output-format-to-use-based-o.patch

This was my take on it-- I took the AvroOutputFormat you created, but used the PType passed to configureMapReduce to determine which OutputFormat to use, instead of hardcoding it in the FileTargetImpl. Should work the same way and doesn't have any issues w/backwards compatibility.
                
> Writing to a text file with avro types fills a file with the tostring of AvroWrapper
> ------------------------------------------------------------------------------------
>
>                 Key: CRUNCH-52
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-52
>             Project: Crunch
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Robert Chu
>            Assignee: Rahul Sharma
>         Attachments: 0001-CRUNCH-52-Determine-the-output-format-to-use-based-o.patch, CRUNCH-52.patch
>
>
> Currently when writing a pcollection to a text file (provided by To.textFile(...)) TextOutputFormat doesn't unwrap avro types.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira