You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Lars Francke (Commented) (JIRA)" <ji...@apache.org> on 2012/02/02 11:29:53 UTC
[jira] [Commented] (SQOOP-428) AvroOutputFormat doesn't support
compression even though documentation claims it does
[ https://issues.apache.org/jira/browse/SQOOP-428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198670#comment-13198670 ]
Lars Francke commented on SQOOP-428:
------------------------------------
Hey,
thanks for the hint. I only tried 20 and 23, sorry. The problem is that 1.0.0 doesn't support Snappy compression out of the box so the test that uses it fails. Because I can't figure out an easy way right now to check for the availability I'll just remove the test. I guess that doesn't need a new review? I'll attach the patch shortly, just running tests against all three versions now. 23 fails because of MAPREDUCE-3736 but it succeeded earlier.
> AvroOutputFormat doesn't support compression even though documentation claims it does
> -------------------------------------------------------------------------------------
>
> Key: SQOOP-428
> URL: https://issues.apache.org/jira/browse/SQOOP-428
> Project: Sqoop
> Issue Type: Bug
> Components: docs
> Affects Versions: 1.4.0-incubating
> Reporter: Lars Francke
> Assignee: Lars Francke
> Priority: Minor
> Labels: avro, document
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-428.1.patch, SQOOP-428.2.patch, SQOOP-428.3.patch, TEST-com.cloudera.sqoop.TestAvroImport.txt
>
>
> The documentation claims that Avro files can be compressed as well:
> {quote}
> By default, data is not compressed. You can compress your data by using the deflate (gzip) algorithm with the -z or --compress argument, or specify any Hadoop compression codec using the --compression-codec argument. This applies to SequenceFile, text, and Avro files.
> {quote}
> This is not true as the AvroOutputFormat currently doesn't support compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira