You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Josh Wills (JIRA)" <ji...@apache.org> on 2014/07/05 01:22:33 UTC

[jira] [Updated] (CRUNCH-434) outputConf options are ignored on a few key Targets

     [ https://issues.apache.org/jira/browse/CRUNCH-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills updated CRUNCH-434:
------------------------------

    Attachment: CRUNCH-434.patch

The patch for this. Going to commit this one soon.

> outputConf options are ignored on a few key Targets
> ---------------------------------------------------
>
>                 Key: CRUNCH-434
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-434
>             Project: Crunch
>          Issue Type: Bug
>    Affects Versions: 0.10.0, 0.8.3
>            Reporter: Josh Wills
>             Fix For: 0.8.4, 0.11.0
>
>         Attachments: CRUNCH-434.patch
>
>
> I was messing around with some per-target compression settings and discovered that some of the major Targets (TextFileTarget, AvroFileTarget, and AvroParquetFileTarget) ignore any outputConf settings that are done to them, which means that we can only set compression options on a per-job/per-output-type level right now, as opposed to for each individual output.
> Fixed this and added some file-compression related utilities to test it.



--
This message was sent by Atlassian JIRA
(v6.2#6252)