You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2007/09/27 08:38:50 UTC
[jira] Commented: (HADOOP-1851) Map output compression codec cannot
be set independently of job output compression codec
[ https://issues.apache.org/jira/browse/HADOOP-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12530641 ]
Arun C Murthy commented on HADOOP-1851:
---------------------------------------
As Riccardo says we clearly need another configuration property... how about:
Map Outputs:
mapred.map.output.compression.{type|codec}
JobConf.{get|set}MapOutputCompression{Type|Codec}
Job Outputs:
mapred.output.compression.{type|codec}
JobConf.{get|set}OutputCompression{Type|Codec}
That's the easy bit, however I think that this will snow-ball into a large-ish patch since this will entail hunting down all {{OutputFormat}} implementations and ensuring that they use mapred.output.compression.{type|codec} properties... clearly something we *have* to fix. Of course, I'll ensure this is clearly documented for folks who write their own {{OutputFormat}}s.
> Map output compression codec cannot be set independently of job output compression codec
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-1851
> URL: https://issues.apache.org/jira/browse/HADOOP-1851
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.14.1
> Reporter: Riccardo
> Assignee: Arun C Murthy
>
> The property "mapred.output.compression.codec" is used when setting and getting the map output compression codec in JobConf, thus making it impossible to use a different codec for map outputs and overall job outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.