You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Karthik Kambatla (JIRA)" <ji...@apache.org> on 2014/07/03 07:33:37 UTC
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in
property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karthik Kambatla updated MAPREDUCE-5906:
----------------------------------------
Target Version/s: 2.6.0 (was: 2.5.0)
> Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
> --------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 2.4.0
> Reporter: Akira AJISAKA
> Assignee: Akira AJISAKA
> Priority: Minor
> Labels: newbie
> Attachments: MAPREDUCE-5906.patch
>
>
> In MergeManagerImpl.java, the default value of MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90.
> {code}
> final float maxInMemCopyUse =
> jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f);
> {code}
> However, the actual default value is 0.70 in mapred-default.xml.
> {code}
> <name>mapreduce.reduce.shuffle.input.buffer.percent</name>
> <value>0.70</value>
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)