You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/09/03 20:48:53 UTC
[jira] [Updated] (MAPREDUCE-5906) Inconsistent configuration in
property "mapreduce.reduce.shuffle.input.buffer.percent"
[ https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer updated MAPREDUCE-5906:
----------------------------------------
Fix Version/s: (was: 3.0.0)
> Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
> --------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 2.4.0
> Reporter: Akira AJISAKA
> Assignee: Akira AJISAKA
> Priority: Minor
> Labels: newbie
> Fix For: 2.6.0
>
> Attachments: MAPREDUCE-5906.patch
>
>
> In MergeManagerImpl.java, the default value of MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90.
> {code}
> final float maxInMemCopyUse =
> jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f);
> {code}
> However, the actual default value is 0.70 in mapred-default.xml.
> {code}
> <name>mapreduce.reduce.shuffle.input.buffer.percent</name>
> <value>0.70</value>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)