You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by ar...@apache.org on 2014/09/12 20:47:04 UTC
[21/41] git commit: MAPREDUCE-6070.
yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented.
Contributed by Tsuyoshi OZAWA
MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented. Contributed by Tsuyoshi OZAWA
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9e28e089
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9e28e089
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/9e28e089
Branch: refs/heads/HDFS-6581
Commit: 9e28e089c6bcb0b264751bdfa1f994ce002ef2de
Parents: 4be9517
Author: Jason Lowe <jl...@apache.org>
Authored: Thu Sep 11 16:19:23 2014 +0000
Committer: Jason Lowe <jl...@apache.org>
Committed: Thu Sep 11 16:19:23 2014 +0000
----------------------------------------------------------------------
hadoop-mapreduce-project/CHANGES.txt | 3 +++
.../src/main/resources/mapred-default.xml | 7 ++++++-
2 files changed, 9 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9e28e089/hadoop-mapreduce-project/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-mapreduce-project/CHANGES.txt b/hadoop-mapreduce-project/CHANGES.txt
index 490c0a1..0c065c5 100644
--- a/hadoop-mapreduce-project/CHANGES.txt
+++ b/hadoop-mapreduce-project/CHANGES.txt
@@ -279,6 +279,9 @@ Release 2.6.0 - UNRELEASED
MAPREDUCE-6075. HistoryServerFileSystemStateStore can create zero-length
files (jlowe)
+ MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but
+ is not documented (Tsuyoshi OZAWA via jlowe)
+
Release 2.5.1 - UNRELEASED
INCOMPATIBLE CHANGES
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9e28e089/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
----------------------------------------------------------------------
diff --git a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
index 703a103..6cefdc9 100644
--- a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
+++ b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
@@ -508,7 +508,12 @@
<description>Whether to enable the small-jobs "ubertask" optimization,
which runs "sufficiently small" jobs sequentially within a single JVM.
"Small" is defined by the following maxmaps, maxreduces, and maxbytes
- settings. Users may override this value.
+ settings. Note that configurations for application masters also affect
+ the "Small" definition - yarn.app.mapreduce.am.resource.mb must be
+ larger than both mapreduce.map.memory.mb and mapreduce.reduce.memory.mb,
+ and yarn.app.mapreduce.am.resource.cpu-vcores must be larger than
+ both mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores to enable
+ ubertask. Users may override this value.
</description>
</property>