You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Tsuyoshi OZAWA (JIRA)" <ji...@apache.org> on 2014/06/24 01:03:27 UTC
[jira] [Updated] (YARN-2078) yarn.app.am.resource.mb/cpu-vcores
affects uber mode but is not documented
[ https://issues.apache.org/jira/browse/YARN-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsuyoshi OZAWA updated YARN-2078:
---------------------------------
Description:
We should document the condition when uber mode is enabled. Currently, users need to read following code to understand the condition.
{code}
boolean smallMemory =
( (Math.max(conf.getLong(MRJobConfig.MAP_MEMORY_MB, 0),
conf.getLong(MRJobConfig.REDUCE_MEMORY_MB, 0))
<= sysMemSizeForUberSlot)
|| (sysMemSizeForUberSlot == JobConf.DISABLED_MEMORY_LIMIT));
boolean smallCpu =
Math.max(
conf.getInt(
MRJobConfig.MAP_CPU_VCORES,
MRJobConfig.DEFAULT_MAP_CPU_VCORES),
conf.getInt(
MRJobConfig.REDUCE_CPU_VCORES,
MRJobConfig.DEFAULT_REDUCE_CPU_VCORES))
<= sysCPUSizeForUberSlot
{code}
was:
We should document the condition when uber mode is enabled. If not, users need to read code.
{code}
boolean smallMemory =
( (Math.max(conf.getLong(MRJobConfig.MAP_MEMORY_MB, 0),
conf.getLong(MRJobConfig.REDUCE_MEMORY_MB, 0))
<= sysMemSizeForUberSlot)
|| (sysMemSizeForUberSlot == JobConf.DISABLED_MEMORY_LIMIT));
boolean smallCpu =
Math.max(
conf.getInt(
MRJobConfig.MAP_CPU_VCORES,
MRJobConfig.DEFAULT_MAP_CPU_VCORES),
conf.getInt(
MRJobConfig.REDUCE_CPU_VCORES,
MRJobConfig.DEFAULT_REDUCE_CPU_VCORES))
<= sysCPUSizeForUberSlot
{code}
> yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented
> --------------------------------------------------------------------------
>
> Key: YARN-2078
> URL: https://issues.apache.org/jira/browse/YARN-2078
> Project: Hadoop YARN
> Issue Type: Bug
> Components: documentation
> Affects Versions: 2.4.0
> Reporter: Tsuyoshi OZAWA
> Assignee: Tsuyoshi OZAWA
> Priority: Trivial
> Attachments: YARN-2078.1.patch
>
>
> We should document the condition when uber mode is enabled. Currently, users need to read following code to understand the condition.
> {code}
> boolean smallMemory =
> ( (Math.max(conf.getLong(MRJobConfig.MAP_MEMORY_MB, 0),
> conf.getLong(MRJobConfig.REDUCE_MEMORY_MB, 0))
> <= sysMemSizeForUberSlot)
> || (sysMemSizeForUberSlot == JobConf.DISABLED_MEMORY_LIMIT));
> boolean smallCpu =
> Math.max(
> conf.getInt(
> MRJobConfig.MAP_CPU_VCORES,
> MRJobConfig.DEFAULT_MAP_CPU_VCORES),
> conf.getInt(
> MRJobConfig.REDUCE_CPU_VCORES,
> MRJobConfig.DEFAULT_REDUCE_CPU_VCORES))
> <= sysCPUSizeForUberSlot
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)