[jira] [Created] (TEZ-1986) Unable to increase am/task container size for MR job in yarn-tez

["Rajesh Balamohan (JIRA)" <ji...@apache.org>]

Rajesh Balamohan created TEZ-1986:
-------------------------------------

             Summary: Unable to increase am/task container size for MR job in yarn-tez
                 Key: TEZ-1986
                 URL: https://issues.apache.org/jira/browse/TEZ-1986
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Rajesh Balamohan


Tried to run a MR job with "-Dtez.am.resource.memory.mb=8192 -Dtez.task.resource.memory.mb=8192 -Dmapreduce.framework.name=yarn-tez -Dmapreduce.map.resource.mb=8192 -Dmapreduce.reduce.resource.mb=8192".

>>>
DAGAppMaster:
java -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -server -Xmx7168m -Djava.net.preferIPv4Stack=true -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=/grid/5/cluster/yarn/logs/application_1421164610335_0326/container_1421164610335_0326_01_000001 -Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel= org.apache.tez.dag.app.DAGAppMaster

Tasks:
java -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -server -Xmx3584m -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+UseParallelGC -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties
>>>

These values seem to be from "mapred.map.child.java.opts" and "mapred.reduce.child.java.opts" instead of (8192 m * 0.8 = 6553m).  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)