[jira] [Created] (TEZ-643) Some GridMix job fails due to Out Of Memory issue when container reuse is enabled

["Yesha Vora (JIRA)" <ji...@apache.org>]

Yesha Vora created TEZ-643:
------------------------------

             Summary: Some GridMix job fails due to Out Of Memory issue when container reuse is enabled
                 Key: TEZ-643
                 URL: https://issues.apache.org/jira/browse/TEZ-643
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Yesha Vora


Some gridmix jobs such as GRIDMIX000000 and GRIDMIX000004  fails with 'java.lang.OutOfMemoryError: Java heap space' Error when container reuse feature is enabled.

snapshot of Application master log
---------
Vertex failed, vertexName=initialmap, vertexId=vertex_1384298997980_0004_1_01, diagnostics=[Task failed, taskId=task_1384298997980_0004_1_01_000292, diagnostics=[AttemptID:attempt_1384298997980_0004_1_01_000292_0 Info:Error: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1504)
at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:442)
Caused by: java.lang.Exception: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:172)
at org.apache.hadoop.mapred.YarnTezDagChild$4.run(YarnTezDagChild.java:448)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
... 1 more
Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
at java.util.concurrent.FutureTask.get(FutureTask.java:111)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:166)
... 5 more
Caused by: java.lang.OutOfMemoryError: Java heap space
at org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.initialize(DefaultSorter.java:138)
at org.apache.tez.runtime.library.output.OnFileSortedOutput.initialize(OnFileSortedOutput.java:69)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeOutputCallable.call(LogicalIOProcessorRuntimeTask.java:291)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeOutputCallable.call(LogicalIOProcessorRuntimeTask.java:269)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)

---------



--
This message was sent by Atlassian JIRA
(v6.1#6144)