[jira] [Resolved] (TEZ-643) Some GridMix job fails due to Out Of Memory issue when container reuse is enabled

["Siddharth Seth (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Seth resolved TEZ-643.
--------------------------------

       Resolution: Fixed
    Fix Version/s: 0.3.0

Committed to master. Have set the fix version to 0.3.0 for now since this isn't part of the current RC. 0.3.0 will likely get renamed to something like 0.2.1.

> Some GridMix job fails due to Out Of Memory issue when container reuse is enabled
> ---------------------------------------------------------------------------------
>
>                 Key: TEZ-643
>                 URL: https://issues.apache.org/jira/browse/TEZ-643
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Yesha Vora
>            Assignee: Siddharth Seth
>             Fix For: 0.3.0
>
>         Attachments: TEZ-643.txt
>
>
> Some gridmix jobs such as GRIDMIX000000 and GRIDMIX000004  fails with 'java.lang.OutOfMemoryError: Java heap space' Error when container reuse feature is enabled.
> snapshot of Application master log
> ---------
> Vertex failed, vertexName=initialmap, vertexId=vertex_1384298997980_0004_1_01, diagnostics=[Task failed, taskId=task_1384298997980_0004_1_01_000292, diagnostics=[AttemptID:attempt_1384298997980_0004_1_01_000292_0 Info:Error: java.lang.reflect.UndeclaredThrowableException
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1504)
> at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:442)
> Caused by: java.lang.Exception: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:172)
> at org.apache.hadoop.mapred.YarnTezDagChild$4.run(YarnTezDagChild.java:448)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
> ... 1 more
> Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
> at java.util.concurrent.FutureTask.get(FutureTask.java:111)
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:166)
> ... 5 more
> Caused by: java.lang.OutOfMemoryError: Java heap space
> at org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.initialize(DefaultSorter.java:138)
> at org.apache.tez.runtime.library.output.OnFileSortedOutput.initialize(OnFileSortedOutput.java:69)
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeOutputCallable.call(LogicalIOProcessorRuntimeTask.java:291)
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeOutputCallable.call(LogicalIOProcessorRuntimeTask.java:269)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:722)
> ---------



--
This message was sent by Atlassian JIRA
(v6.1#6144)