You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2014/03/27 21:43:18 UTC

[jira] [Commented] (PIG-3842) Pig on tez job hangs when AM has a failure and DAG cannot be submitted

    [ https://issues.apache.org/jira/browse/PIG-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13949906#comment-13949906 ] 

Rohini Palaniswamy commented on PIG-3842:
-----------------------------------------

It hangs at 

{code}
"main" prio=5 tid=0x00007f87eb000800 nid=0x1703 in Object.wait() [0x000000010bdd4000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000147042060> (a org.apache.pig.backend.hadoop.executionengine.tez.TezPlanContainer)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.pig.backend.hadoop.executionengine.tez.TezPlanContainer.getNextPlan(TezPlanContainer.java:121)
        - locked <0x0000000147042060> (a org.apache.pig.backend.hadoop.executionengine.tez.TezPlanContainer)
        at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:75)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:374)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1395)
{code}

> Pig on tez job hangs when AM has a failure and DAG cannot be submitted
> ----------------------------------------------------------------------
>
>                 Key: PIG-3842
>                 URL: https://issues.apache.org/jira/browse/PIG-3842
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Rohini Palaniswamy
>             Fix For: tez-branch
>
>
> For eg: when submitting to a wrong queue below exception is encountered and job hangs
> {code}
> 2014-03-27 19:31:17,981 [JobControl] INFO 
> org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application
> application_1394493512142_22453
> 2014-03-27 19:31:17,983 [JobControl] ERROR
> org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
> java.lang.RuntimeException: TezSession has already shutdown
>         at
> org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.waitForTezSessionReady(TezSessionManager.java:89)
>         at
> org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:113)
>         at
> org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getSession(TezSessionManager.java:154)
>         at
> org.apache.pig.backend.hadoop.executionengine.tez.TezJob.submit(TezJob.java:92)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at
> org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
>         at
> org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
>         at
> org.apache.pig.backend.hadoop.executionengine.tez.TezJobControl.run(TezJobControl.java:43)
>         at java.lang.Thread.run(Thread.java:722)
>         at
> org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:102)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)