You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Kuhu Shukla (JIRA)" <ji...@apache.org> on 2019/03/13 20:55:00 UTC

[jira] [Created] (TEZ-4053) TestExceptionPropagation.testExceptionPropagationSession fails intermittently

Kuhu Shukla created TEZ-4053:
--------------------------------

             Summary: TestExceptionPropagation.testExceptionPropagationSession fails intermittently
                 Key: TEZ-4053
                 URL: https://issues.apache.org/jira/browse/TEZ-4053
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


Irrespective of the test case failing or not I see the below stack trace that needs to be looked at:
{code}
2019-03-13 15:12:19,457 [INFO] [Dispatcher thread {Central}] |HistoryEventHandler.criticalEvents|: [HISTORY][DAG:dag_1552507929653_0001_1][Event:DAG_FINISHED]: dagId=dag_1552507929653_0001_1, startTime=1552507939233, finishTime=1552507939419, timeTaken=186, status=FAILED, diagnostics=Vertex failed, vertexName=v1, vertexId=vertex_1552507929653_0001_1_00, diagnostics=[Exception in EdgeManager, vertex:vertex_1552507929653_0001_1_00 [v1],java.lang.RuntimeException: EM_GetNumSourceTaskPhysicalOutputs
        at org.apache.tez.test.TestExceptionPropagation$CustomEdgeManager.getNumSourceTaskPhysicalOutputs(TestExceptionPropagation.java:828)
        at org.apache.tez.dag.app.dag.impl.Edge.getSourceSpec(Edge.java:340)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getSourceSpecFor(VertexImpl.java:4489)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getOutputSpecList(VertexImpl.java:4477)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.createRemoteTaskSpec(VertexImpl.java:1647)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.scheduleTasks(VertexImpl.java:1683)
] completed., numCompletedVertices=2, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=1, numVertices=2
2019-03-13 15:12:19,418 [INFO] [Dispatcher thread {Central}] |impl.DAGImpl|: Checking vertices for DAG completion, num
CompletedVertices=2, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=1, numVertices=2, commitInProgres
s=0, terminationCause=VERTEX_FAILURE
2019-03-13 15:12:19,418 [INFO] [Dispatcher thread {Central}] |impl.DAGImpl|: DAG did not succeed due to VERTEX_FAILURE
. failedVertices:1 killedVertices:1
2019-03-13 15:12:19,443 [INFO] [Dispatcher thread {Central}] |recovery.RecoveryService|: DAG completed, dagId=dag_1552
507929653_0001_1, queueSize=0
2019-03-13 15:12:19,457 [INFO] [Dispatcher thread {Central}] |HistoryEventHandler.criticalEvents|: [HISTORY][DAG:dag_1
552507929653_0001_1][Event:DAG_FINISHED]: dagId=dag_1552507929653_0001_1, startTime=1552507939233, finishTime=15525079
39419, timeTaken=186, status=FAILED, diagnostics=Vertex failed, vertexName=v1, vertexId=vertex_1552507929653_0001_1_00
, diagnostics=[Exception in EdgeManager, vertex:vertex_1552507929653_0001_1_00 [v1],java.lang.RuntimeException: EM_Get
NumSourceTaskPhysicalOutputs
        at org.apache.tez.test.TestExceptionPropagation$CustomEdgeManager.getNumSourceTaskPhysicalOutputs(TestExceptio
nPropagation.java:828)
        at org.apache.tez.dag.app.dag.impl.Edge.getSourceSpec(Edge.java:340)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getSourceSpecFor(VertexImpl.java:4489)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getOutputSpecList(VertexImpl.java:4477)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.createRemoteTaskSpec(VertexImpl.java:1647)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.scheduleTasks(VertexImpl.java:1683)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerPluginContextImpl.scheduleTasks(VertexManager.java:221)
        at org.apache.tez.dag.app.dag.impl.RootInputVertexManager.schedulePendingTasks(RootInputVertexManager.java:386)
        at org.apache.tez.dag.app.dag.impl.RootInputVertexManager.processPendingTasks(RootInputVertexManager.java:379)
        at org.apache.tez.dag.app.dag.impl.RootInputVertexManager.onVertexStarted(RootInputVertexManager.java:182)
        at org.apache.tez.test.TestExceptionPropagation$RootInputVertexManagerWithException.onVertexStarted(TestExceptionPropagation.java:714)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventOnVertexStarted.invoke(VertexManager.java:618)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:687)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:682)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:682)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:671)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)