[jira] [Created] (TEZ-3239) ShuffleVertexManager recovery issue when auto parallelism is enabled

["Ming Ma (JIRA)" <ji...@apache.org>]

Ming Ma created TEZ-3239:
----------------------------

             Summary: ShuffleVertexManager recovery issue when auto parallelism is enabled
                 Key: TEZ-3239
                 URL: https://issues.apache.org/jira/browse/TEZ-3239
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Ming Ma


Repro:

* Enable {{tez.shuffle-vertex-manager.enable.auto-parallel}}.
* kill the Tez AM container after the job has reached to the point that VM has reconfigured the Edge.
* The new Tez AM attempt will fail to the following error.

{noformat}
org.apache.tez.dag.api.TezUncheckedException: Atleast 1 bipartite source should exist
at org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.onVertexStarted(ShuffleVertexManager.java:497)
at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventOnVertexStarted.invoke(VertexManager.java:589)
at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:658)
at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:653)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
{noformat}

That is because the edge routing type changed to {{DataMovementType.CUSTOM}} after reconfiguration. Allowing {{DataMovementType.CUSTOM}} in the following check seems to fix the issue.

{noformat}
      if (entry.getValue().getDataMovementType() == DataMovementType.SCATTER_GATHER) {
        bipartiteSources++;
      }
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)