You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2016/05/11 04:41:12 UTC

[jira] [Updated] (TEZ-2413) No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning

     [ https://issues.apache.org/jira/browse/TEZ-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated TEZ-2413:
-----------------------------
    Fix Version/s:     (was: 0.7.1)

> No need to check whether vertex has been committed as shared output in DAGImpl#vertexreRunning
> ----------------------------------------------------------------------------------------------
>
>                 Key: TEZ-2413
>                 URL: https://issues.apache.org/jira/browse/TEZ-2413
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jeff Zhang
>            Assignee: Jeff Zhang
>
> * Vertex only send out DAGEventVertexReRunning when vertex.commitVertexOutputs is false, that means it is not necessary to check whether it has been committed as shared output of vertex group in DAGImpl#vertexReRunning
> {code}
> private boolean vertexReRunning(Vertex vertex) {
>     reRunningVertices.add(vertex.getVertexId());
>     numSuccessfulVertices--;
>     addDiagnostic("Vertex re-running"
>       + ", vertexName=" + vertex.getName()
>       + ", vertexId=" + vertex.getVertexId());
>     if (!commitAllOutputsOnSuccess) {
>       // partial output may already have been committed. fail if so
>       List<VertexGroupInfo> groupList = vertexGroupInfo.get(vertex.getName());
>       if (groupList != null) {
>         for (VertexGroupInfo groupInfo : groupList) {
>           if (groupInfo.committed) {
>             String msg = "Aborting job as committed vertex: "
>                 + vertex.getLogIdentifier() + " is re-running";
>             LOG.info(msg);
>             addDiagnostic(msg);
>             enactKill(DAGTerminationCause.VERTEX_RERUN_AFTER_COMMIT,
>                 VertexTerminationCause.VERTEX_RERUN_AFTER_COMMIT);
>             return true;
>           } else {
>             groupInfo.successfulMembers--;
>           }
>         }
>       }
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)