[jira] [Commented] (TEZ-3203) DAG hangs when one of the upstream vertices has zero tasks

["Jason Lowe (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15231014#comment-15231014 ] 

Jason Lowe commented on TEZ-3203:
---------------------------------

The hang occurs because the downstream vertex with multiple inputs never schedules tasks despite the upstream vertices completing.  I believe this is occurring because the upstream vertex with zero tasks is failing to send out a CONFIGURED event, and therefore the downstream vertex keeps waiting on that event before scheduling.  It looks like ShuffleVertexManager can end up not calling doneReconfiguringVertex when it has zero tasks to schedule.

> DAG hangs when one of the upstream vertices has zero tasks
> ----------------------------------------------------------
>
>                 Key: TEZ-3203
>                 URL: https://issues.apache.org/jira/browse/TEZ-3203
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Jason Lowe
>            Priority: Critical
>
> A DAG hangs during execution if it has a vertex with multiple inputs and one of those upstream vertices has zero tasks and is using ShuffleVertexManager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)