[jira] [Commented] (TEZ-3897) Tez Local Mode hang for vertices with broadcast input

["Jonathan Eagles (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377656#comment-16377656 ] 

Jonathan Eagles commented on TEZ-3897:
--------------------------------------

This patch adds preemption to the scheduler. Priority based preemption alone was overly aggressive in preempting tasks that had low priority but were unrelated. This patch adds DAG aware preemption to preempt only true hangs based on priority and ancestry.

> Tez Local Mode hang for vertices with broadcast input
> -----------------------------------------------------
>
>                 Key: TEZ-3897
>                 URL: https://issues.apache.org/jira/browse/TEZ-3897
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Major
>
> Broadcast edges are not taken into consideration for slow-start edges so downstream tasks in local mode can start before upstream tasks. Without preemption in the scheduler, there will be a hang.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)