[jira] [Commented] (TEZ-3296) Tez job can hang if two vertices at the same root distance have different task requirements

["TezQA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323526#comment-15323526 ] 

TezQA commented on TEZ-3296:
----------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment
  http://issues.apache.org/jira/secure/attachment/12809315/TEZ-3296.001.patch
  against master revision 2c21285.

    {color:red}-1 patch{color}.  master compilation may be broken.

Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/1782//console

This message is automatically generated.

> Tez job can hang if two vertices at the same root distance have different task requirements
> -------------------------------------------------------------------------------------------
>
>                 Key: TEZ-3296
>                 URL: https://issues.apache.org/jira/browse/TEZ-3296
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.7.1
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>            Priority: Critical
>         Attachments: TEZ-3296.001.patch
>
>
> When two vertices have the same distance from the root Tez will schedule containers with the same priority.  However those vertices could have different task requirements and therefore different capabilities.  As documented in YARN-314, YARN currently doesn't support requests for multiple sizes at the same priority.  In practice this leads to one vertex allocation requests clobbering the other, and that can result in a situation where the Tez AM is waiting on containers it will never receive from the RM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)