You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2014/09/26 23:01:34 UTC

[jira] [Commented] (TEZ-1612) ShuffleVertexManager's EdgeManager should not hard code source num tasks

    [ https://issues.apache.org/jira/browse/TEZ-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14149962#comment-14149962 ] 

Daniel Dai commented on TEZ-1612:
---------------------------------

Shall we port the patch to 0.5 branch? Pig 0.14 will use tez 0.5.

> ShuffleVertexManager's EdgeManager should not hard code source num tasks
> ------------------------------------------------------------------------
>
>                 Key: TEZ-1612
>                 URL: https://issues.apache.org/jira/browse/TEZ-1612
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.5.0
>            Reporter: Daniel Dai
>            Assignee: Bikas Saha
>             Fix For: 0.6.0
>
>         Attachments: DAG1.png, TEZ-1612.1.patch, runwithmaster.tar.gz, syslog_dag_1411413615885_0001_1, testfail1.log.tar.gz
>
>
> Several Pig unit tests hang intermittently. For example, TestNewPlanImplicitSplit.testImplicitSplitInCoGroup, which is a DAG of 4 nodes:
> !DAG1.png!
> It uses auto-parallelism, vertex 106 change parallelism from 2->1, and vertex 107 from 21->1.
> Log attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)