[jira] [Commented] (TEZ-800) One-one edge with parallelism -1 fails if source vertex parallelism is not -1 as well

["Daniel Dai (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999073#comment-13999073 ] 

Daniel Dai commented on TEZ-800:
--------------------------------

Once we explicitly set vertex parallelism, we see another issue. When we change source vertex parallelism dynamically (through a VertexManagerPlugin), the parallelism of destination vertex does not change accordingly, thus lead to an exception "Invalid event V_ONE_TO_ONE_SOURCE_SPLIT"

> One-one edge with parallelism -1 fails if source vertex parallelism is not -1 as well
> -------------------------------------------------------------------------------------
>
>                 Key: TEZ-800
>                 URL: https://issues.apache.org/jira/browse/TEZ-800
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Rohini Palaniswamy
>            Assignee: Bikas Saha
>
> // no input initializers. At this moment, only other case is 1-1 edge
>           // with uninitialized sources
>           boolean hasOneToOneUninitedSource = false;
>           for (Map.Entry<Vertex, Edge> entry : vertex.sourceVertices.entrySet()) {
>             if (entry.getValue().getEdgeProperty().getDataMovementType() == 
>                 DataMovementType.ONE_TO_ONE) {
>               if (entry.getKey().getTotalTasks() == -1) {
>                 hasOneToOneUninitedSource = true;
>                 break;
>               }
>             }
>           }
> This checks for the source vertex which has the 1-1 edge to also have -1 parallelism.



--
This message was sent by Atlassian JIRA
(v6.2#6252)