You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Adrian Nicoara (JIRA)" <ji...@apache.org> on 2018/08/24 21:07:00 UTC

[jira] [Created] (TEZ-3983) VertexGroup ONE_TO_ONE edges do not produce the right graph

Adrian Nicoara created TEZ-3983:
-----------------------------------

             Summary: VertexGroup ONE_TO_ONE edges do not produce the right graph
                 Key: TEZ-3983
                 URL: https://issues.apache.org/jira/browse/TEZ-3983
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Adrian Nicoara


A VertexGroup is described to act as a union of multiple vertices.

Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union, then the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream vertex, must then require that vertex to also have 4 tasks.

This is not the case, as evidenced by the [following test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].] 

Rather, what happens is that implementation (of unrolling the VertexGroup and directly creating edges between the components of the VertexGroup and the downstream vertices) is presented as the behavior.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)