[jira] [Updated] (TEZ-3654) CartesianProduct edge won't work with GroupInputEdge

["Zhiyuan Yang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhiyuan Yang updated TEZ-3654:
------------------------------
    Attachment: TEZ-3654.1.patch

Changes: 
1. expose input vertex group information to Vertex/Edge Manager plugin
2. rewritten cartesian product edge to make it work with input vertex group

Please help review when you get time. [~sseth], [~mingma]

> CartesianProduct edge won't work with GroupInputEdge
> ----------------------------------------------------
>
>                 Key: TEZ-3654
>                 URL: https://issues.apache.org/jira/browse/TEZ-3654
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Zhiyuan Yang
>            Assignee: Zhiyuan Yang
>         Attachments: TEZ-3654.1.patch
>
>
> If a vertex group is used as source of cartesian product, it expands into multiple vertices that share the same edge properties and each CP edge is taken as individual cartesian product source by CP vertex manager. CP vertex manager will find there are more CP edge than expected and abort the AM.  
> Ideally group edge semantic should be fixed: both task and vertex manager should see same number of sources; also not every edge can be simply duplicated.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)