You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "sridhar Reddy (Jira)" <ji...@apache.org> on 2019/10/03 00:08:00 UTC
[jira] [Comment Edited] (BEAM-7049) Merge multiple input to one
BeamUnionRel
[ https://issues.apache.org/jira/browse/BEAM-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943253#comment-16943253 ]
sridhar Reddy edited comment on BEAM-7049 at 10/3/19 12:07 AM:
---------------------------------------------------------------
Sounds good. Take your time. I appreciate you helping people on the Outreachy program besides me. You are a great apache beam community member!
was (Author: sridharg):
Sounds good. Take your time. I appreciate you helping people on the Outreachy program besides me.
> Merge multiple input to one BeamUnionRel
> ----------------------------------------
>
> Key: BEAM-7049
> URL: https://issues.apache.org/jira/browse/BEAM-7049
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
> Reporter: Rui Wang
> Assignee: sridhar Reddy
> Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
> BeamUnionRel assumes inputs are two and rejects more. So `a UNION b UNION c` will have to be created as UNION(a, UNION(b, c)) and have two shuffles. If BeamUnionRel can handle multiple shuffles, we will have only one shuffle
--
This message was sent by Atlassian Jira
(v8.3.4#803005)