You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Boyuan Zhang (Jira)" <ji...@apache.org> on 2020/10/22 23:43:00 UTC
[jira] [Commented] (BEAM-11107) GreedFuserPipeline drops side input
from PTransform.inputs() when fusion happens
[ https://issues.apache.org/jira/browse/BEAM-11107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17219384#comment-17219384 ]
Boyuan Zhang commented on BEAM-11107:
-------------------------------------
The problem is caused by [sanitizeDanglingPTransformInputs|https://github.com/apache/beam/blob/master/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/graph/GreedyPipelineFuser.java#L350-L424] function, which drops the sideInput from transforms if the sideInput is not specified in the ExecutableStage. It seems like when fusing transforms into ExecutableStage, we didn't populate sideInput correctly.
> GreedFuserPipeline drops side input from PTransform.inputs() when fusion happens
> --------------------------------------------------------------------------------
>
> Key: BEAM-11107
> URL: https://issues.apache.org/jira/browse/BEAM-11107
> Project: Beam
> Issue Type: Bug
> Components: java-fn-execution
> Reporter: Boyuan Zhang
> Priority: P2
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)