You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Mingwei Samuel (JIRA)" <ji...@apache.org> on 2017/10/05 00:22:00 UTC
[jira] [Updated] (BEAM-3017) DropInputs on
BigQueryIO.writeTableRows() sink
[ https://issues.apache.org/jira/browse/BEAM-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mingwei Samuel updated BEAM-3017:
---------------------------------
Description:
After upgrade to version 2.1.0 there are "DropInput##" transforms on every output of my pipeline, outside of their corresponding transforms. They're getting added to my
{{BigQueryIO.<T>writeTableRows()}}
sinks, even though looking at the source code it appears that these "DropInput" transforms are supposed to pull from reads that do not have any outputs, so I'm not sure why they're getting added to sinks.
These transforms are flooding my graph and filling it with junk, for example: !https://i.imgur.com/jXtn9Gr.png|thumbnail!
was:
After upgrade to version 2.1.0 there are "DropInput##" transforms on every output of my pipeline, outside of their corresponding transforms. They're getting added to my
{{BigQueryIO.<T>writeTableRows()}}
sinks, even though looking at the source code it appears that these "DropInput" transforms are supposed to pull from reads that do not have any outputs, so I'm not sure why they're getting added to sinks.
These transforms are flooding my graph and filling it with junk, for example: !https://i.imgur.com/jXtn9Gr.png!
Summary: DropInputs on BigQueryIO.writeTableRows() sink (was: DropInputs on every Sink, Breaking Transform Flow)
> DropInputs on BigQueryIO.writeTableRows() sink
> ----------------------------------------------
>
> Key: BEAM-3017
> URL: https://issues.apache.org/jira/browse/BEAM-3017
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Affects Versions: 2.1.0
> Reporter: Mingwei Samuel
> Assignee: Thomas Groh
> Priority: Minor
>
> After upgrade to version 2.1.0 there are "DropInput##" transforms on every output of my pipeline, outside of their corresponding transforms. They're getting added to my
> {{BigQueryIO.<T>writeTableRows()}}
> sinks, even though looking at the source code it appears that these "DropInput" transforms are supposed to pull from reads that do not have any outputs, so I'm not sure why they're getting added to sinks.
> These transforms are flooding my graph and filling it with junk, for example: !https://i.imgur.com/jXtn9Gr.png|thumbnail!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)