You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 22:50:11 UTC
[GitHub] [beam] kennknowles opened a new issue, #19140: When using unbounded PCollection from TextIO to BigQuery, data is stuck in Reshuffle/GroupByKey inside of BigQueryIO
kennknowles opened a new issue, #19140:
URL: https://github.com/apache/beam/issues/19140
As a short summary, when reading from TextIO with watchForNewFiles (unbounded collection), BigQueryIO in stream mode, BigQueryIO does not write data. It is "stuck" in a GroupByKey internal to Reshuffle.
The issue is detailed in stackoverflow with code and version information.
[https://stackoverflow.com/questions/53266689/when-using-unbounded-pcollection-from-textio-to-bigquery-data-is-stuck-in-reshu](https://stackoverflow.com/questions/53266689/when-using-unbounded-pcollection-from-textio-to-bigquery-data-is-stuck-in-reshu)
Thanks!
Imported from Jira [BEAM-6061](https://issues.apache.org/jira/browse/BEAM-6061). Original Jira may contain additional context.
Reported by: Florian Baumert.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org