You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 22:50:11 UTC

[GitHub] [beam] kennknowles opened a new issue, #19140: When using unbounded PCollection from TextIO to BigQuery, data is stuck in Reshuffle/GroupByKey inside of BigQueryIO

kennknowles opened a new issue, #19140:
URL: https://github.com/apache/beam/issues/19140

   As a short summary, when reading from TextIO with watchForNewFiles (unbounded collection), BigQueryIO in stream mode, BigQueryIO does not write data. It is "stuck" in a GroupByKey internal to Reshuffle.
   
    
   
   The issue is detailed in stackoverflow with code and version information.
   
   [https://stackoverflow.com/questions/53266689/when-using-unbounded-pcollection-from-textio-to-bigquery-data-is-stuck-in-reshu](https://stackoverflow.com/questions/53266689/when-using-unbounded-pcollection-from-textio-to-bigquery-data-is-stuck-in-reshu)
   
    
   
    Thanks!
   
   Imported from Jira [BEAM-6061](https://issues.apache.org/jira/browse/BEAM-6061). Original Jira may contain additional context.
   Reported by: Florian Baumert.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org