[GitHub] [beam] damccorm opened a new issue, #20408: Reshuffle seems to be dropping elements in streaming Dataflow pipeline.

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #20408:
URL: https://github.com/apache/beam/issues/20408

   https://stackoverflow.com/questions/62017572/beam-java-dataflow-bigquery-streaming-insert-groupbykey-reducing-elements
   
   This showed up on SO and it shows a GBK in a reshuffle actually dropping elements. I asked the user if they've tried it on other runners, and from what I understood they tried with the Direct runner but never got to the point in the pipeline where the original issue occurred, so it's hard to tell if this is a runner or SDK issue. The user has also contacted Dataflow support.
   
   Not sure if this is high priority or not or who would be an appropriate assignee, so I'll just leave the bug unassigned for future reference, so if this pops up again there's evidence that it's been a problem. 
   
   Imported from Jira [BEAM-10228](https://issues.apache.org/jira/browse/BEAM-10228). Original Jira may contain additional context.
   Reported by: danoliveira.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org