You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Niel Markwick (Jira)" <ji...@apache.org> on 2022/03/24 19:49:00 UTC

[jira] [Created] (BEAM-14171) CoGroupByKey loses values with large groups on Dataflow v1

Niel Markwick created BEAM-14171:
------------------------------------

             Summary: CoGroupByKey loses values with large groups on Dataflow v1
                 Key: BEAM-14171
                 URL: https://issues.apache.org/jira/browse/BEAM-14171
             Project: Beam
          Issue Type: Bug
          Components: runner-dataflow, sdk-java-core
    Affects Versions: 2.37.0, 2.36.0
            Reporter: Niel Markwick
            Assignee: Robert Bradshaw
             Fix For: 2.38.0


CoGroupByKey can lose elements - replacing them with null values when a group is large (>10,000 elements).

 

This only occurs in dataflow v1, not dataflow-v2 runner

Possibly related to BEAM-13541.

 

https://lists.apache.org/thread/5y56kbgm3q0m1byzf7186rrkomrcfldm

 

 

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)