[jira] [Created] (BEAM-11086) [Go SDK] Validate windows are aggregated correctly in GBKs and Combines

["Robert Burke (Jira)" <ji...@apache.org>]

Robert Burke created BEAM-11086:
-----------------------------------

             Summary: [Go SDK] Validate windows are aggregated correctly in GBKs and Combines
                 Key: BEAM-11086
                 URL: https://issues.apache.org/jira/browse/BEAM-11086
             Project: Beam
          Issue Type: Sub-task
          Components: sdk-go
            Reporter: Robert Burke


Add an integration test to validate windowing behavior against real runners, in particular WRT GroupByKey operations.

This entails writing small batch test pipelines that assign event times, and window into those transforms. Windows are assigned by the the runner as per the given windowing strategy.

Code should be added in the sdks/go/test directory [https://github.com/apache/beam/tree/master/sdks/go/test/integration/primitives]

and hooked up so that they're run as part of the post commit tests. 

In particular, a multi-window case with a sliding window, and a lifted combiner (like stats.Sum) should be written. It's unlikely the current Combiner Lifting implementation takes windows into account correctly, leading to correctness issues when they are used simultaneously.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)