[jira] [Updated] (BEAM-12040) WriteFiles withRunnerDeterminedSharding for unbounded data doesn't work with merging windows

["Kenneth Knowles (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-12040:
-----------------------------------

This Jira ticket has a pull request attached to it, but is still open. Did the pull request resolve the issue? If so, could you please mark it resolved? This will help the project have a clear view of its open issues.

> WriteFiles withRunnerDeterminedSharding for unbounded data doesn't work with merging windows
> --------------------------------------------------------------------------------------------
>
>                 Key: BEAM-12040
>                 URL: https://issues.apache.org/jira/browse/BEAM-12040
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-files
>            Reporter: Siyuan Chen
>            Priority: P3
>          Time Spent: 5h 50m
>  Remaining Estimate: 0h
>
> Currently the implementation of `withRunnerDeterminedShardingUnbounded` uses a stateful DoFn to achieve the grouping and batching of the input elements, which doesn't support session windows. One possible way is to add another GBK prior to the stateful DoFn to first get session windows merged and reify the window before invoking the sateful DoFn. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)