You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2021/03/30 15:54:00 UTC

[jira] [Created] (BEAM-12071) DataFrame IO sinks do not correctly partition by window

Brian Hulette created BEAM-12071:
------------------------------------

             Summary: DataFrame IO sinks do not correctly partition by window
                 Key: BEAM-12071
                 URL: https://issues.apache.org/jira/browse/BEAM-12071
             Project: Beam
          Issue Type: Improvement
          Components: sdk-py-core
            Reporter: Brian Hulette
            Assignee: Brian Hulette


I just discovered that when processing windowed data with DataFrameTransform, only one partition is written to every window, and a single window gets every other partition/window combination.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)