You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "David Morávek (Jira)" <ji...@apache.org> on 2020/12/12 12:29:00 UTC

[jira] [Created] (BEAM-11443) Byte-based GroupByKey in Flink Streaming

David Morávek created BEAM-11443:
------------------------------------

             Summary: Byte-based GroupByKey in Flink Streaming
                 Key: BEAM-11443
                 URL: https://issues.apache.org/jira/browse/BEAM-11443
             Project: Beam
          Issue Type: Improvement
          Components: runner-flink
            Reporter: David Morávek
            Assignee: David Morávek


Currently Flink Streaming GBK is implemented using `SystemReduceFn#buffering`, that works on de-serialized values (we need to de-serialize value after shuffle and then serialize again when appending to bag state).

We can remove this unnecessary serde cycle by using binary representation instead of de-serialized payload.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)