You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2021/01/20 10:17:00 UTC

[jira] [Created] (FLINK-21054) Implement mini-batch optimized slicing window aggregate operator

Jark Wu created FLINK-21054:
-------------------------------

             Summary: Implement mini-batch optimized slicing window aggregate operator
                 Key: FLINK-21054
                 URL: https://issues.apache.org/jira/browse/FLINK-21054
             Project: Flink
          Issue Type: Sub-task
          Components: Table SQL / Runtime
            Reporter: Jark Wu
            Assignee: Jark Wu
             Fix For: 1.13.0


We have supported cumulative windows in FLINK-19605. However, the current cumulative window is not efficient, because the slices are not shared. 

We leverages the slicing ideas proposed in FLINK-7001 and this design doc [1]. The slicing is an optimized implementation for hopping, cumulative, tumbling windows. Besides of that, we introduced ManagedMemory based mini-batch optimization for the slicing window aggregate operator, this can tremendously reduce the accessing of state and get the higher throughtput without latency loss.  

[1]: https://docs.google.com/document/d/1ziVsuW_HQnvJr_4a9yKwx_LEnhVkdlde2Z5l6sx5HlY/edit#



--
This message was sent by Atlassian Jira
(v8.3.4#803005)