[jira] [Closed] (FLINK-21054) Implement mini-batch optimized slicing window aggregate operator

["Jark Wu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-21054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jark Wu closed FLINK-21054.
---------------------------
    Resolution: Fixed

Fixed in master: c4bfa9fa68c2944582589b11c7d42b99356ca124

> Implement mini-batch optimized slicing window aggregate operator
> ----------------------------------------------------------------
>
>                 Key: FLINK-21054
>                 URL: https://issues.apache.org/jira/browse/FLINK-21054
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table SQL / Runtime
>            Reporter: Jark Wu
>            Assignee: Jark Wu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.13.0
>
>
> We have supported cumulative windows in FLINK-19605. However, the current cumulative window is not efficient, because the slices are not shared. 
> We leverages the slicing ideas proposed in FLINK-7001 and this design doc [1]. The slicing is an optimized implementation for hopping, cumulative, tumbling windows. Besides of that, we introduced ManagedMemory based mini-batch optimization for the slicing window aggregate operator, this can tremendously reduce the accessing of state and get the higher throughtput without latency loss.  
> [1]: https://docs.google.com/document/d/1ziVsuW_HQnvJr_4a9yKwx_LEnhVkdlde2Z5l6sx5HlY/edit#



--
This message was sent by Atlassian Jira
(v8.3.4#803005)