You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Fabian Hueske (JIRA)" <ji...@apache.org> on 2016/10/26 21:22:58 UTC

[jira] [Created] (FLINK-4937) Add incremental group window aggregation for streaming Table API

Fabian Hueske created FLINK-4937:
------------------------------------

             Summary: Add incremental group window aggregation for streaming Table API
                 Key: FLINK-4937
                 URL: https://issues.apache.org/jira/browse/FLINK-4937
             Project: Flink
          Issue Type: Sub-task
          Components: Table API & SQL
    Affects Versions: 1.2.0
            Reporter: Fabian Hueske


Group-window aggregates for streaming tables are currently not done in an incremental fashion. This means that the window collects all records and performs the aggregation when the window is closed instead of eagerly updating a partial aggregate for every added record. Since records are buffered, non-incremental aggregation requires more storage space than incremental aggregation.

The DataStream API which is used under the hood of the streaming Table API features [incremental aggregation|https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/windows.html#windowfunction-with-incremental-aggregation] using a {{ReduceFunction}}.

We should add support for incremental aggregation in group-windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)