You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "wangpeibin (Jira)" <ji...@apache.org> on 2021/01/29 11:51:00 UTC

[jira] [Updated] (FLINK-21202) Introduce TimeWindow and CountWindow in PyFlink

     [ https://issues.apache.org/jira/browse/FLINK-21202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

wangpeibin updated FLINK-21202:
-------------------------------
    Description: 
Now, when the lastrow function is used for de duplication, if two successive rows are equal, a fallback row and an update row will still be generated, which will trigger downstream repeated calculation.

Therefore, by optimizing the logic of the deduplicatefunctionhelper, when the two rows before and after the fallback are equal, it can automatically offset, thus reducing the amount of calculation

In order to reduce the impact on the existing logic, this change can be opened manually by adding a configuration item as a switch

  was:Introduce TimeWindow, CountWindow and corresponding coders.


> Introduce TimeWindow and CountWindow in PyFlink
> -----------------------------------------------
>
>                 Key: FLINK-21202
>                 URL: https://issues.apache.org/jira/browse/FLINK-21202
>             Project: Flink
>          Issue Type: Sub-task
>          Components: API / Python
>    Affects Versions: 1.13.0
>            Reporter: Huang Xingbo
>            Priority: Major
>             Fix For: 1.13.0
>
>
> Now, when the lastrow function is used for de duplication, if two successive rows are equal, a fallback row and an update row will still be generated, which will trigger downstream repeated calculation.
> Therefore, by optimizing the logic of the deduplicatefunctionhelper, when the two rows before and after the fallback are equal, it can automatically offset, thus reducing the amount of calculation
> In order to reduce the impact on the existing logic, this change can be opened manually by adding a configuration item as a switch



--
This message was sent by Atlassian Jira
(v8.3.4#803005)