You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/09/01 01:46:00 UTC

[jira] [Assigned] (FLINK-19079) Support row time deduplicate operator

     [ https://issues.apache.org/jira/browse/FLINK-19079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee reassigned FLINK-19079:
------------------------------------

    Assignee: Leonard Xu

> Support row time deduplicate operator
> -------------------------------------
>
>                 Key: FLINK-19079
>                 URL: https://issues.apache.org/jira/browse/FLINK-19079
>             Project: Flink
>          Issue Type: Sub-task
>            Reporter: Leonard Xu
>            Assignee: Leonard Xu
>            Priority: Major
>
> To convert a insert-only table to versioned table, the recommended way is use deduplicate query as following, the converted *versioned_view* owns primary key and event time and thus can be a versioned table.
> {code:java}
> CREATE VIEW versioned_rates AS
> SELECT currency, rate, currency_time
> FROM (
>       SELECT *,
>       ROW_NUMBER() OVER (PARTITION BY currency   -- inferred primary key
>             ORDER BY currency_time               -- the event time  
>         DESC) AS rowNum
>       FROM rates)
> WHERE rowNum = 1;
> {code}
> But currently deduplicate operator only support on process time, this issue aims to support deduplicate on Event time.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)