You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2020/11/05 13:18:00 UTC

[jira] [Closed] (FLINK-19079) Support row time deduplicate operator

     [ https://issues.apache.org/jira/browse/FLINK-19079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jark Wu closed FLINK-19079.
---------------------------
    Fix Version/s: 1.12.0
       Resolution: Fixed

Fixed in master (1.12.0): ad18d13080f409223e955a1bb7c80239b74989a2

> Support row time deduplicate operator
> -------------------------------------
>
>                 Key: FLINK-19079
>                 URL: https://issues.apache.org/jira/browse/FLINK-19079
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table SQL / Runtime
>            Reporter: Leonard Xu
>            Assignee: Leonard Xu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.12.0
>
>
> To convert a insert-only table to versioned table, the recommended way is use deduplicate query as following, the converted *versioned_view* owns primary key and event time and thus can be a versioned table.
> {code:java}
> CREATE VIEW versioned_rates AS
> SELECT currency, rate, currency_time
> FROM (
>       SELECT *,
>       ROW_NUMBER() OVER (PARTITION BY currency   -- inferred primary key
>             ORDER BY currency_time               -- the event time  
>         DESC) AS rowNum
>       FROM rates)
> WHERE rowNum = 1;
> {code}
> But currently deduplicate operator only support on process time, this issue aims to support deduplicate on Event time.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)