You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user-zh@flink.apache.org by yanyunpeng <ya...@rockontrol.com> on 2021/07/13 06:37:59 UTC

flink 消费kafka 数据去重后聚合问题

create view distinct_view as 
select val,ptime from (select * ,ROW_NUMBER() OVER (PARTITION BY MN ORDER BY ptime ) as rowNum from test_udf) where rowNum = 1


select avg(val) as avg_var, STDDEV_POP(val) as spddev_pop_var from distinct_view GROUP BY HOP(ptime, INTERVAL '2' SECONDS, INTERVAL '1' DAY);

kafka的数据有重复 但是这么写有问题 请问这种情况应该怎么写