You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "wangkang (Jira)" <ji...@apache.org> on 2022/12/27 12:00:00 UTC
[jira] [Updated] (FLINK-30512) Flink SQL state TTL has no effect when using Interval Join
[ https://issues.apache.org/jira/browse/FLINK-30512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wangkang updated FLINK-30512:
-----------------------------
Description:
Take the following join SQL program as an example:
{code:java}
SET 'table.exec.state.ttl' = '900000 ms';
select
...
from kafka_source_dwdexpose as t1
left join kafka_source_expose_attr_click t3
ON t1.mid = t3.mid and t1.sr = t3.sr
and t1.time_local = t3.time_local
and t1.log_ltz BETWEEN t3.log_ltz - INTERVAL '2' MINUTE AND t3.log_ltz + INTERVAL '2' MINUTE {code}
!flink1.16.png|width=906,height=278!
the state size is getting bigger and bigger.
we also test the same sql with flink sql 1.13,the state size is stable.
was:
Take the following join SQL program as an example:
{code:java}
SET 'table.exec.state.ttl' = '900000 ms';
select
...
from kafka_source_dwdexpose as t1
left join kafka_source_expose_attr_click t3
ON t1.mid = t3.mid and t1.sr = t3.sr
and t1.time_local = t3.time_local
and t1.log_ltz BETWEEN t3.log_ltz - INTERVAL '2' MINUTE AND t3.log_ltz + INTERVAL '2' MINUTE {code}
!flink1.16.png!
the state size is getting bigger and bigger.
we also test the same sql with flink sql 1.13,the state size is stable.
> Flink SQL state TTL has no effect when using Interval Join
> ----------------------------------------------------------
>
> Key: FLINK-30512
> URL: https://issues.apache.org/jira/browse/FLINK-30512
> Project: Flink
> Issue Type: Bug
> Components: Runtime / State Backends
> Affects Versions: 1.15.1, 1.16.1
> Reporter: wangkang
> Priority: Major
> Attachments: flink1.16.png
>
>
> Take the following join SQL program as an example:
> {code:java}
> SET 'table.exec.state.ttl' = '900000 ms';
> select
> ...
> from kafka_source_dwdexpose as t1
> left join kafka_source_expose_attr_click t3
> ON t1.mid = t3.mid and t1.sr = t3.sr
> and t1.time_local = t3.time_local
> and t1.log_ltz BETWEEN t3.log_ltz - INTERVAL '2' MINUTE AND t3.log_ltz + INTERVAL '2' MINUTE {code}
> !flink1.16.png|width=906,height=278!
> the state size is getting bigger and bigger.
> we also test the same sql with flink sql 1.13,the state size is stable.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)