You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (Jira)" <ji...@apache.org> on 2020/05/11 15:02:00 UTC
[jira] [Updated] (FLINK-17573) There is duplicate source data in
ProcessWindowFunction
[ https://issues.apache.org/jira/browse/FLINK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Metzger updated FLINK-17573:
-----------------------------------
Priority: Major (was: Blocker)
> There is duplicate source data in ProcessWindowFunction
> -------------------------------------------------------
>
> Key: FLINK-17573
> URL: https://issues.apache.org/jira/browse/FLINK-17573
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
> Reporter: Tammy zhang
> Priority: Major
>
> i consumed kafka topic data, and keyby the stream, then use a ProcessWindowFunction in this keyedStream, and a strange phenomenon appeared, the process function's sourceData become duplicated, like:
> Input Data iterator:[H2update 623.0 2020-05-08 15:19:25.14, H2update 297.0 2020-05-08 15:19:28.501, H2update 832.0 2020-05-08 15:19:29.415]
> data iterator end----------------------------------
> Input Data iterator:[H1400 59.0 2020-05-08 15:19:07.087, H1400 83.0 2020-05-08 15:19:09.521]
> data iterator end----------------------------------
> Input Data iterator:[H2insert 455.0 2020-05-08 15:19:23.066, H2insert 910.0 2020-05-08 15:19:23.955, H2insert 614.0 2020-05-08 15:19:24.397, H2insert 556.0 2020-05-08 15:19:27.389, H2insert 922.0 2020-05-08 15:19:27.761, H2insert 165.0 2020-05-08 15:19:28.26]
> data iterator end----------------------------------
> Input Data iterator:[H1400 59.0 2020-05-08 15:19:07.087, H1400 83.0 2020-05-08 15:19:09.521]
> data iterator end----------------------------------
> Input Data iterator:[H2update 623.0 2020-05-08 15:19:25.14, H2update 297.0 2020-05-08 15:19:28.501, H2update 832.0 2020-05-08 15:19:29.415]
> data iterator end----------------------------------
> Input Data iterator:[H2insert 455.0 2020-05-08 15:19:23.066, H2insert 910.0 2020-05-08 15:19:23.955, H2insert 614.0 2020-05-08 15:19:24.397, H2insert 556.0 2020-05-08 15:19:27.389, H2insert 922.0 2020-05-08 15:19:27.761, H2insert 165.0 2020-05-08 15:19:28.26]
> data iterator end----------------------------------
> I can ensure that there is no duplication of kafka data, Could you help me point out where the problem is, thanks a lot
--
This message was sent by Atlassian Jira
(v8.3.4#803005)