You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Roman Khachatryan (Jira)" <ji...@apache.org> on 2020/10/31 16:57:00 UTC
[jira] [Updated] (FLINK-19907) Channel state (upstream) can be
restored after emission of new elements (watermarks)
[ https://issues.apache.org/jira/browse/FLINK-19907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Khachatryan updated FLINK-19907:
--------------------------------------
Description:
In StreamTask.beforeInvoke:
1. operatorChain.initializeStateAndOpenOperators(createStreamTaskStateInitializer());
2. readRecoveredChannelState();
But operatorChain.initializeStateAndOpenOperators can emit watermarks (or potentially some other stream elements).
I've encountered this issue while adding an EndOfRecovery marker - in some runs of in OverWindowITCase.testRowTimeBoundedPartitionedRangeOver the marker was emitted after the watermark.
cc: [~zjwang], [~pnowojski]
was:
In StreamTask.beforeInvoke:
operatorChain.initializeStateAndOpenOperators(createStreamTaskStateInitializer()); readRecoveredChannelState();
But operatorChain.initializeStateAndOpenOperators can emit watermarks (or potentially some other stream elements).
I've encountered this issue while adding an EndOfRecovery marker - in some runs of in OverWindowITCase.testRowTimeBoundedPartitionedRangeOver the marker was emitted after the watermark.
cc: [~zjwang], [~pnowojski]
> Channel state (upstream) can be restored after emission of new elements (watermarks)
> ------------------------------------------------------------------------------------
>
> Key: FLINK-19907
> URL: https://issues.apache.org/jira/browse/FLINK-19907
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Affects Versions: 1.12.0, 1.11.2
> Reporter: Roman Khachatryan
> Assignee: Roman Khachatryan
> Priority: Major
> Fix For: 1.12.0
>
>
> In StreamTask.beforeInvoke:
> 1. operatorChain.initializeStateAndOpenOperators(createStreamTaskStateInitializer());
> 2. readRecoveredChannelState();
> But operatorChain.initializeStateAndOpenOperators can emit watermarks (or potentially some other stream elements).
> I've encountered this issue while adding an EndOfRecovery marker - in some runs of in OverWindowITCase.testRowTimeBoundedPartitionedRangeOver the marker was emitted after the watermark.
>
> cc: [~zjwang], [~pnowojski]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)