You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2015/08/06 14:31:04 UTC
[jira] [Updated] (FLINK-2491) Operators are not participating in
state checkpointing in some cases
[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Metzger updated FLINK-2491:
----------------------------------
Description:
While implementing a test case for the Kafka Consumer, I came across the following bug:
Consider the following topology, with the operator parallelism in parentheses:
Source (2) --> Sink (1).
In this setup, the {{snapshotState()}} method is called on the source, but not on the Sink.
The sink receives the generated data.
The only one of the two sources is generating data.
I've implemented a test case for this, you can find it here: https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java
was:
While implementing a test case for the Kafka Consumer, I came across the following bug:
Consider the following topology, with the operator parallelism in parentheses:
Source (2) --> Sink (1).
In this setup, the {{snapshotState()}} method is called on the source, but not on the Sink.
The sink receives the generated data.
The only one of the two sources is generating data.
I've implemented a test case for this, you can find it here: https://github.com/rmetzger/flink/tree/para_checkpoint_bug
> Operators are not participating in state checkpointing in some cases
> --------------------------------------------------------------------
>
> Key: FLINK-2491
> URL: https://issues.apache.org/jira/browse/FLINK-2491
> Project: Flink
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 0.10
> Reporter: Robert Metzger
> Priority: Critical
>
> While implementing a test case for the Kafka Consumer, I came across the following bug:
> Consider the following topology, with the operator parallelism in parentheses:
> Source (2) --> Sink (1).
> In this setup, the {{snapshotState()}} method is called on the source, but not on the Sink.
> The sink receives the generated data.
> The only one of the two sources is generating data.
> I've implemented a test case for this, you can find it here: https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)