[jira] [Commented] (FLINK-2491) Checkpointing only works if all operators/tasks are still running

["Lin Canhuang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16701630#comment-16701630 ] 

Lin Canhuang commented on FLINK-2491:
-------------------------------------

I also came across this problem when setting the source parallelism larger than the partitions of kafka.

I done this patch(using 1.6 release) for a workaround. I'm not sure it is fine or not, please check. THX. 

[^fix_checkpoint_not_working_if_tasks_are_finished.patch]

> Checkpointing only works if all operators/tasks are still running
> -----------------------------------------------------------------
>
>                 Key: FLINK-2491
>                 URL: https://issues.apache.org/jira/browse/FLINK-2491
>             Project: Flink
>          Issue Type: Bug
>          Components: DataStream API, State Backends, Checkpointing
>    Affects Versions: 0.10.0
>            Reporter: Robert Metzger
>            Assignee: Márton Balassi
>            Priority: Critical
>         Attachments: fix_checkpoint_not_working_if_tasks_are_finished.patch
>
>
> While implementing a test case for the Kafka Consumer, I came across the following bug:
> Consider the following topology, with the operator parallelism in parentheses:
> Source (2) --> Sink (1).
> In this setup, the {{snapshotState()}} method is called on the source, but not on the Sink.
> The sink receives the generated data.
> only one of the two sources is generating data.
> I've implemented a test case for this, you can find it here: https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)