[jira] [Commented] (BEAM-1812) Allow configuring checkpoints in Flink Runner PipelineOptions

["Jins George (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954561#comment-15954561 ] 

Jins George commented on BEAM-1812:
-----------------------------------

Hi [~aljoscha],
Can you assign this ticket to me. I have analyzed and added external check-pointing configurations to FlinkPipelineOptions in my forked repo. I was able to resume from the last kafka offset after a cancel and restart.  I can submit a pull request.

Thanks,
Jins

> Allow configuring checkpoints in Flink Runner PipelineOptions
> -------------------------------------------------------------
>
>                 Key: BEAM-1812
>                 URL: https://issues.apache.org/jira/browse/BEAM-1812
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>
> Flink allows fine grained configuration of checkpointing: https://github.com/aljoscha/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/CheckpointConfig.java
> Among other things this allows to configure externalised checkpoints, which is a valuable feature when running a job in production because it allows restoring a job after a failure as from a savepoint.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)