[jira] [Commented] (BEAM-5396) Flink portable runner savepoint / upgrade support

["Thomas Weise (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702791#comment-16702791 ] 

Thomas Weise commented on BEAM-5396:
------------------------------------

I started work to add the pipeline options. But as of Flink v1.5.5 there is no support to pass the savepoint restore settings via RemoteStreamEnvironment. The RestClusterClient has the ability to accept them though.

[https://github.com/apache/flink/blob/release-1.5/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/RemoteStreamEnvironment.java#L222]

[https://github.com/apache/flink/blob/release-1.5/flink-clients/src/main/java/org/apache/flink/client/program/ClusterClient.java#L455]

 

> Flink portable runner savepoint / upgrade support
> -------------------------------------------------
>
>                 Key: BEAM-5396
>                 URL: https://issues.apache.org/jira/browse/BEAM-5396
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Major
>              Labels: portability, portability-flink
>
> The portable Flink runner needs to support Flink savepoints for production use. It should be possible to upgrade a stateful portable Beam pipeline that runs on Flink, which involves taking a savepoint and then starting the new version of the pipeline from that savepoint. The potential issues with pipeline evolution and migration are similar to those when using the Flink DataStream API (schema / name changes etc.).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)