You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Dan Hill <qu...@gmail.com> on 2020/06/10 18:13:55 UTC

Re: How to safely update jobs in-flight using Apache Flink on AWS EMR?

Hi!  I'm assuming this question comes up regularly with AWS EMR.  I posted
it on Stack Overflow.

https://stackoverflow.com/questions/62309400/how-to-safely-update-jobs-in-flight-using-apache-flink-on-aws-emr

------------------------------------------------

I was not able to find instructions for how to update code safely. I see
Flink docs on how to use savepoints. I'd expect an easy solution for
updating Flink jobs in AWS EMR.

https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/deployment/aws.html

https://ci.apache.org/projects/flink/flink-docs-release-1.10/ops/upgrading.html

https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/savepoints.html

I was expecting instructions like the following (but not for Dataflow and
Apache Beam):

https://cloud.google.com/dataflow/docs/guides/updating-a-pipeline

https://medium.com/google-cloud/restarting-cloud-dataflow-in-flight-9c688c49adfd

>