Flink dynamic scaling 1.5

[Anil <an...@gmail.com>]

This is regarding dynamic rescaling in Flink 1.5

I am using Yarn for running Flink jobs. I start these jobs with a static
resource. Is there any option to scale out these job by itself in specific
conditions like if there's a memory issues.

In Flink 1.5 release notes -

Applications can be rescaled without manually triggering a savepoint. Under 
the hood, Flink will still take a savepoint, stop the application, and 
rescale it to the new parallelism.

This means that I will have to monitor my jobs memory and will have to
trigger rescale manually. Is these any workaround to handle this.



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Flink dynamic scaling 1.5

[Anil <an...@gmail.com>]

Thanks for the reply Till. Resubmitting the job is an option. 
I was wondering if there's any way that Flink could be configured to detect
issues like a memory issue and rescale without me submitting the job again. 



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/