You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Sushil Ks <su...@gmail.com> on 2018/01/03 13:04:34 UTC
Job Manager not able to fetch job info when restarted
Hi,
We are launching Flink on Yarn job, here whenever the job manager
gets restarted, the previous task that was running doesn't get restarted
instead it shows no jobs running. Is there a way to resume previous running
task, when job manager restarts.
Regards,
Sushil Ks
Re: Job Manager not able to fetch job info when restarted
Posted by Sushil Ks <su...@gmail.com>.
Oh okay! Thanks!
On Jan 4, 2018 2:47 PM, "Stefan Richter" <s....@data-artisans.com>
wrote:
> Yes, HA is required for what you want to do. I am not aware of an alert
> mechanism in Flink, but would assume that this is something that should
> better be solved on the YARN level?
>
> Best,
> Stefan
>
> Am 03.01.2018 um 19:27 schrieb Sushil Ks <su...@gmail.com>:
>
> Hi Stefan,
> It was just ran without HA, via yarn. Will try running a yarn
> session with HA and test, thanks for you time. Also is there a way we can
> get alerts if a pipeline restarts or gets cancelled in Flink?
>
> Regards,
> Sushil Ks
>
> On Jan 3, 2018 7:07 PM, "Stefan Richter" <s....@data-artisans.com>
> wrote:
>
>> Hi,
>>
>> did you configure high availability with Zookeeper, as described here:
>> https://ci.apache.org/projects/flink/flink-docs-releas
>> e-1.3/setup/jobmanager_high_availability.html ? This should bring the
>> desired behaviour.
>>
>> Best,
>> Stefan
>>
>> Am 03.01.2018 um 14:04 schrieb Sushil Ks <su...@gmail.com>:
>>
>> Hi,
>> We are launching Flink on Yarn job, here whenever the job manager
>> gets restarted, the previous task that was running doesn't get restarted
>> instead it shows no jobs running. Is there a way to resume previous running
>> task, when job manager restarts.
>>
>> Regards,
>> Sushil Ks
>>
>>
>>
>
Re: Job Manager not able to fetch job info when restarted
Posted by Stefan Richter <s....@data-artisans.com>.
Yes, HA is required for what you want to do. I am not aware of an alert mechanism in Flink, but would assume that this is something that should better be solved on the YARN level?
Best,
Stefan
> Am 03.01.2018 um 19:27 schrieb Sushil Ks <su...@gmail.com>:
>
> Hi Stefan,
> It was just ran without HA, via yarn. Will try running a yarn session with HA and test, thanks for you time. Also is there a way we can get alerts if a pipeline restarts or gets cancelled in Flink?
>
> Regards,
> Sushil Ks
>
>
> On Jan 3, 2018 7:07 PM, "Stefan Richter" <s.richter@data-artisans.com <ma...@data-artisans.com>> wrote:
> Hi,
>
> did you configure high availability with Zookeeper, as described here: https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/jobmanager_high_availability.html <https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/jobmanager_high_availability.html> ? This should bring the desired behaviour.
>
> Best,
> Stefan
>
>> Am 03.01.2018 um 14:04 schrieb Sushil Ks <sushil416@gmail.com <ma...@gmail.com>>:
>>
>> Hi,
>> We are launching Flink on Yarn job, here whenever the job manager gets restarted, the previous task that was running doesn't get restarted instead it shows no jobs running. Is there a way to resume previous running task, when job manager restarts.
>>
>> Regards,
>> Sushil Ks
>
Re: Job Manager not able to fetch job info when restarted
Posted by Sushil Ks <su...@gmail.com>.
Hi Stefan,
It was just ran without HA, via yarn. Will try running a yarn
session with HA and test, thanks for you time. Also is there a way we can
get alerts if a pipeline restarts or gets cancelled in Flink?
Regards,
Sushil Ks
On Jan 3, 2018 7:07 PM, "Stefan Richter" <s....@data-artisans.com>
wrote:
> Hi,
>
> did you configure high availability with Zookeeper, as described here:
> https://ci.apache.org/projects/flink/flink-docs-
> release-1.3/setup/jobmanager_high_availability.html ? This should bring
> the desired behaviour.
>
> Best,
> Stefan
>
> Am 03.01.2018 um 14:04 schrieb Sushil Ks <su...@gmail.com>:
>
> Hi,
> We are launching Flink on Yarn job, here whenever the job manager
> gets restarted, the previous task that was running doesn't get restarted
> instead it shows no jobs running. Is there a way to resume previous running
> task, when job manager restarts.
>
> Regards,
> Sushil Ks
>
>
>
Re: Job Manager not able to fetch job info when restarted
Posted by sen <se...@163.com>.
If I want the job be restarted after jobmanager restart ,is it must be
zookeeper when on HA mode?
high-availability: zookeeper
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Job Manager not able to fetch job info when restarted
Posted by Stefan Richter <s....@data-artisans.com>.
Hi,
did you configure high availability with Zookeeper, as described here: https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/jobmanager_high_availability.html <https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/jobmanager_high_availability.html> ? This should bring the desired behaviour.
Best,
Stefan
> Am 03.01.2018 um 14:04 schrieb Sushil Ks <su...@gmail.com>:
>
> Hi,
> We are launching Flink on Yarn job, here whenever the job manager gets restarted, the previous task that was running doesn't get restarted instead it shows no jobs running. Is there a way to resume previous running task, when job manager restarts.
>
> Regards,
> Sushil Ks