You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Vishwas Siravara <vs...@gmail.com> on 2019/11/06 16:06:52 UTC

flink's hard dependency on zookeeper for HA

Hi all,
I am using flink 1.7.2 as a standalone cluster in high availability mode
with zookeeper. I have noticed that all flink processes go down once
zookeeper goes down ? Is this expected behavior since the leader election
has already happened and the job has been running for several hours.


Best,
Vishwas

Re: flink's hard dependency on zookeeper for HA

Posted by vino yang <ya...@gmail.com>.
Hi Vishwas,

In the standalone cluster HA mode, Flink heavily depends on ZooKeeper. Not
only for leader election, but also for:


   - Checkpoint metadata info;
   - JobGraph store;
   - ....

So you should make sure your ZooKeeper Cluster works normally. More details
please see[1][2].

Best,
Vino

[1]:
https://cwiki.apache.org/confluence/display/FLINK/JobManager+High+Availability
[2]:
https://ci.apache.org/projects/flink/flink-docs-master/ops/jobmanager_high_availability.html

Vishwas Siravara <vs...@gmail.com> 于2019年11月7日周四 上午12:07写道:

> Hi all,
> I am using flink 1.7.2 as a standalone cluster in high availability mode
> with zookeeper. I have noticed that all flink processes go down once
> zookeeper goes down ? Is this expected behavior since the leader election
> has already happened and the job has been running for several hours.
>
>
> Best,
> Vishwas
>