You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Vishal Santoshi <vi...@gmail.com> on 2021/03/09 18:56:21 UTC
Flink and Nomad ( from Hashicorp)
Is there any reason not to have Nomad HA on the lines of K8s HA ? I think
it would depend on how puggable the HA core code is ? Any links to how
ZK/K8s code specifically for HA would be highly appreciated....
Re: Flink and Nomad ( from Hashicorp)
Posted by Vishal Santoshi <vi...@gmail.com>.
Makes total sense, Thanks, I'll check it out.
On Wed, Mar 10, 2021 at 1:28 PM Till Rohrmann <tr...@apache.org> wrote:
> Hi Vishal,
>
> There is no specific reason why Flink does not have a Nomad HA
> implementation other than it has not been done yet. As long as Nomad
> supports leader election, service recovery and persisting small data it
> should be possible to implement HighAvailabilityServices against it. The
> best pointers to get started would be the implementation of the
> HighAvailabilityServices [1,2].
>
> If you would like to contribute such a feature, then please open a JIRA
> ticket for it.
>
> [1]
> https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/highavailability/zookeeper/ZooKeeperHaServices.java
> [2]
> https://github.com/apache/flink/blob/master/flink-kubernetes/src/main/java/org/apache/flink/kubernetes/highavailability/KubernetesHaServices.java
>
> Cheers,
> Till
>
> On Tue, Mar 9, 2021 at 7:56 PM Vishal Santoshi <vi...@gmail.com>
> wrote:
>
>> Is there any reason not to have Nomad HA on the lines of K8s HA ? I
>> think it would depend on how puggable the HA core code is ? Any links to
>> how ZK/K8s code specifically for HA would be highly appreciated....
>>
>
Re: Flink and Nomad ( from Hashicorp)
Posted by Till Rohrmann <tr...@apache.org>.
Hi Vishal,
There is no specific reason why Flink does not have a Nomad HA
implementation other than it has not been done yet. As long as Nomad
supports leader election, service recovery and persisting small data it
should be possible to implement HighAvailabilityServices against it. The
best pointers to get started would be the implementation of the
HighAvailabilityServices [1,2].
If you would like to contribute such a feature, then please open a JIRA
ticket for it.
[1]
https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/highavailability/zookeeper/ZooKeeperHaServices.java
[2]
https://github.com/apache/flink/blob/master/flink-kubernetes/src/main/java/org/apache/flink/kubernetes/highavailability/KubernetesHaServices.java
Cheers,
Till
On Tue, Mar 9, 2021 at 7:56 PM Vishal Santoshi <vi...@gmail.com>
wrote:
> Is there any reason not to have Nomad HA on the lines of K8s HA ? I think
> it would depend on how puggable the HA core code is ? Any links to how
> ZK/K8s code specifically for HA would be highly appreciated....
>