[jira] [Commented] (LIVY-719) Livy is not high available in aws EMR cluster

["Yiheng Wang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LIVY-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16985791#comment-16985791 ] 

Yiheng Wang commented on LIVY-719:
----------------------------------

Hi

We have proposed a JIRA for Livy HA.

https://issues.apache.org/jira/browse/LIVY-718

> Livy is not high available in aws EMR cluster
> ---------------------------------------------
>
>                 Key: LIVY-719
>                 URL: https://issues.apache.org/jira/browse/LIVY-719
>             Project: Livy
>          Issue Type: Bug
>            Reporter: chiranjeevi patel
>            Priority: Major
>
> Hi,
> We have been using the Livy in our EMR cluster to submit the batch jobs, now after upgrading to EMR 5.0.24 with multi master capability, livy is not able to handle the sessions on master failover.
> Livy is installed on all three master nodes and running as independent application, so a master node failure is bringing down the livy session, where EMR was abel to switch the active master to standby one, but out jobs were failing, since we lost the session with previous active master, and we need to explicitly connect to the new active master with a different IP.
>  
> Do you have any plans to support multi master (HA) clusters ?
> I have asked the AWS support team, and they responded as livy is due with many open source issues, and they can work on it only when these issues are sorted.
> Let me know if you need any further details
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)