[jira] [Created] (LIVY-718) Support multi-active high availability in Livy

["Yiheng Wang (Jira)" <ji...@apache.org>]

Yiheng Wang created LIVY-718:
--------------------------------

             Summary: Support multi-active high availability in Livy
                 Key: LIVY-718
                 URL: https://issues.apache.org/jira/browse/LIVY-718
             Project: Livy
          Issue Type: Epic
          Components: RSC, Server
            Reporter: Yiheng Wang


In this JIRA we want to discuss how to implement multi-active high availability in Livy.

Currently, Livy only supports single node recovery. This is not sufficient in some production environments. In our scenario, the Livy server serves many notebook and JDBC services. We want to make Livy service more fault-tolerant and scalable.

There're already some proposals in the community for high availability. But they're not so complete or just for active-standby high availability. So we propose a multi-active high availability design to achieve the following goals:
# One or more servers will serve the client requests at the same time.
# Sessions are allocated among different servers.
# When one node crashes, the affected sessions will be moved to other active services.

Here's our design document, please review and comment:
https://docs.google.com/document/d/1bD3qYZpw14_NuCcSGUOfqQ0pqvSbCQsOLFuZp26Ohjc/edit?usp=sharing 




--
This message was sent by Atlassian Jira
(v8.3.4#803005)