You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@livy.apache.org by "Dexter Hu (Jira)" <ji...@apache.org> on 2022/05/04 21:53:00 UTC

[jira] [Updated] (LIVY-890) Support Livy session restore for k8s

     [ https://issues.apache.org/jira/browse/LIVY-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dexter Hu updated LIVY-890:
---------------------------
    Description: 
Currently, session restore is only supported for YARN, according to

[https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]

 

Since serverless Apache Spark running on EKS, GKS, OKE is getting more popular as a cost-effective alternative than YARN, it is needed to support session restore for k8s for both batch and interactive sessions.  

> Support Livy session restore for k8s
> ------------------------------------
>
>                 Key: LIVY-890
>                 URL: https://issues.apache.org/jira/browse/LIVY-890
>             Project: Livy
>          Issue Type: Improvement
>            Reporter: Dexter Hu
>            Priority: Major
>
> Currently, session restore is only supported for YARN, according to
> [https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/server/src/main/scala/org/apache/livy/server/LivyServer.scala#L419]
>  
> Since serverless Apache Spark running on EKS, GKS, OKE is getting more popular as a cost-effective alternative than YARN, it is needed to support session restore for k8s for both batch and interactive sessions.  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)