You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@livy.apache.org by Juanjo Vázquez <jv...@apache.org> on 2018/08/09 09:52:21 UTC
Kubernetes
Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a
Spark with Kubernetes as cluster manager. Obvious question, is k8s
currently supported both on client and cluster modes?. Anyone running this
architecture?.
Thanks!.
Re: Kubernetes
Posted by Juan-Jose Vazquez <jv...@apache.org>.
Sorry, not yet. Still building the infrastructure. Stay tuned!
El mar., 4 sept. 2018 a las 9:40, Pusarla, Srikanth (Nokia - IN/Bangalore)
(<sr...@nokia.com>) escribió:
> Hi,
>
>
>
> Could you try livy on spark2.3.1, did you find any issues, please share
> the status.
>
>
>
> Thanks,
>
> Srikanth
>
>
>
> *From:* juanjo.vazquez@gmail.com <ju...@gmail.com> *On Behalf Of
> *Juanjo Vázquez
> *Sent:* Thursday, August 09, 2018 3:47 PM
>
>
> *To:* user@livy.incubator.apache.org
> *Subject:* Re: Kubernetes
>
>
>
> Excellent!. I'll give it a try then and report any issues I could find on
> 2.3.1. Thanks.
>
>
>
> On Thu, Aug 9, 2018 at 12:12 PM, Pusarla, Srikanth (Nokia - IN/Bangalore) <
> srikanth.pusarla@nokia.com> wrote:
>
> We didn’t do any hack and we didn’t try on Spark 2.3.1, Thanks.
>
>
>
> *From:* Juan José Vázquez Delgado <ju...@gmail.com>
> *Sent:* Thursday, August 09, 2018 3:39 PM
> *To:* user@livy.incubator.apache.org
> *Subject:* Re: Kubernetes
>
>
>
> Great news!. Did you have to hack anything in order to get it work or
> vanilla Livy just worked?. We're currently running the last Spark version
> 2.3.1. Thanks!.
>
>
>
> El jue., 9 ago. 2018 a las 12:02, Pusarla, Srikanth (Nokia - IN/Bangalore)
> (<sr...@nokia.com>) escribió:
>
> Hi,
>
>
>
> Yes, We brought up livy 0.5.0 using spark 2.2 on K8S in cluster mode,
> client mode is not supported with spark2.2 on K8S.
>
>
>
> Thanks & Regards,
>
> Srikanth
>
>
>
> *From:* Juanjo Vázquez <jv...@apache.org>
> *Sent:* Thursday, August 09, 2018 3:22 PM
> *To:* user@livy.apache.org
> *Subject:* Kubernetes
>
>
>
> Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a
> Spark with Kubernetes as cluster manager. Obvious question, is k8s
> currently supported both on client and cluster modes?. Anyone running this
> architecture?.
>
>
>
> Thanks!.
>
>
>
--
Juan José Vázquez Delgado
CTO
Tecsisa
C/Quintanavides, 19
Parque Vía Norte
Edificio 4, Planta 3, Oficina H
28050 Madrid
T: +34 91 182 04 70
F: +34 91 447 05 11
E: juanjo.vazquez.delgado@tecsisa.com
W: www.tecsisa.com
RE: Kubernetes
Posted by "Pusarla, Srikanth (Nokia - IN/Bangalore)" <sr...@nokia.com>.
Hi,
Could you try livy on spark2.3.1, did you find any issues, please share the status.
Thanks,
Srikanth
From: juanjo.vazquez@gmail.com <ju...@gmail.com> On Behalf Of Juanjo Vázquez
Sent: Thursday, August 09, 2018 3:47 PM
To: user@livy.incubator.apache.org
Subject: Re: Kubernetes
Excellent!. I'll give it a try then and report any issues I could find on 2.3.1. Thanks.
On Thu, Aug 9, 2018 at 12:12 PM, Pusarla, Srikanth (Nokia - IN/Bangalore) <sr...@nokia.com>> wrote:
We didn’t do any hack and we didn’t try on Spark 2.3.1, Thanks.
From: Juan José Vázquez Delgado <ju...@gmail.com>>
Sent: Thursday, August 09, 2018 3:39 PM
To: user@livy.incubator.apache.org<ma...@livy.incubator.apache.org>
Subject: Re: Kubernetes
Great news!. Did you have to hack anything in order to get it work or vanilla Livy just worked?. We're currently running the last Spark version 2.3.1. Thanks!.
El jue., 9 ago. 2018 a las 12:02, Pusarla, Srikanth (Nokia - IN/Bangalore) (<sr...@nokia.com>>) escribió:
Hi,
Yes, We brought up livy 0.5.0 using spark 2.2 on K8S in cluster mode, client mode is not supported with spark2.2 on K8S.
Thanks & Regards,
Srikanth
From: Juanjo Vázquez <jv...@apache.org>>
Sent: Thursday, August 09, 2018 3:22 PM
To: user@livy.apache.org<ma...@livy.apache.org>
Subject: Kubernetes
Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a Spark with Kubernetes as cluster manager. Obvious question, is k8s currently supported both on client and cluster modes?. Anyone running this architecture?.
Thanks!.
Re: Kubernetes
Posted by Juanjo Vázquez <jv...@apache.org>.
Excellent!. I'll give it a try then and report any issues I could find on
2.3.1. Thanks.
On Thu, Aug 9, 2018 at 12:12 PM, Pusarla, Srikanth (Nokia - IN/Bangalore) <
srikanth.pusarla@nokia.com> wrote:
> We didn’t do any hack and we didn’t try on Spark 2.3.1, Thanks.
>
>
>
> *From:* Juan José Vázquez Delgado <ju...@gmail.com>
> *Sent:* Thursday, August 09, 2018 3:39 PM
> *To:* user@livy.incubator.apache.org
> *Subject:* Re: Kubernetes
>
>
>
> Great news!. Did you have to hack anything in order to get it work or
> vanilla Livy just worked?. We're currently running the last Spark version
> 2.3.1. Thanks!.
>
>
>
> El jue., 9 ago. 2018 a las 12:02, Pusarla, Srikanth (Nokia - IN/Bangalore)
> (<sr...@nokia.com>) escribió:
>
> Hi,
>
>
>
> Yes, We brought up livy 0.5.0 using spark 2.2 on K8S in cluster mode,
> client mode is not supported with spark2.2 on K8S.
>
>
>
> Thanks & Regards,
>
> Srikanth
>
>
>
> *From:* Juanjo Vázquez <jv...@apache.org>
> *Sent:* Thursday, August 09, 2018 3:22 PM
> *To:* user@livy.apache.org
> *Subject:* Kubernetes
>
>
>
> Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a
> Spark with Kubernetes as cluster manager. Obvious question, is k8s
> currently supported both on client and cluster modes?. Anyone running this
> architecture?.
>
>
>
> Thanks!.
>
>
RE: Kubernetes
Posted by "Pusarla, Srikanth (Nokia - IN/Bangalore)" <sr...@nokia.com>.
We didn’t do any hack and we didn’t try on Spark 2.3.1, Thanks.
From: Juan José Vázquez Delgado <ju...@gmail.com>
Sent: Thursday, August 09, 2018 3:39 PM
To: user@livy.incubator.apache.org
Subject: Re: Kubernetes
Great news!. Did you have to hack anything in order to get it work or vanilla Livy just worked?. We're currently running the last Spark version 2.3.1. Thanks!.
El jue., 9 ago. 2018 a las 12:02, Pusarla, Srikanth (Nokia - IN/Bangalore) (<sr...@nokia.com>>) escribió:
Hi,
Yes, We brought up livy 0.5.0 using spark 2.2 on K8S in cluster mode, client mode is not supported with spark2.2 on K8S.
Thanks & Regards,
Srikanth
From: Juanjo Vázquez <jv...@apache.org>>
Sent: Thursday, August 09, 2018 3:22 PM
To: user@livy.apache.org<ma...@livy.apache.org>
Subject: Kubernetes
Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a Spark with Kubernetes as cluster manager. Obvious question, is k8s currently supported both on client and cluster modes?. Anyone running this architecture?.
Thanks!.
Re: Kubernetes
Posted by Juan José Vázquez Delgado <ju...@gmail.com>.
Great news!. Did you have to hack anything in order to get it work or
vanilla Livy just worked?. We're currently running the last Spark version
2.3.1. Thanks!.
El jue., 9 ago. 2018 a las 12:02, Pusarla, Srikanth (Nokia - IN/Bangalore)
(<sr...@nokia.com>) escribió:
> Hi,
>
>
>
> Yes, We brought up livy 0.5.0 using spark 2.2 on K8S in cluster mode,
> client mode is not supported with spark2.2 on K8S.
>
>
>
> Thanks & Regards,
>
> Srikanth
>
>
>
> *From:* Juanjo Vázquez <jv...@apache.org>
> *Sent:* Thursday, August 09, 2018 3:22 PM
> *To:* user@livy.apache.org
> *Subject:* Kubernetes
>
>
>
> Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a
> Spark with Kubernetes as cluster manager. Obvious question, is k8s
> currently supported both on client and cluster modes?. Anyone running this
> architecture?.
>
>
>
> Thanks!.
>
RE: Kubernetes
Posted by "Pusarla, Srikanth (Nokia - IN/Bangalore)" <sr...@nokia.com>.
Hi,
Yes, We brought up livy 0.5.0 using spark 2.2 on K8S in cluster mode, client mode is not supported with spark2.2 on K8S.
Thanks & Regards,
Srikanth
From: Juanjo Vázquez <jv...@apache.org>
Sent: Thursday, August 09, 2018 3:22 PM
To: user@livy.apache.org
Subject: Kubernetes
Hi guys, Livy newby here. I'm planning to deploy a Livy server on top of a Spark with Kubernetes as cluster manager. Obvious question, is k8s currently supported both on client and cluster modes?. Anyone running this architecture?.
Thanks!.