You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Matt Cheah <mc...@palantir.com> on 2019/05/17 19:22:04 UTC

[PSA] Sharing our Experiences With Kubernetes

Hi everyone,

 

I would like to share the experiences my organization has had with deploying Kubernetes and migrating our Spark applications to Kubernetes over from YARN. We are publishing a series of blog posts that describe what we have learned and what we have built.

 

Our introduction post is here: https://medium.com/palantir/introducing-rubix-kubernetes-at-palantir-ab0ce16ea42e

 

We then discuss our custom scheduling work here: https://medium.com/palantir/spark-scheduling-in-kubernetes-4976333235f3

 

Stay tuned for more posts in this space! I hope that this is helpful for you.

 

-Matt Cheah

Re: [PSA] Sharing our Experiences With Kubernetes

Posted by Ramandeep Singh <rs...@nyu.edu>.

Thanks for sharing.

On Sat, May 18, 2019, 00:52 Matt Cheah <mc...@palantir.com> wrote:

> Hi everyone,
>
>
>
> I would like to share the experiences my organization has had with
> deploying Kubernetes and migrating our Spark applications to Kubernetes
> over from YARN. We are publishing a series of blog posts that describe what
> we have learned and what we have built.
>
>
>
> Our introduction post is here:
> https://medium.com/palantir/introducing-rubix-kubernetes-at-palantir-ab0ce16ea42e
>
>
>
> We then discuss our custom scheduling work here:
> https://medium.com/palantir/spark-scheduling-in-kubernetes-4976333235f3
>
>
>
> Stay tuned for more posts in this space! I hope that this is helpful for
> you.
>
>
>
> -Matt Cheah
>