You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Anirudh Ramanathan (JIRA)" <ji...@apache.org> on 2017/08/02 19:12:02 UTC

[jira] [Comment Edited] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

    [ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111546#comment-16111546 ] 

Anirudh Ramanathan edited comment on SPARK-18278 at 8/2/17 7:11 PM:
--------------------------------------------------------------------

FYI: sandflee's question was addressed in https://github.com/apache-spark-on-k8s/spark/issues/270

Our last published update is here: http://apache-spark-developers-list.1001551.n3.nabble.com/An-Update-on-Spark-on-Kubernetes-Jun-23-td21843.html
In the next couple of weeks, we plan on submitting an official [SPIP|https://spark.apache.org/improvement-proposals.html] detailing our management of the fork, demonstrating uptake, and sustained maintainership. Our goal is to graduate beyond [experimental support|http://spark.apache.org/docs/latest/cluster-overview.html#cluster-manager-types] into an upstream contribution for Spark 2.3.

[~rxin] [~srowen] [~viirya]



was (Author: foxish):
FYI: sandflee's question was addressed in https://github.com/apache-spark-on-k8s/spark/issues/270

Our last published update is here: http://apache-spark-developers-list.1001551.n3.nabble.com/An-Update-on-Spark-on-Kubernetes-Jun-23-td21843.html
In the next couple of weeks, we plan on submitting an official [SPIP|https://spark.apache.org/improvement-proposals.html] detailing our management of the fork, demonstrating uptake, sustained maintainership and also adoption inn our fork. Our goal is to graduate beyond [experimental support|http://spark.apache.org/docs/latest/cluster-overview.html#cluster-manager-types] into an upstream contribution for Spark 2.3.

[~rxin] [~srowen] [~viirya]


> Support native submission of spark jobs to a kubernetes cluster
> ---------------------------------------------------------------
>
>                 Key: SPARK-18278
>                 URL: https://issues.apache.org/jira/browse/SPARK-18278
>             Project: Spark
>          Issue Type: Umbrella
>          Components: Build, Deploy, Documentation, Scheduler, Spark Core
>            Reporter: Erik Erlandson
>         Attachments: SPARK-18278 - Spark on Kubernetes Design Proposal.pdf
>
>
> A new Apache Spark sub-project that enables native support for submitting Spark applications to a kubernetes cluster.   The submitted application runs in a driver executing on a kubernetes pod, and executors lifecycles are also managed as pods.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org