You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2015/09/02 08:22:45 UTC

[jira] [Updated] (SPARK-10288) Add a rest client for Spark on Yarn

     [ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Saisai Shao updated SPARK-10288:
--------------------------------
    Description: 
This is a proposal to add rest client for Spark on Yarn. Rest API offers a convenient addition to let user to submit application through rest client, people will easily achieve long haul submission, build their own submission gateway through rest client.

Here is the design doc (https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).

Currently I'm working on it, working branch is (https://github.com/jerryshao/apache-spark/tree/yarn-rest-support), the major part is already finished.

Any comment is greatly appreciated, thanks a lot.

  was:
This is a proposal to add rest client for Spark on Yarn. Currently Spark standalone and Mesos mode can support rest way of submitting applications, for Spark on Yarn, it still uses program way to do it. Since RM now (from 2.6) supports rest way of submitting application, so it would be better Spark on Yarn also support this way.

Here is the design doc (https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).

Currently I'm working on it, working branch is (https://github.com/jerryshao/apache-spark/tree/yarn-rest-support), the major part is already finished.

Any comment is greatly appreciated, thanks a lot.


> Add a rest client for Spark on Yarn
> -----------------------------------
>
>                 Key: SPARK-10288
>                 URL: https://issues.apache.org/jira/browse/SPARK-10288
>             Project: Spark
>          Issue Type: New Feature
>          Components: YARN
>            Reporter: Saisai Shao
>
> This is a proposal to add rest client for Spark on Yarn. Rest API offers a convenient addition to let user to submit application through rest client, people will easily achieve long haul submission, build their own submission gateway through rest client.
> Here is the design doc (https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).
> Currently I'm working on it, working branch is (https://github.com/jerryshao/apache-spark/tree/yarn-rest-support), the major part is already finished.
> Any comment is greatly appreciated, thanks a lot.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org