[jira] [Commented] (SPARK-11035) Launcher: allow apps to be launched in-process

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222996#comment-16222996 ] 

Apache Spark commented on SPARK-11035:
--------------------------------------

User 'vanzin' has created a pull request for this issue:
https://github.com/apache/spark/pull/19591

> Launcher: allow apps to be launched in-process
> ----------------------------------------------
>
>                 Key: SPARK-11035
>                 URL: https://issues.apache.org/jira/browse/SPARK-11035
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>    Affects Versions: 1.6.0
>            Reporter: Marcelo Vanzin
>
> The launcher library is currently restricted to launching apps as child processes. That is fine for a lot of cases, especially if the app is running in client mode.
> But in certain cases, especially launching in cluster mode, it's more efficient to avoid launching a new process, since that process won't be doing much.
> We should add support for launching apps in process, even if restricted to cluster mode at first. This will require some rework of the launch paths to avoid using system properties to propagate configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org