[jira] [Commented] (SPARK-7877) Support non-persistent cluster mode

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458324#comment-15458324 ] 

Apache Spark commented on SPARK-7877:
-------------------------------------

User 'philipphoffmann' has created a pull request for this issue:
https://github.com/apache/spark/pull/14936

> Support non-persistent cluster mode
> -----------------------------------
>
>                 Key: SPARK-7877
>                 URL: https://issues.apache.org/jira/browse/SPARK-7877
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>            Reporter: Timothy Chen
>
> Currently mesos cluster mode framework by default won't be removed even when it's shutdown since it's assumed to be a long running framework can register and reattach to all the running tasks.
> However, there might be cases users want to make the framework more empheral, which when the framework dies all the tasks stops and mesos doesn't keep the framework state at all.
> Besides making the state be in memory, we also need to make the framework failover timeout to be a small amount, which should be configurable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org