You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Timothy Chen (JIRA)" <ji...@apache.org> on 2015/05/26 20:01:18 UTC

[jira] [Created] (SPARK-7877) Support non-persistent cluster mode

Timothy Chen created SPARK-7877:
-----------------------------------

             Summary: Support non-persistent cluster mode
                 Key: SPARK-7877
                 URL: https://issues.apache.org/jira/browse/SPARK-7877
             Project: Spark
          Issue Type: Improvement
          Components: Mesos
            Reporter: Timothy Chen


Currently mesos cluster mode framework by default won't be removed even when it's shutdown since it's assumed to be a long running framework can register and reattach to all the running tasks.
However, there might be cases users want to make the framework more empheral, which when the framework dies all the tasks stops and mesos doesn't keep the framework state at all.
Besides making the state be in memory, we also need to make the framework failover timeout to be a small amount, which should be configurable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org