You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Timothy Chen (JIRA)" <ji...@apache.org> on 2015/08/27 10:35:45 UTC
[jira] [Created] (SPARK-10313) Support HA stateful driver on Mesos
cluster mode
Timothy Chen created SPARK-10313:
------------------------------------
Summary: Support HA stateful driver on Mesos cluster mode
Key: SPARK-10313
URL: https://issues.apache.org/jira/browse/SPARK-10313
Project: Spark
Issue Type: Improvement
Components: Mesos
Reporter: Timothy Chen
Spark driver state becomes important to recover after failure especially in Spark streaming context.
We can allow Spark cluster mode framework to support a stateful supervised driver mode, that launches Spark drivers in persistent volumes with Mesos, and on relaunch tries to relaunch the driver with the same volume mounted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org