You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2014/11/20 08:00:50 UTC
[jira] [Updated] (SPARK-4506) Update documentation to clarify
whether standalone-cluster mode is now officially supported
[ https://issues.apache.org/jira/browse/SPARK-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Josh Rosen updated SPARK-4506:
------------------------------
Description:
The "Launching Compiled Spark Applications" section of the Spark Standalone docs claims that standalone mode only supports {{client}} deploy mode:
{quote}
The spark-submit script provides the most straightforward way to submit a compiled Spark application to the cluster. For standalone clusters, Spark currently only supports deploying the driver inside the client process that is submitting the application (client deploy mode).
{quote}
It looks like {{standalone-cluster}} mode actually works (I've used it and have heard from users that are successfully using it, too).
The current line was added in SPARK-2259 when {{standalone-cluster}} mode wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs in {{standalone-cluster}} mode, so we should update the documentation if we're now ready to officially support it.
was:
Thee "Launching Compiled Spark Applications" section of the Spark Standalone docs claims that standalone mode only supports {{client}} deploy mode:
{quote}
The spark-submit script provides the most straightforward way to submit a compiled Spark application to the cluster. For standalone clusters, Spark currently only supports deploying the driver inside the client process that is submitting the application (client deploy mode).
{quote}
It looks like {{standalone-cluster}} mode actually works (I've used it and have heard from users that are successfully using it, too).
The current line was added in SPARK-2259 when {{standalone-cluster}} mode wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs in {{standalone-cluster}} mode, so we should update the documentation if we're now ready to officially support it.
> Update documentation to clarify whether standalone-cluster mode is now officially supported
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-4506
> URL: https://issues.apache.org/jira/browse/SPARK-4506
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 1.1.0, 1.1.1, 1.2.0
> Reporter: Josh Rosen
> Assignee: Andrew Or
>
> The "Launching Compiled Spark Applications" section of the Spark Standalone docs claims that standalone mode only supports {{client}} deploy mode:
> {quote}
> The spark-submit script provides the most straightforward way to submit a compiled Spark application to the cluster. For standalone clusters, Spark currently only supports deploying the driver inside the client process that is submitting the application (client deploy mode).
> {quote}
> It looks like {{standalone-cluster}} mode actually works (I've used it and have heard from users that are successfully using it, too).
> The current line was added in SPARK-2259 when {{standalone-cluster}} mode wasn't officially supported. It looks like SPARK-2260 fixed a number of bugs in {{standalone-cluster}} mode, so we should update the documentation if we're now ready to officially support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org