You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2015/12/03 17:46:11 UTC

[jira] [Resolved] (SPARK-12129) spark.submit.deployMode not being picked up in SparkSubmitArguments

     [ https://issues.apache.org/jira/browse/SPARK-12129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin resolved SPARK-12129.
------------------------------------
    Resolution: Invalid

That's an internal property, it's not documented, and users are not supposed to set it.

I think what you're really looking for is SPARK-10123.

> spark.submit.deployMode not being picked up in SparkSubmitArguments
> -------------------------------------------------------------------
>
>                 Key: SPARK-12129
>                 URL: https://issues.apache.org/jira/browse/SPARK-12129
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Submit
>    Affects Versions: 1.3.1, 1.4.1, 1.5.2
>         Environment: YARN, MESOS
>            Reporter: Doug Balog
>            Priority: Trivial
>
> In sparkSubmitArguments.scala
> {code}
>  deployMode = Option(deployMode).orElse(env.get("DEPLOY_MODE")).orNull
> {code}
> This code should probably check to see if the env variable SPARK_SUBMIT is set and then look up `spark.submit.deployMode` in sparkProperties.
> To see this, run something like {code}spark-submit -v --conf spark.submit.deployMode=cluster --class org.apache.spark.examples.SparkPi $SPARK_HOME/lib/spark-examples-1.6.0-hadoop.2.6.0.jar{code}
> The last `spark.submit.deployMode` will be set to client.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org