You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/04/25 04:53:12 UTC
[jira] [Assigned] (SPARK-14845) spark.files in properties file is
not distributed to driver in yarn-cluster mode
[ https://issues.apache.org/jira/browse/SPARK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-14845:
------------------------------------
Assignee: (was: Apache Spark)
> spark.files in properties file is not distributed to driver in yarn-cluster mode
> --------------------------------------------------------------------------------
>
> Key: SPARK-14845
> URL: https://issues.apache.org/jira/browse/SPARK-14845
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit, YARN
> Reporter: Jeff Zhang
> Priority: Minor
>
> I use the following command to run SparkPi example. And in this property file, define spark.files. It turns out that in yarn-cluster mode this README.md is only distirbuted to executor but not in driver.
> content of properties file
> {noformat}
> spark.files=/Users/jzhang/github/spark/README.md
> {noformat}
> launch command
> {noformat}
> bin/spark-submit --master yarn-cluster --properties-file a.properties --class org.apache.spark.examples.SparkPi examples/target/original-spark-examples_2.11-2.0.0-SNAPSHOT.jar
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org