You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2016/04/22 12:03:12 UTC
[jira] [Commented] (SPARK-14845) spark.files in properties file is
not distributed to driver in yarn-cluster mode
[ https://issues.apache.org/jira/browse/SPARK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253673#comment-15253673 ]
Jeff Zhang commented on SPARK-14845:
------------------------------------
working on it.
> spark.files in properties file is not distributed to driver in yarn-cluster mode
> --------------------------------------------------------------------------------
>
> Key: SPARK-14845
> URL: https://issues.apache.org/jira/browse/SPARK-14845
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Reporter: Jeff Zhang
> Priority: Minor
>
> I use the following command to run SparkPi example. And in this property file, define spark.files. It turns out that in yarn-cluster mode this README.md is only distirbuted to executor but not in driver.
> content of properties file
> {noformat}
> spark.files=/Users/jzhang/github/spark/README.md
> {noformat}
> launch command
> {noformat}
> bin/spark-submit --master yarn-cluster --properties-file a.properties --class org.apache.spark.examples.SparkPi examples/target/original-spark-examples_2.11-2.0.0-SNAPSHOT.jar
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org