You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2017/01/26 10:16:01 UTC
spark git commit: [CORE][DOCS] Update a help message for --files in
spark-submit
Repository: spark
Updated Branches:
refs/heads/master d3dcb63b9 -> 7045b8b35
[CORE][DOCS] Update a help message for --files in spark-submit
## What changes were proposed in this pull request?
This pr is to update a help message for `--files` in spark-submit because it seems users get confused about how to get full paths of the files that one adds via the option.
Author: Takeshi YAMAMURO <li...@gmail.com>
Closes #16698 from maropu/SparkFilesDoc.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7045b8b3
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7045b8b3
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7045b8b3
Branch: refs/heads/master
Commit: 7045b8b3554459fe61c4b32868560e66444a2876
Parents: d3dcb63
Author: Takeshi YAMAMURO <li...@gmail.com>
Authored: Thu Jan 26 10:15:58 2017 +0000
Committer: Sean Owen <so...@cloudera.com>
Committed: Thu Jan 26 10:15:58 2017 +0000
----------------------------------------------------------------------
.../main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/7045b8b3/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
index b1d36e1..dee7734 100644
--- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
+++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
@@ -506,7 +506,8 @@ private[deploy] class SparkSubmitArguments(args: Seq[String], env: Map[String, S
| --py-files PY_FILES Comma-separated list of .zip, .egg, or .py files to place
| on the PYTHONPATH for Python apps.
| --files FILES Comma-separated list of files to be placed in the working
- | directory of each executor.
+ | directory of each executor. File paths of these files
+ | in executors can be accessed via SparkFiles.get(fileName).
|
| --conf PROP=VALUE Arbitrary Spark configuration property.
| --properties-file FILE Path to a file from which to load extra properties. If not
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org