You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/03/05 04:39:56 UTC
[spark] branch branch-2.4 updated: [MINOR][CORE] Expose the alias
-c flag of --conf for spark-submit
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 1c17ede [MINOR][CORE] Expose the alias -c flag of --conf for spark-submit
1c17ede is described below
commit 1c17ede75082fe56d3c5aedc14ac6246fdf3b333
Author: Kent Yao <ya...@hotmail.com>
AuthorDate: Wed Mar 4 20:37:51 2020 -0800
[MINOR][CORE] Expose the alias -c flag of --conf for spark-submit
### What changes were proposed in this pull request?
-c is short for --conf, it was introduced since v1.1.0 but hidden from users until now
### Why are the changes needed?
### Does this PR introduce any user-facing change?
no
expose hidden feature
### How was this patch tested?
Nah
Closes #27802 from yaooqinn/conf.
Authored-by: Kent Yao <ya...@hotmail.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
(cherry picked from commit 3edab6cc1d70c102093e973a2cf97208db19be8c)
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala | 2 +-
docs/configuration.md | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
index 974a0b7..3d489a3 100644
--- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
+++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala
@@ -541,7 +541,7 @@ private[deploy] class SparkSubmitArguments(args: Seq[String], env: Map[String, S
| directory of each executor. File paths of these files
| in executors can be accessed via SparkFiles.get(fileName).
|
- | --conf PROP=VALUE Arbitrary Spark configuration property.
+ | --conf, -c PROP=VALUE Arbitrary Spark configuration property.
| --properties-file FILE Path to a file from which to load extra properties. If not
| specified, this will look for conf/spark-defaults.conf.
|
diff --git a/docs/configuration.md b/docs/configuration.md
index 1582082..6bb1bda 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -80,7 +80,7 @@ Then, you can supply configuration values at runtime:
The Spark shell and [`spark-submit`](submitting-applications.html)
tool support two ways to load configurations dynamically. The first is command line options,
-such as `--master`, as shown above. `spark-submit` can accept any Spark property using the `--conf`
+such as `--master`, as shown above. `spark-submit` can accept any Spark property using the `--conf/-c`
flag, but uses special flags for properties that play a part in launching the Spark application.
Running `./bin/spark-submit --help` will show the entire list of these options.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org