You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/02/11 17:56:10 UTC
[spark] branch branch-3.0 updated: [SPARK-29462][SQL][DOCS] Add
some more context and details in
'spark.sql.defaultUrlStreamHandlerFactory.enabled' documentation
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new a539696 [SPARK-29462][SQL][DOCS] Add some more context and details in 'spark.sql.defaultUrlStreamHandlerFactory.enabled' documentation
a539696 is described below
commit a53969617e8770683e675ae6d39e8f8bfd787073
Author: HyukjinKwon <gu...@apache.org>
AuthorDate: Tue Feb 11 09:55:02 2020 -0800
[SPARK-29462][SQL][DOCS] Add some more context and details in 'spark.sql.defaultUrlStreamHandlerFactory.enabled' documentation
### What changes were proposed in this pull request?
This PR adds some more information and context to `spark.sql.defaultUrlStreamHandlerFactory.enabled`.
### Why are the changes needed?
It is a bit difficult to understand the documentation of `spark.sql.defaultUrlStreamHandlerFactory.enabled`.
### Does this PR introduce any user-facing change?
Nope, internal doc only fix.
### How was this patch tested?
Nope. I only tested linter.
Closes #27541 from HyukjinKwon/SPARK-29462-followup.
Authored-by: HyukjinKwon <gu...@apache.org>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
(cherry picked from commit 99bd59fe29a87bb70485db536b0ae676e7a9d42e)
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.../main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
index 6bc7522..563e51e 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
@@ -172,7 +172,13 @@ object StaticSQLConf {
val DEFAULT_URL_STREAM_HANDLER_FACTORY_ENABLED =
buildStaticConf("spark.sql.defaultUrlStreamHandlerFactory.enabled")
- .doc("When true, set FsUrlStreamHandlerFactory to support ADD JAR against HDFS locations")
+ .doc(
+ "When true, register Hadoop's FsUrlStreamHandlerFactory to support " +
+ "ADD JAR against HDFS locations. " +
+ "It should be disabled when a different stream protocol handler should be registered " +
+ "to support a particular protocol type, or if Hadoop's FsUrlStreamHandlerFactory " +
+ "conflicts with other protocol types such as `http` or `https`. See also SPARK-25694 " +
+ "and HADOOP-14598.")
.internal()
.booleanConf
.createWithDefault(true)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org