You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/03/27 05:41:48 UTC
[GitHub] [spark] beliefer opened a new pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
beliefer opened a new pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042
### What changes were proposed in this pull request?
Add version information to the configuration of `Hive`.
I sorted out some information show below.
Item name | Since version | JIRA ID | Commit ID | Note
-- | -- | -- | -- | --
spark.sql.hive.metastore.version | 1.4.0 | SPARK-6908 | 05454fd8aef75b129cbbd0288f5089c5259f4a15#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.version | 1.1.1 | SPARK-3971 | 64945f868443fbc59cb34b34c16d782dda0fb63d#diff-12fa2178364a810b3262b30d8d48aa2d |
spark.sql.hive.metastore.jars | 1.4.0 | SPARK-6908 | 05454fd8aef75b129cbbd0288f5089c5259f4a15#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.convertMetastoreParquet | 1.1.1 | SPARK-2406 | cc4015d2fa3785b92e6ab079b3abcf17627f7c56#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.convertMetastoreParquet.mergeSchema | 1.3.1 | SPARK-6575 | 778c87686af0c04df9dfe144b8f744f271a988ad#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.convertMetastoreOrc | 2.0.0 | SPARK-14070 | 1e886159849e3918445d3fdc3c4cef86c6c1a236#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.convertInsertingPartitionedTable | 3.0.0 | SPARK-28573 | d5688dc732890923c326f272b0c18c329a69459a#diff-842e3447fc453de26c706db1cac8f2c4 |
spark.sql.hive.convertMetastoreCtas | 3.0.0 | SPARK-25271 | 5ad03607d1487e7ab3e3b6d00eef9c4028ed4975#diff-842e3447fc453de26c706db1cac8f2c4 |
spark.sql.hive.metastore.sharedPrefixes | 1.4.0 | SPARK-7491 | a8556086d33cb993fab0ae2751e31455e6c664ab#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.metastore.barrierPrefixes | 1.4.0 | SPARK-7491 | a8556086d33cb993fab0ae2751e31455e6c664ab#diff-ff50aea397a607b79df9bec6f2a841db |
spark.sql.hive.thriftServer.async | 1.5.0 | SPARK-6964 | eb19d3f75cbd002f7e72ce02017a8de67f562792#diff-ff50aea397a607b79df9bec6f2a841db |
### Why are the changes needed?
Supplemental configuration version information.
### Does this PR introduce any user-facing change?
'No'.
### How was this patch tested?
Exists UT
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604826664
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25157/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-605080912
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399047030
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -135,6 +143,7 @@ private[spark] object HiveUtils extends Logging {
"that should be shared is JDBC drivers that are needed to talk to the metastore. Other " +
"classes that need to be shared are those that interact with classes that are already " +
"shared. For example, custom appenders that are used by log4j.")
+ .version("1.4.0")
Review comment:
SPARK-7491, commit ID: a8556086d33cb993fab0ae2751e31455e6c664ab#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC]
Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604826376
**[Test build #120449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120449/testReport)** for PR 28042 at commit [`3b3cb8c`](https://github.com/apache/spark/commit/3b3cb8c1cae88575c7c0bcf98a20d5d06f479267).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604987356
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25196/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC]
Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-605079424
**[Test build #120491 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120491/testReport)** for PR 28042 at commit [`3b3cb8c`](https://github.com/apache/spark/commit/3b3cb8c1cae88575c7c0bcf98a20d5d06f479267).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-605080930
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120491/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-610369861
Merged to branch-3.0 too.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-605080930
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120491/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604826376
**[Test build #120449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120449/testReport)** for PR 28042 at commit [`3b3cb8c`](https://github.com/apache/spark/commit/3b3cb8c1cae88575c7c0bcf98a20d5d06f479267).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604847925
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604987351
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604847935
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120449/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on issue #28042: [SPARK-31279][SQL][DOC]
Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604985213
retest this please
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-606378079
Merged to master.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604987351
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
HyukjinKwon closed pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046266
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -65,6 +65,7 @@ private[spark] object HiveUtils extends Logging {
.doc("Version of the Hive metastore. Available options are " +
"<code>0.12.0</code> through <code>2.3.6</code> and " +
"<code>3.0.0</code> through <code>3.1.2</code>.")
+ .version("1.4.0")
Review comment:
SPARK-6908, commit ID: 05454fd8aef75b129cbbd0288f5089c5259f4a15#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-605080912
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046720
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -103,12 +107,14 @@ private[spark] object HiveUtils extends Logging {
.doc("When true, also tries to merge possibly different but compatible Parquet schemas in " +
"different Parquet data files. This configuration is only effective " +
"when \"spark.sql.hive.convertMetastoreParquet\" is true.")
+ .version("1.3.1")
.booleanConf
.createWithDefault(false)
val CONVERT_METASTORE_ORC = buildConf("spark.sql.hive.convertMetastoreOrc")
.doc("When set to true, the built-in ORC reader and writer are used to process " +
"ORC tables created by using the HiveQL syntax, instead of Hive serde.")
+ .version("2.0.0")
Review comment:
SPARK-14070, commit ID: 1e886159849e3918445d3fdc3c4cef86c6c1a236#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046361
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -73,6 +74,7 @@ private[spark] object HiveUtils extends Logging {
// already rely on this config.
val FAKE_HIVE_VERSION = buildConf("spark.sql.hive.version")
.doc(s"deprecated, please use ${HIVE_METASTORE_VERSION.key} to get the Hive version in Spark.")
+ .version("1.1.1")
Review comment:
SPARK-3971, commit ID: 64945f868443fbc59cb34b34c16d782dda0fb63d#diff-12fa2178364a810b3262b30d8d48aa2d
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604847925
Merged build finished. Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399047055
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -146,12 +155,14 @@ private[spark] object HiveUtils extends Logging {
.doc("A comma separated list of class prefixes that should explicitly be reloaded for each " +
"version of Hive that Spark SQL is communicating with. For example, Hive UDFs that are " +
"declared in a prefix that typically would be shared (i.e. <code>org.apache.spark.*</code>).")
+ .version("1.4.0")
Review comment:
SPARK-7491, commit ID: a8556086d33cb993fab0ae2751e31455e6c664ab#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604826658
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604987356
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25196/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC]
Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604847754
**[Test build #120449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120449/testReport)** for PR 28042 at commit [`3b3cb8c`](https://github.com/apache/spark/commit/3b3cb8c1cae88575c7c0bcf98a20d5d06f479267).
* This patch **fails due to an unknown error code, -9**.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046516
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -89,12 +91,14 @@ private[spark] object HiveUtils extends Logging {
| Use Hive jars of specified version downloaded from Maven repositories.
| 3. A classpath in the standard format for both Hive and Hadoop.
""".stripMargin)
+ .version("1.4.0")
.stringConf
.createWithDefault("builtin")
val CONVERT_METASTORE_PARQUET = buildConf("spark.sql.hive.convertMetastoreParquet")
.doc("When set to true, the built-in Parquet reader and writer are used to process " +
"parquet tables created by using the HiveQL syntax, instead of Hive serde.")
+ .version("1.1.1")
Review comment:
SPARK-2406, commit ID: cc4015d2fa3785b92e6ab079b3abcf17627f7c56#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604826658
Merged build finished. Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604986708
**[Test build #120491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120491/testReport)** for PR 28042 at commit [`3b3cb8c`](https://github.com/apache/spark/commit/3b3cb8c1cae88575c7c0bcf98a20d5d06f479267).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604847935
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120449/
Test FAILed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046631
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -103,12 +107,14 @@ private[spark] object HiveUtils extends Logging {
.doc("When true, also tries to merge possibly different but compatible Parquet schemas in " +
"different Parquet data files. This configuration is only effective " +
"when \"spark.sql.hive.convertMetastoreParquet\" is true.")
+ .version("1.3.1")
Review comment:
SPARK-6575, commit ID: 778c87686af0c04df9dfe144b8f744f271a988ad#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399047144
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -146,12 +155,14 @@ private[spark] object HiveUtils extends Logging {
.doc("A comma separated list of class prefixes that should explicitly be reloaded for each " +
"version of Hive that Spark SQL is communicating with. For example, Hive UDFs that are " +
"declared in a prefix that typically would be shared (i.e. <code>org.apache.spark.*</code>).")
+ .version("1.4.0")
.stringConf
.toSequence
.createWithDefault(Nil)
val HIVE_THRIFT_SERVER_ASYNC = buildConf("spark.sql.hive.thriftServer.async")
.doc("When set to true, Hive Thrift server executes SQL queries in an asynchronous way.")
+ .version("1.5.0")
Review comment:
SPARK-6964, commit ID: eb19d3f75cbd002f7e72ce02017a8de67f562792#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC]
Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
SparkQA commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604986708
**[Test build #120491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120491/testReport)** for PR 28042 at commit [`3b3cb8c`](https://github.com/apache/spark/commit/3b3cb8c1cae88575c7c0bcf98a20d5d06f479267).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046813
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -118,6 +124,7 @@ private[spark] object HiveUtils extends Logging {
"`spark.sql.hive.convertMetastoreOrc` is true, the built-in ORC/Parquet writer is used" +
"to process inserting into partitioned ORC/Parquet tables created by using the HiveSQL " +
"syntax.")
+ .version("3.0.0")
Review comment:
SPARK-28573, commit ID: d5688dc732890923c326f272b0c18c329a69459a#diff-842e3447fc453de26c706db1cac8f2c4
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on issue #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#issuecomment-604826664
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25157/
Test PASSed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046930
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -126,6 +133,7 @@ private[spark] object HiveUtils extends Logging {
"instead of Hive serde in CTAS. This flag is effective only if " +
"`spark.sql.hive.convertMetastoreParquet` or `spark.sql.hive.convertMetastoreOrc` is " +
"enabled respectively for Parquet and ORC formats")
+ .version("3.0.0")
Review comment:
SPARK-25271, commit ID: 5ad03607d1487e7ab3e3b6d00eef9c4028ed4975#diff-842e3447fc453de26c706db1cac8f2c4
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] beliefer commented on a change in pull request #28042:
[SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
Posted by GitBox <gi...@apache.org>.
beliefer commented on a change in pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive
URL: https://github.com/apache/spark/pull/28042#discussion_r399046428
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -89,12 +91,14 @@ private[spark] object HiveUtils extends Logging {
| Use Hive jars of specified version downloaded from Maven repositories.
| 3. A classpath in the standard format for both Hive and Hadoop.
""".stripMargin)
+ .version("1.4.0")
Review comment:
SPARK-6908, commit ID: 05454fd8aef75b129cbbd0288f5089c5259f4a15#diff-ff50aea397a607b79df9bec6f2a841db
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org