You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2018/02/08 04:21:24 UTC
spark git commit: Revert [SPARK-22279][SQL] Turn on
spark.sql.hive.convertMetastoreOrc by default
Repository: spark
Updated Branches:
refs/heads/master a62f30d3f -> 3473fda6d
Revert [SPARK-22279][SQL] Turn on spark.sql.hive.convertMetastoreOrc by default
## What changes were proposed in this pull request?
This is to revert the changes made in https://github.com/apache/spark/pull/19499 , because this causes a regression. We should not ignore the table-specific compression conf when the Hive serde tables are converted to the data source tables.
## How was this patch tested?
The existing tests.
Author: gatorsmile <ga...@gmail.com>
Closes #20536 from gatorsmile/revert22279.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3473fda6
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3473fda6
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3473fda6
Branch: refs/heads/master
Commit: 3473fda6dc77bdfd84b3de95d2082856ad4f8626
Parents: a62f30d
Author: gatorsmile <ga...@gmail.com>
Authored: Thu Feb 8 12:21:18 2018 +0800
Committer: Wenchen Fan <we...@databricks.com>
Committed: Thu Feb 8 12:21:18 2018 +0800
----------------------------------------------------------------------
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/3473fda6/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
----------------------------------------------------------------------
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
index d9627eb..93f3f38 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
@@ -109,7 +109,7 @@ private[spark] object HiveUtils extends Logging {
.doc("When set to true, the built-in ORC reader and writer are used to process " +
"ORC tables created by using the HiveQL syntax, instead of Hive serde.")
.booleanConf
- .createWithDefault(true)
+ .createWithDefault(false)
val HIVE_METASTORE_SHARED_PREFIXES = buildConf("spark.sql.hive.metastore.sharedPrefixes")
.doc("A comma separated list of class prefixes that should be loaded using the classloader " +
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org