You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2016/10/20 06:55:09 UTC
spark git commit: [SPARK-17991][SQL] Enable metastore partition
pruning by default.
Repository: spark
Updated Branches:
refs/heads/master 39755169f -> 4bd17c460
[SPARK-17991][SQL] Enable metastore partition pruning by default.
## What changes were proposed in this pull request?
This should apply to non-converted metastore relations. WIP to see if this causes any test failures.
## How was this patch tested?
Existing tests.
Author: Eric Liang <ek...@databricks.com>
Closes #15475 from ericl/try-enabling-pruning.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4bd17c46
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4bd17c46
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4bd17c46
Branch: refs/heads/master
Commit: 4bd17c4606764242bc29888b8eedc8e4b5a00f46
Parents: 3975516
Author: Eric Liang <ek...@databricks.com>
Authored: Wed Oct 19 23:55:05 2016 -0700
Committer: Reynold Xin <rx...@databricks.com>
Committed: Wed Oct 19 23:55:05 2016 -0700
----------------------------------------------------------------------
.../src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/4bd17c46/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
----------------------------------------------------------------------
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala b/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index 9061b1b..ebf4fad 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -267,7 +267,7 @@ object SQLConf {
.doc("When true, some predicates will be pushed down into the Hive metastore so that " +
"unmatching partitions can be eliminated earlier.")
.booleanConf
- .createWithDefault(false)
+ .createWithDefault(true)
val HIVE_FILESOURCE_PARTITION_PRUNING =
SQLConfigBuilder("spark.sql.hive.filesourcePartitionPruning")
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org