You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/07/20 14:19:25 UTC
[spark] branch master updated (c2afe1c -> d0c83f3)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from c2afe1c [SPARK-32366][DOC] Fix doc link of datetime pattern in 3.0 migration guide
add d0c83f3 [SPARK-32302][SQL] Partially push down disjunctive predicates through Join/Partitions
No new revisions were added by this update.
Summary of changes:
.../sql/catalyst/expressions/predicates.scala | 153 ++++++---------------
.../spark/sql/catalyst/optimizer/Optimizer.scala | 8 +-
...n.scala => PushExtraPredicateThroughJoin.scala} | 42 +++---
.../org/apache/spark/sql/internal/SQLConf.scala | 15 --
.../ConjunctiveNormalFormPredicateSuite.scala | 128 -----------------
.../ExtractPredicatesWithinOutputSetSuite.scala | 82 +++++++++++
.../catalyst/optimizer/FilterPushdownSuite.scala | 62 ++++-----
.../datasources/PruneFileSourcePartitions.scala | 8 +-
.../hive/execution/PruneHiveTablePartitions.scala | 9 +-
.../execution/PruneHiveTablePartitionsSuite.scala | 25 ++++
10 files changed, 208 insertions(+), 324 deletions(-)
rename sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/{PushCNFPredicateThroughJoin.scala => PushExtraPredicateThroughJoin.scala} (59%)
delete mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConjunctiveNormalFormPredicateSuite.scala
create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExtractPredicatesWithinOutputSetSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org