You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2022/07/28 13:21:11 UTC
[spark] branch master updated (0f9c1a2e848 -> f49411e3cf5)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 0f9c1a2e848 [SPARK-39844][SQL] Update SQLConf for DEFAULT column providers to allow/deny "ALTER TABLE ... ADD COLUMN" commands separately
add f49411e3cf5 [SPARK-39528][SQL] Use V2 Filter in SupportsRuntimeFiltering
No new revisions were added by this update.
Summary of changes:
.../connector/read/SupportsRuntimeFiltering.java | 23 ++++++-
...tering.java => SupportsRuntimeV2Filtering.java} | 33 ++++++----
.../spark/sql/catalyst/expressions/literals.scala | 1 +
.../sql/internal/connector/PredicateUtils.scala | 49 ++++++++++++++
.../sql/connector/catalog/InMemoryTable.scala | 12 +++-
.../catalog/InMemoryTableWithV2Filter.scala | 77 ++++++++++++++++++++++
...cala => InMemoryTableWithV2FilterCatalog.scala} | 4 +-
.../execution/datasources/DataSourceStrategy.scala | 21 +-----
.../execution/datasources/v2/BatchScanExec.scala | 7 +-
.../datasources/v2/DataSourceV2Strategy.scala | 28 ++++++--
.../dynamicpruning/PartitionPruning.scala | 4 +-
.../spark/sql/DynamicPartitionPruningSuite.scala | 20 +++++-
12 files changed, 229 insertions(+), 50 deletions(-)
copy sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/{SupportsRuntimeFiltering.java => SupportsRuntimeV2Filtering.java} (57%)
create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/internal/connector/PredicateUtils.scala
create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/connector/catalog/InMemoryTableWithV2Filter.scala
copy sql/catalyst/src/test/scala/org/apache/spark/sql/connector/catalog/{InMemoryRowLevelOperationTableCatalog.scala => InMemoryTableWithV2FilterCatalog.scala} (90%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org