You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2025/08/14 00:25:48 UTC

(spark) branch master updated (14f300406133 -> 9297712a66d3)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


    from 14f300406133 [SPARK-53271][PYTHON][INFRA] Show Python Versions in PySpark Jobs
     add 9297712a66d3 [SPARK-53272][SQL] Refactor SPJ pushdown logic out of BatchScanExec

No new revisions were added by this update.

Summary of changes:
 .../sql/execution/KeyGroupedPartitionedScan.scala  | 176 +++++++++++++++++++++
 .../execution/datasources/v2/BatchScanExec.scala   | 158 +-----------------
 .../datasources/v2/DataSourceV2Strategy.scala      |   1 +
 .../joins/StoragePartitionJoinParams.scala         |  48 ++++++
 4 files changed, 232 insertions(+), 151 deletions(-)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/KeyGroupedPartitionedScan.scala
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/joins/StoragePartitionJoinParams.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org