You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2021/02/08 16:43:35 UTC
[spark] branch master updated (c92e408 -> 3b26bc2)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from c92e408 [SPARK-34388][SQL] Propagate the registered UDF name to ScalaUDF, ScalaUDAF and ScalaAggregator
add 3b26bc2 [SPARK-34168][SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning
No new revisions were added by this update.
Summary of changes:
...c.scala => SubqueryAdaptiveBroadcastExec.scala} | 37 ++++++-------
.../execution/adaptive/AdaptiveSparkPlanExec.scala | 5 +-
.../adaptive/CustomShuffleReaderExec.scala | 4 +-
.../adaptive/InsertAdaptiveSparkPlan.scala | 18 +++++--
.../PlanAdaptiveDynamicPruningFilters.scala | 59 +++++++++++++++++++++
.../adaptive/PlanAdaptiveSubqueries.scala | 9 ++--
.../sql/execution/adaptive/QueryStageExec.scala | 27 ++++++++--
.../spark/sql/DynamicPartitionPruningSuite.scala | 61 ++++++++++++++++------
.../execution/CoalesceShufflePartitionsSuite.scala | 4 +-
.../execution/RemoveRedundantProjectsSuite.scala | 3 ++
.../adaptive/AdaptiveQueryExecSuite.scala | 4 +-
11 files changed, 173 insertions(+), 58 deletions(-)
copy sql/core/src/main/scala/org/apache/spark/sql/execution/{datasources/v2/AlterTableExec.scala => SubqueryAdaptiveBroadcastExec.scala} (52%)
create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/PlanAdaptiveDynamicPruningFilters.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org