You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2021/02/08 16:43:35 UTC

[spark] branch master updated (c92e408 -> 3b26bc2)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from c92e408  [SPARK-34388][SQL] Propagate the registered UDF name to ScalaUDF, ScalaUDAF and ScalaAggregator
     add 3b26bc2  [SPARK-34168][SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

No new revisions were added by this update.

Summary of changes:
 ...c.scala => SubqueryAdaptiveBroadcastExec.scala} | 37 ++++++-------
 .../execution/adaptive/AdaptiveSparkPlanExec.scala |  5 +-
 .../adaptive/CustomShuffleReaderExec.scala         |  4 +-
 .../adaptive/InsertAdaptiveSparkPlan.scala         | 18 +++++--
 .../PlanAdaptiveDynamicPruningFilters.scala        | 59 +++++++++++++++++++++
 .../adaptive/PlanAdaptiveSubqueries.scala          |  9 ++--
 .../sql/execution/adaptive/QueryStageExec.scala    | 27 ++++++++--
 .../spark/sql/DynamicPartitionPruningSuite.scala   | 61 ++++++++++++++++------
 .../execution/CoalesceShufflePartitionsSuite.scala |  4 +-
 .../execution/RemoveRedundantProjectsSuite.scala   |  3 ++
 .../adaptive/AdaptiveQueryExecSuite.scala          |  4 +-
 11 files changed, 173 insertions(+), 58 deletions(-)
 copy sql/core/src/main/scala/org/apache/spark/sql/execution/{datasources/v2/AlterTableExec.scala => SubqueryAdaptiveBroadcastExec.scala} (52%)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/PlanAdaptiveDynamicPruningFilters.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org