[spark] branch master updated (3c4044e -> a4ceea6)

[hv...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

hvanhovell pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 3c4044e  [SPARK-30703][SQL][DOCS] Add a document for the ANSI mode
     add a4ceea6  [SPARK-30751][SQL] Combine the skewed readers into one in AQE skew join optimizations

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/execution/ShuffledRowRDD.scala       |  23 +-
 .../execution/adaptive/CustomShuffledRowRDD.scala  | 113 +++++++++
 .../adaptive/OptimizeLocalShuffleReader.scala      |   2 +-
 .../execution/adaptive/OptimizeSkewedJoin.scala    | 276 +++++++++++++--------
 .../adaptive/ReduceNumShufflePartitions.scala      | 157 ++----------
 .../adaptive/ShufflePartitionsCoalescer.scala      | 112 +++++++++
 .../execution/adaptive/SkewedShuffledRowRDD.scala  |  78 ------
 .../execution/exchange/ShuffleExchangeExec.scala   |  21 +-
 .../sql/execution/joins/SortMergeJoinExec.scala    |  13 +-
 .../ReduceNumShufflePartitionsSuite.scala          | 210 +---------------
 .../ShufflePartitionsCoalescerSuite.scala          | 220 ++++++++++++++++
 .../adaptive/AdaptiveQueryExecSuite.scala          | 219 ++++++----------
 12 files changed, 741 insertions(+), 703 deletions(-)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffledRowRDD.scala
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsCoalescer.scala
 delete mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/SkewedShuffledRowRDD.scala
 create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/ShufflePartitionsCoalescerSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org