You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by li...@apache.org on 2020/03/11 04:51:47 UTC

[spark] branch master updated (93def95 -> d5f5720)

This is an automated email from the ASF dual-hosted git repository.

lixiao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 93def95  [SPARK-31095][BUILD] Upgrade netty-all to 4.1.47.Final
     add d5f5720  [SPARK-31070][SQL] make skew join split skewed partitions more evenly

No new revisions were added by this update.

Summary of changes:
 .../adaptive/CoalesceShufflePartitions.scala       |  2 +-
 .../execution/adaptive/OptimizeSkewedJoin.scala    | 44 +++++++------------
 ...Coalescer.scala => ShufflePartitionsUtil.scala} | 50 +++++++++++++++++++++-
 ...uite.scala => ShufflePartitionsUtilSuite.scala} | 32 ++++++++++++--
 .../adaptive/AdaptiveQueryExecSuite.scala          | 14 +++---
 5 files changed, 102 insertions(+), 40 deletions(-)
 rename sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/{ShufflePartitionsCoalescer.scala => ShufflePartitionsUtil.scala} (73%)
 rename sql/core/src/test/scala/org/apache/spark/sql/execution/{ShufflePartitionsCoalescerSuite.scala => ShufflePartitionsUtilSuite.scala} (88%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org