You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by li...@apache.org on 2020/03/03 00:04:49 UTC
[spark] branch master updated (f0010c8 -> 473a28c)
This is an automated email from the ASF dual-hosted git repository.
lixiao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from f0010c8 [SPARK-31003][TESTS] Fix incorrect uses of assume() in tests
add 473a28c [SPARK-30991] Refactor AQE readers and RDDs
No new revisions were added by this update.
Summary of changes:
.../spark/sql/execution/ShuffledRowRDD.scala | 142 ++++++++++++---------
.../apache/spark/sql/execution/SparkPlanInfo.scala | 2 +-
.../adaptive/CustomShuffleReaderExec.scala | 81 ++++++++++++
.../execution/adaptive/CustomShuffledRowRDD.scala | 113 ----------------
.../execution/adaptive/LocalShuffledRowRDD.scala | 112 ----------------
.../adaptive/OptimizeLocalShuffleReader.scala | 88 +++----------
.../execution/adaptive/OptimizeSkewedJoin.scala | 72 ++---------
.../adaptive/ReduceNumShufflePartitions.scala | 49 ++-----
.../adaptive/ShufflePartitionsCoalescer.scala | 23 ++--
.../execution/exchange/ShuffleExchangeExec.scala | 12 +-
.../ReduceNumShufflePartitionsSuite.scala | 28 ++--
.../ShufflePartitionsCoalescerSuite.scala | 101 ++++++++++-----
.../adaptive/AdaptiveQueryExecSuite.scala | 23 ++--
13 files changed, 317 insertions(+), 529 deletions(-)
create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffleReaderExec.scala
delete mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffledRowRDD.scala
delete mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/LocalShuffledRowRDD.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org