You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2021/07/02 08:08:04 UTC

[spark] branch master updated (ca6acf0 -> 0c9c8ff)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from ca6acf0  [SPARK-35785][SS] Cleanup support for RocksDB instance
     add 0c9c8ff  [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

No new revisions were added by this update.

Summary of changes:
 R/pkg/tests/fulltests/test_sparkSQL.R              |   3 +
 python/pyspark/sql/dataframe.py                    |   6 +-
 python/pyspark/sql/tests/test_dataframe.py         |   2 +-
 .../org/apache/spark/sql/internal/SQLConf.scala    |  33 ++++-
 .../adaptive/CoalesceShufflePartitions.scala       |  29 ++++-
 .../execution/adaptive/ShufflePartitionsUtil.scala |  80 +++++++++---
 .../sql-tests/inputs/postgreSQL/groupingsets.sql   |   2 +-
 .../inputs/subquery/in-subquery/in-order-by.sql    |   2 +-
 .../results/postgreSQL/groupingsets.sql.out        |   6 +-
 .../subquery/in-subquery/in-order-by.sql.out       |   6 +-
 .../org/apache/spark/sql/DataFrameSuite.scala      |   2 +-
 .../sql/execution/ShufflePartitionsUtilSuite.scala | 141 +++++++++++++++------
 .../adaptive/AdaptiveQueryExecSuite.scala          |  13 ++
 13 files changed, 249 insertions(+), 76 deletions(-)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org