You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2022/03/02 20:25:16 UTC

[spark] branch branch-3.2 updated (416f86d -> 0f03b54)

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 416f86d  [SPARK-38272][K8S][TESTS] Use `docker-desktop` instead of `docker-for-desktop` for Docker K8S IT deployMode and context name
     add 0f03b54  [SPARK-33206][CORE][3.2] Fix shuffle index cache weight calculation for small index files

No new revisions were added by this update.

Summary of changes:
 .../spark/network/shuffle/ExecutorDiskUtils.java   |  7 +--
 .../shuffle/ExternalShuffleBlockResolver.java      | 49 ++++++++-------
 .../network/shuffle/RemoteBlockPushResolver.java   | 48 ++++++++-------
 .../network/shuffle/ShuffleIndexInformation.java   | 23 ++++---
 .../shuffle/RemoteBlockPushResolverSuite.java      |  4 +-
 .../shuffle/ShuffleIndexInformationSuite.java      | 71 ++++++++++++++++++++++
 .../network/shuffle/TestShuffleDataContext.java    | 16 ++---
 .../spark/shuffle/IndexShuffleBlockResolver.scala  |  9 ++-
 .../org/apache/spark/storage/BlockManager.scala    |  2 +-
 .../apache/spark/storage/DiskBlockManager.scala    |  4 +-
 .../apache/spark/storage/BlockManagerSuite.scala   |  3 +-
 11 files changed, 162 insertions(+), 74 deletions(-)
 create mode 100644 common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ShuffleIndexInformationSuite.java

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org