You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2022/03/02 20:25:16 UTC
[spark] branch branch-3.2 updated (416f86d -> 0f03b54)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 416f86d [SPARK-38272][K8S][TESTS] Use `docker-desktop` instead of `docker-for-desktop` for Docker K8S IT deployMode and context name
add 0f03b54 [SPARK-33206][CORE][3.2] Fix shuffle index cache weight calculation for small index files
No new revisions were added by this update.
Summary of changes:
.../spark/network/shuffle/ExecutorDiskUtils.java | 7 +--
.../shuffle/ExternalShuffleBlockResolver.java | 49 ++++++++-------
.../network/shuffle/RemoteBlockPushResolver.java | 48 ++++++++-------
.../network/shuffle/ShuffleIndexInformation.java | 23 ++++---
.../shuffle/RemoteBlockPushResolverSuite.java | 4 +-
.../shuffle/ShuffleIndexInformationSuite.java | 71 ++++++++++++++++++++++
.../network/shuffle/TestShuffleDataContext.java | 16 ++---
.../spark/shuffle/IndexShuffleBlockResolver.scala | 9 ++-
.../org/apache/spark/storage/BlockManager.scala | 2 +-
.../apache/spark/storage/DiskBlockManager.scala | 4 +-
.../apache/spark/storage/BlockManagerSuite.scala | 3 +-
11 files changed, 162 insertions(+), 74 deletions(-)
create mode 100644 common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ShuffleIndexInformationSuite.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org