You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/11/30 21:38:44 UTC
[spark] branch master updated (f3c2583 -> c699435)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from f3c2583 [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client
add c699435 [SPARK-33545][CORE] Support Fallback Storage during Worker decommission
No new revisions were added by this update.
Summary of changes:
core/pom.xml | 41 ++++
.../main/scala/org/apache/spark/SparkContext.scala | 1 +
.../org/apache/spark/internal/config/package.scala | 10 +
.../spark/shuffle/IndexShuffleBlockResolver.scala | 2 +-
.../org/apache/spark/storage/BlockManager.scala | 18 +-
.../spark/storage/BlockManagerDecommissioner.scala | 3 +
.../org/apache/spark/storage/FallbackStorage.scala | 174 +++++++++++++
.../storage/ShuffleBlockFetcherIterator.scala | 3 +-
.../spark/storage/FallbackStorageSuite.scala | 269 +++++++++++++++++++++
9 files changed, 517 insertions(+), 4 deletions(-)
create mode 100644 core/src/main/scala/org/apache/spark/storage/FallbackStorage.scala
create mode 100644 core/src/test/scala/org/apache/spark/storage/FallbackStorageSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org