You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/11/30 21:38:44 UTC

[spark] branch master updated (f3c2583 -> c699435)

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from f3c2583  [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client
     add c699435  [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

No new revisions were added by this update.

Summary of changes:
 core/pom.xml                                       |  41 ++++
 .../main/scala/org/apache/spark/SparkContext.scala |   1 +
 .../org/apache/spark/internal/config/package.scala |  10 +
 .../spark/shuffle/IndexShuffleBlockResolver.scala  |   2 +-
 .../org/apache/spark/storage/BlockManager.scala    |  18 +-
 .../spark/storage/BlockManagerDecommissioner.scala |   3 +
 .../org/apache/spark/storage/FallbackStorage.scala | 174 +++++++++++++
 .../storage/ShuffleBlockFetcherIterator.scala      |   3 +-
 .../spark/storage/FallbackStorageSuite.scala       | 269 +++++++++++++++++++++
 9 files changed, 517 insertions(+), 4 deletions(-)
 create mode 100644 core/src/main/scala/org/apache/spark/storage/FallbackStorage.scala
 create mode 100644 core/src/test/scala/org/apache/spark/storage/FallbackStorageSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org