You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@celeborn.apache.org by re...@apache.org on 2025/04/21 05:51:28 UTC

(celeborn) branch branch-0.5 updated (cdcb79101 -> daa8e7a6d)

This is an automated email from the ASF dual-hosted git repository.

rexxiong pushed a change to branch branch-0.5
in repository https://gitbox.apache.org/repos/asf/celeborn.git


    from cdcb79101 [CELEBORN-1646][FOLLOWUP] DeviceMonitor should notifyObserversOnError with CRITICAL_ERROR disk status for input/ouput error
     add daa8e7a6d [CELEBORN-1894][0.5] Allow skipping already read chunks during unreplicated shuffle read retries

No new revisions were added by this update.

Summary of changes:
 .../celeborn/client/read/CelebornInputStream.java  |  39 ++++++-
 .../celeborn/client/read/DfsPartitionReader.java   |  53 ++++++++--
 .../celeborn/client/read/LocalPartitionReader.java |   8 ++
 .../celeborn/client/read/MetricsCallback.java      |   2 +
 .../celeborn/client/read/PartitionReader.java      |   4 +
 .../client/read/WorkerPartitionReader.java         |  73 +++++++++++--
 .../PartitionReaderCheckpointMetadata.java         |  30 +++---
 .../org/apache/celeborn/common/CelebornConf.scala  |  12 +++
 docs/configuration/client.md                       |   1 +
 ...tBase.scala => ReadWriteTestWithFailures.scala} | 115 ++++++++-------------
 10 files changed, 228 insertions(+), 109 deletions(-)
 copy common/src/main/java/org/apache/celeborn/common/network/protocol/Heartbeat.java => client/src/main/java/org/apache/celeborn/client/read/checkpoint/PartitionReaderCheckpointMetadata.java (56%)
 copy worker/src/test/scala/org/apache/celeborn/service/deploy/cluster/{ReadWriteTestBase.scala => ReadWriteTestWithFailures.scala} (50%)