You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@celeborn.apache.org by re...@apache.org on 2025/02/08 01:40:42 UTC

(celeborn) branch main updated: [CELEBORN-1721][FOLLOWUP] Fix the problem of getting partition location in ShuffleClientImpl during soft split

This is an automated email from the ASF dual-hosted git repository.

rexxiong pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn.git


The following commit(s) were added to refs/heads/main by this push:
     new e78c9b8ab [CELEBORN-1721][FOLLOWUP] Fix the problem of getting partition location in ShuffleClientImpl during soft split
e78c9b8ab is described below

commit e78c9b8ab5239db7b4670e037ac9c6566ebc823d
Author: xinyuwang1 <xi...@xiaohongshu.com>
AuthorDate: Sat Feb 8 09:40:32 2025 +0800

    [CELEBORN-1721][FOLLOWUP] Fix the problem of getting partition location in ShuffleClientImpl during soft split
    
    ### What changes were proposed in this pull request?
    Fix the problem of getting partition location in ShuffleClientImpl during soft split.
    
    ### Why are the changes needed?
    bug fix
    
    ### Does this PR introduce _any_ user-facing change?
    No.
    
    ### How was this patch tested?
    CI.
    
    Closes #3092 from littlexyw/CELEBORN-1721-FOLLOWUP.
    
    Authored-by: xinyuwang1 <xi...@xiaohongshu.com>
    Signed-off-by: Shuang <lv...@alibaba-inc.com>
---
 client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
index 8dbccb00b..106d77c21 100644
--- a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
+++ b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
@@ -1489,7 +1489,7 @@ public class ShuffleClientImpl extends ShuffleClient {
                           partitionIds[partitionIndex],
                           StatusCode.fromValue(statusCodeList.get(i).byteValue())));
                   if (statusCodeList.get(i) == StatusCode.SOFT_SPLIT.getValue()) {
-                    PartitionLocation loc = batches.get(i).loc;
+                    PartitionLocation loc = batches.get(partitionIndex).loc;
                     if (!newerPartitionLocationExists(
                         reducePartitionMap.get(shuffleId), loc.getId(), loc.getEpoch(), false)) {
                       ReviveRequest reviveRequest =