You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@celeborn.apache.org by zh...@apache.org on 2023/07/24 12:44:05 UTC

[incubator-celeborn] branch main updated: [CELEBORN-656] Should also refine log about return HARD_SPLIT in handlePushMergedData

This is an automated email from the ASF dual-hosted git repository.

zhouky pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git


The following commit(s) were added to refs/heads/main by this push:
     new 6427ed35c [CELEBORN-656] Should also refine log about return HARD_SPLIT in handlePushMergedData
6427ed35c is described below

commit 6427ed35cd63497191cfc13e7675710a4aa82d96
Author: Angerszhuuuu <an...@gmail.com>
AuthorDate: Mon Jul 24 20:43:56 2023 +0800

    [CELEBORN-656] Should also refine log about return HARD_SPLIT in handlePushMergedData
    
    ### What changes were proposed in this pull request?
    As title
    
    ### Why are the changes needed?
    
    ### Does this PR introduce _any_ user-facing change?
    
    ### How was this patch tested?
    
    Closes #1756 from AngersZhuuuu/CELEBORN-656-FOLLOWUP.
    
    Authored-by: Angerszhuuuu <an...@gmail.com>
    Signed-off-by: zky.zhoukeyong <zk...@alibaba-inc.com>
---
 .../org/apache/celeborn/service/deploy/worker/PushDataHandler.scala   | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala b/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
index bb54a2f8c..f93d46d60 100644
--- a/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
+++ b/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
@@ -448,7 +448,7 @@ class PushDataHandler extends BaseMessageHandler with Logging {
             callbackWithTimer.onSuccess(
               ByteBuffer.wrap(Array[Byte](StatusCode.STAGE_ENDED.getValue)))
           } else {
-            logInfo(s"Receive push merged data for committed hard split partition of " +
+            logInfo(s"[Case1] Receive push merged data for committed hard split partition of " +
               s"(shuffle $shuffleKey, map $mapId attempt $attemptId)")
             callbackWithTimer.onSuccess(
               ByteBuffer.wrap(Array[Byte](StatusCode.HARD_SPLIT.getValue)))
@@ -458,7 +458,7 @@ class PushDataHandler extends BaseMessageHandler with Logging {
             // If there is no shuffle key in shuffleMapperAttempts but there is shuffle key
             // in StorageManager. This partition should be HARD_SPLIT partition and
             // after worker restart, some tasks still push data to this HARD_SPLIT partition.
-            logInfo(s"Receive push merged data for committed hard split partition of " +
+            logInfo(s"[Case2] Receive push merged data for committed hard split partition of " +
               s"(shuffle $shuffleKey, map $mapId attempt $attemptId)")
             callbackWithTimer.onSuccess(
               ByteBuffer.wrap(Array[Byte](StatusCode.HARD_SPLIT.getValue)))