You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@celeborn.apache.org by fc...@apache.org on 2023/11/28 12:54:31 UTC
(incubator-celeborn) branch main updated: [CELEBORN-1142] clear shuffleIdCache in shutdown method of ShuffleClientImpl
This is an automated email from the ASF dual-hosted git repository.
fchen pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 98cb941c8 [CELEBORN-1142] clear shuffleIdCache in shutdown method of ShuffleClientImpl
98cb941c8 is described below
commit 98cb941c844023bf946bc215c91b4ddcf587aa28
Author: jiaoqingbo <11...@qq.com>
AuthorDate: Tue Nov 28 20:54:24 2023 +0800
[CELEBORN-1142] clear shuffleIdCache in shutdown method of ShuffleClientImpl
### What changes were proposed in this pull request?
As Title
### Why are the changes needed?
As Title
### Does this PR introduce _any_ user-facing change?
NO
### How was this patch tested?
PASS GA
Closes #2114 from jiaoqingbo/1142.
Authored-by: jiaoqingbo <11...@qq.com>
Signed-off-by: Fu Chen <cf...@gmail.com>
---
client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java | 2 ++
1 file changed, 2 insertions(+)
diff --git a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
index b1a377517..fe7a403ef 100644
--- a/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
+++ b/client/src/main/java/org/apache/celeborn/client/ShuffleClientImpl.java
@@ -1676,6 +1676,8 @@ public class ShuffleClientImpl extends ShuffleClient {
if (null != lifecycleManagerRef) {
lifecycleManagerRef = null;
}
+
+ shuffleIdCache.clear();
pushExcludedWorkers.clear();
fetchExcludedWorkers.clear();
logger.warn("Shuffle client has been shutdown!");