You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@celeborn.apache.org by zh...@apache.org on 2023/02/14 05:38:08 UTC
[incubator-celeborn] branch main updated: [CELEBORN-298] Fix the wrong configuration name in readme and conf.template (#1234)
This is an automated email from the ASF dual-hosted git repository.
zhouky pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 4fb5b3d54 [CELEBORN-298] Fix the wrong configuration name in readme and conf.template (#1234)
4fb5b3d54 is described below
commit 4fb5b3d5479292eea866ca0123b3360e8568fa23
Author: zhongqiangchen <zh...@alibaba-inc.com>
AuthorDate: Tue Feb 14 13:38:03 2023 +0800
[CELEBORN-298] Fix the wrong configuration name in readme and conf.template (#1234)
---
README.md | 2 +-
conf/celeborn-defaults.conf.template | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/README.md b/README.md
index af6830ef6..bce2a57f3 100644
--- a/README.md
+++ b/README.md
@@ -170,7 +170,7 @@ spark.shuffle.service.enabled false
# options: hash, sort
# Hash shuffle writer use (partition count) * (celeborn.push.buffer.size) * (spark.executor.cores) memory.
# Sort shuffle writer use less memory than hash shuffle writer, if your shuffle partition count is large, try to use sort hash writer.
-spark.celeborn.shuffle.writer.mode hash
+spark.celeborn.shuffle.writer hash
# we recommend set spark.celeborn.push.replicate.enabled to true to enable server-side data replication
spark.celeborn.push.replicate.enabled true
diff --git a/conf/celeborn-defaults.conf.template b/conf/celeborn-defaults.conf.template
index ac692201b..e33293f6b 100644
--- a/conf/celeborn-defaults.conf.template
+++ b/conf/celeborn-defaults.conf.template
@@ -22,7 +22,7 @@ celeborn.rpc.io.serverThreads 8
celeborn.rpc.io.numConnectionsPerPeer 2
celeborn.push.io.numConnectionsPerPeer 2
-celeborn.push.io.threads 8
+celeborn.worker.push.io.threads 8
celeborn.push.replicate.enabled true