You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by ho...@apache.org on 2024/08/07 06:40:50 UTC
(incubator-gluten) branch main updated: [VL] Doc: Update RSS docs (#6692)
This is an automated email from the ASF dual-hosted git repository.
hongze pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new e918a5658 [VL] Doc: Update RSS docs (#6692)
e918a5658 is described below
commit e918a56586c54d6c29240c6062a629732d613ec6
Author: Zhen Wang <64...@qq.com>
AuthorDate: Wed Aug 7 14:40:45 2024 +0800
[VL] Doc: Update RSS docs (#6692)
---
docs/get-started/Velox.md | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/docs/get-started/Velox.md b/docs/get-started/Velox.md
index 63239c399..5f49f542b 100644
--- a/docs/get-started/Velox.md
+++ b/docs/get-started/Velox.md
@@ -230,7 +230,7 @@ mvn clean package -Pbackends-velox -Pspark-3.3 -Pceleborn -DskipTests
Then add the Gluten and Spark Celeborn Client packages to your Spark application's classpath(usually add them into `$SPARK_HOME/jars`).
- Celeborn: celeborn-client-spark-3-shaded_2.12-[celebornVersion].jar
-- Gluten: gluten-velox-bundle-spark3.x_2.12-xx_xx_xx-SNAPSHOT.jar, gluten-celeborn-package-xx-SNAPSHOT.jar
+- Gluten: gluten-velox-bundle-spark3.x_2.12-xx_xx_xx-SNAPSHOT.jar (The bundled Gluten Jar. Make sure -Pceleborn is specified when it is built.)
Currently to use Gluten following configurations are required in `spark-defaults.conf`
@@ -279,7 +279,7 @@ mvn clean package -Pbackends-velox -Pspark-3.3 -Puniffle -DskipTests
Then add the Uniffle and Spark Celeborn Client packages to your Spark application's classpath(usually add them into `$SPARK_HOME/jars`).
- Uniffle: rss-client-spark3-shaded-[uniffleVersion].jar
-- Gluten: gluten-uniffle-velox-xxx-SNAPSHOT-3.x.jar
+- Gluten: gluten-velox-bundle-spark3.x_2.12-xx_xx_xx-SNAPSHOT.jar (The bundled Gluten Jar. Make sure -Puniffle is specified when it is built.)
Currently to use Gluten following configurations are required in `spark-defaults.conf`
@@ -298,7 +298,7 @@ spark.shuffle.service.enabled false
spark.rss.storage.type LOCALFILE_HDFS
# If you want to use dynamic resource allocation,
-# please refer to this URL (https://github.com/apache/incubator-uniffle/tree/master/patch/spark) to apply the patch into your own Spark.
+# please refer to this URL (https://uniffle.apache.org/docs/client-guide#support-spark-dynamic-allocation) for more details.
spark.dynamicAllocation.enabled false
```
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org