You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by ho...@apache.org on 2024/03/22 02:42:19 UTC
(incubator-gluten) branch main updated: [VL] Remove docs about threshold-based spill
This is an automated email from the ASF dual-hosted git repository.
hongze pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 201f322b0 [VL] Remove docs about threshold-based spill
201f322b0 is described below
commit 201f322b0e8495e277237672f286828d683600a4
Author: Hongze Zhang <ho...@intel.com>
AuthorDate: Fri Mar 22 10:42:15 2024 +0800
[VL] Remove docs about threshold-based spill
---
docs/get-started/Velox.md | 3 ---
1 file changed, 3 deletions(-)
diff --git a/docs/get-started/Velox.md b/docs/get-started/Velox.md
index 8a9001310..acaf9f798 100644
--- a/docs/get-started/Velox.md
+++ b/docs/get-started/Velox.md
@@ -345,9 +345,6 @@ Using the following configuration options to customize spilling:
| spark.gluten.sql.columnar.backend.velox.aggregationSpillEnabled | true | Whether spill is enabled on aggregations |
| spark.gluten.sql.columnar.backend.velox.joinSpillEnabled | true | Whether spill is enabled on joins |
| spark.gluten.sql.columnar.backend.velox.orderBySpillEnabled | true | Whether spill is enabled on sorts |
-| spark.gluten.sql.columnar.backend.velox.aggregationSpillMemoryThreshold | 0 | Memory limit before spilling to disk for aggregations, per Spark task. Unit: byte |
-| spark.gluten.sql.columnar.backend.velox.joinSpillMemoryThreshold | 0 | Memory limit before spilling to disk for joins, per Spark task. Unit: byte |
-| spark.gluten.sql.columnar.backend.velox.orderBySpillMemoryThreshold | 0 | Memory limit before spilling to disk for sorts, per Spark task. Unit: byte |
| spark.gluten.sql.columnar.backend.velox.maxSpillLevel | 4 | The max allowed spilling level with zero being the initial spilling level |
| spark.gluten.sql.columnar.backend.velox.maxSpillFileSize | 20MB | The max allowed spill file size. If it is zero, then there is no limit |
| spark.gluten.sql.columnar.backend.velox.minSpillRunSize | 268435456 | The min spill run size limit used to select partitions for spilling |
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org