You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2025/09/24 19:46:13 UTC
(datafusion-comet) branch asf-site updated: Publish built docs triggered by 25d5924a72cfbe9f5effeda11f7f27eb09ec26eb
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 7bcc09495 Publish built docs triggered by 25d5924a72cfbe9f5effeda11f7f27eb09ec26eb
7bcc09495 is described below
commit 7bcc09495d14a04be2558c6aba442e5d0cf4c387
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Wed Sep 24 19:46:10 2025 +0000
Publish built docs triggered by 25d5924a72cfbe9f5effeda11f7f27eb09ec26eb
---
_sources/user-guide/latest/configs.md.txt | 2 +-
searchindex.js | 2 +-
user-guide/latest/configs.html | 4 ++--
3 files changed, 4 insertions(+), 4 deletions(-)
diff --git a/_sources/user-guide/latest/configs.md.txt b/_sources/user-guide/latest/configs.md.txt
index fdfc2da35..410386e95 100644
--- a/_sources/user-guide/latest/configs.md.txt
+++ b/_sources/user-guide/latest/configs.md.txt
@@ -72,7 +72,7 @@ Comet provides the following configuration settings.
| spark.comet.memoryOverhead | The amount of additional memory to be allocated per executor process for Comet, in MiB, when running Spark in on-heap mode. This config is optional. If this is not specified, it will be set to `spark.comet.memory.overhead.factor` * `spark.executor.memory`. For more information, refer to the Comet Tuning Guide (https://datafusion.apache.org/comet/user-guide/tuning.html). | |
| spark.comet.metrics.updateInterval | The interval in milliseconds to update metrics. If interval is negative, metrics will be updated upon task completion. | 3000 |
| spark.comet.native.shuffle.partitioning.hash.enabled | Whether to enable hash partitioning for Comet native shuffle. | true |
-| spark.comet.native.shuffle.partitioning.range.enabled | Experimental feature to enable range partitioning for Comet native shuffle. This feature is experimental while we investigate scenarios that don't partition data correctly. | false |
+| spark.comet.native.shuffle.partitioning.range.enabled | Whether to enable range partitioning for Comet native shuffle. | true |
| spark.comet.nativeLoadRequired | Whether to require Comet native library to load successfully when Comet is enabled. If not, Comet will silently fallback to Spark when it fails to load the native lib. Otherwise, an error will be thrown and the Spark job will be aborted. | false |
| spark.comet.parquet.enable.directBuffer | Whether to use Java direct byte buffer when reading Parquet. | false |
| spark.comet.parquet.read.io.adjust.readRange.skew | In the parallel reader, if the read ranges submitted are skewed in sizes, this option will cause the reader to break up larger read ranges into smaller ranges to reduce the skew. This will result in a slightly larger number of connections opened to the file system but may give improved performance. | false |
diff --git a/searchindex.js b/searchindex.js
index 24b473174..d81d2b5f6 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Install Comet": [[12, "install-comet"]], "2. Clone Spark and Apply Diff": [[12, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[12, "run-spark-sql-tests"]], "ANSI Mode": [[17, "ansi-mode"], [56, "ansi-mode"]], "ANSI mode": [[30, "ansi-mode"], [43, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[22, null], [35, n [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Install Comet": [[12, "install-comet"]], "2. Clone Spark and Apply Diff": [[12, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[12, "run-spark-sql-tests"]], "ANSI Mode": [[17, "ansi-mode"], [56, "ansi-mode"]], "ANSI mode": [[30, "ansi-mode"], [43, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[22, null], [35, n [...]
\ No newline at end of file
diff --git a/user-guide/latest/configs.html b/user-guide/latest/configs.html
index e6e821f15..df47b09da 100644
--- a/user-guide/latest/configs.html
+++ b/user-guide/latest/configs.html
@@ -780,8 +780,8 @@ under the License.
<td><p>true</p></td>
</tr>
<tr class="row-even"><td><p>spark.comet.native.shuffle.partitioning.range.enabled</p></td>
-<td><p>Experimental feature to enable range partitioning for Comet native shuffle. This feature is experimental while we investigate scenarios that don’t partition data correctly.</p></td>
-<td><p>false</p></td>
+<td><p>Whether to enable range partitioning for Comet native shuffle.</p></td>
+<td><p>true</p></td>
</tr>
<tr class="row-odd"><td><p>spark.comet.nativeLoadRequired</p></td>
<td><p>Whether to require Comet native library to load successfully when Comet is enabled. If not, Comet will silently fallback to Spark when it fails to load the native lib. Otherwise, an error will be thrown and the Spark job will be aborted.</p></td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org