You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/09/30 08:52:37 UTC
(datafusion-ballista) branch asf-site updated: Publish built docs triggered by ba1ab3b5da00881efc0c6d8c473802edb1bd5034
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-ballista.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 3eb894ef5 Publish built docs triggered by ba1ab3b5da00881efc0c6d8c473802edb1bd5034
3eb894ef5 is described below
commit 3eb894ef5e582b1487d5a12ab8a8e250b8f13ad0
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Wed Sep 30 08:52:32 2026 +0000
Publish built docs triggered by ba1ab3b5da00881efc0c6d8c473802edb1bd5034
---
_sources/user-guide/configs.md.txt | 1 +
searchindex.js | 2 +-
user-guide/configs.html | 7 ++++++-
3 files changed, 8 insertions(+), 2 deletions(-)
diff --git a/_sources/user-guide/configs.md.txt b/_sources/user-guide/configs.md.txt
index 2508b6cda..9f3a36732 100644
--- a/_sources/user-guide/configs.md.txt
+++ b/_sources/user-guide/configs.md.txt
@@ -135,6 +135,7 @@ standard DataFusion settings.
| ballista.planner.parallel_window.enabled | Boolean | false | Enables the AQE parallel-window rule (ParallelWindowRule), which rewrites bounded-RANGE-frame windows into a distributed range-shuffle so BoundedWindowAggExec's single-partition constraint is not a serial bottleneck. Disabled by default — opt in when the workload contains matching window shapes. [...]
| ballista.planner.propagate_empty.enabled | Boolean | true | Enables the AQE propagate-empty-relation rule. Injects EmptyExec into the plan where an input is known to be empty, such as one side of a join, allowing downstream work to be skipped. [...]
| ballista.scheduler.max_partitions_per_task | UInt64 | 0 | Upper bound on the number of input partitions packed into a single task's `partition_slice`. `0` (default) means unbounded — the scheduler fills each task up to the executor's free vcore count. `1` means one task per input partition. Does not apply to collapse stages, which must pack their full pending queue into a single task for correctness. [...]
+| ballista.scheduler.share_file_statistics_cache | Boolean | true | Shares one file statistics cache across all jobs the scheduler plans, so a job reuses the statistics earlier jobs read from Parquet footers instead of reading every footer again. A cached entry is only used while the file's size and modification time still match, which misses a file rewritten in place without changing either. Set to false to keep this session's jobs off the shared cach [...]
| ballista.standalone.parallelism | UInt16 | number of available CPU cores | Number of vcores advertised by the standalone in-process executor. [...]
<!-- END GENERATED CONFIG REFERENCE -->
diff --git a/searchindex.js b/searchindex.js
index 2f60fcb8a..89a762d3f 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles":{"API changes":[[32,"api-changes"]],"AQE join behavior (opt-in)":[[31,"aqe-join-behavior-opt-in"]],"Adaptive Query Execution":[[55,"adaptive-query-execution"]],"Adaptive Query Execution (AQE)":[[24,"adaptive-query-execution-aqe"]],"Adding a persona":[[29,"adding-a-persona"]],"Aggregate Functions":[[54,"aggregate-functions"]],"Apache DataFusion Ballista":[[30,null]],"Apache DataFusion Ballista 0.10.0 Changelog":[[0,null]],"Apache DataFusion Ballista 0.11.0 Cha [...]
\ No newline at end of file
+Search.setIndex({"alltitles":{"API changes":[[32,"api-changes"]],"AQE join behavior (opt-in)":[[31,"aqe-join-behavior-opt-in"]],"Adaptive Query Execution":[[55,"adaptive-query-execution"]],"Adaptive Query Execution (AQE)":[[24,"adaptive-query-execution-aqe"]],"Adding a persona":[[29,"adding-a-persona"]],"Aggregate Functions":[[54,"aggregate-functions"]],"Apache DataFusion Ballista":[[30,null]],"Apache DataFusion Ballista 0.10.0 Changelog":[[0,null]],"Apache DataFusion Ballista 0.11.0 Cha [...]
\ No newline at end of file
diff --git a/user-guide/configs.html b/user-guide/configs.html
index 7eb17fc75..81b1ac161 100644
--- a/user-guide/configs.html
+++ b/user-guide/configs.html
@@ -620,7 +620,12 @@ standard DataFusion settings.</p>
<td><p>0</p></td>
<td><p>Upper bound on the number of input partitions packed into a single task’s <code class="docutils literal notranslate"><span class="pre">partition_slice</span></code>. <code class="docutils literal notranslate"><span class="pre">0</span></code> (default) means unbounded — the scheduler fills each task up to the executor’s free vcore count. <code class="docutils literal notranslate"><span class="pre">1</span></code> means one task per input partition. Does not apply to collapse stage [...]
</tr>
-<tr class="row-odd"><td><p>ballista.standalone.parallelism</p></td>
+<tr class="row-odd"><td><p>ballista.scheduler.share_file_statistics_cache</p></td>
+<td><p>Boolean</p></td>
+<td><p>true</p></td>
+<td><p>Shares one file statistics cache across all jobs the scheduler plans, so a job reuses the statistics earlier jobs read from Parquet footers instead of reading every footer again. A cached entry is only used while the file’s size and modification time still match, which misses a file rewritten in place without changing either. Set to false to keep this session’s jobs off the shared cache.</p></td>
+</tr>
+<tr class="row-even"><td><p>ballista.standalone.parallelism</p></td>
<td><p>UInt16</p></td>
<td><p>number of available CPU cores</p></td>
<td><p>Number of vcores advertised by the standalone in-process executor.</p></td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org