You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/07/04 22:50:14 UTC
(datafusion-ballista) branch asf-site updated: Publish built docs triggered by 6ccbcd54c38ca3b1072f8b1695855d6f1d973e8d
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-ballista.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 59a229431 Publish built docs triggered by 6ccbcd54c38ca3b1072f8b1695855d6f1d973e8d
59a229431 is described below
commit 59a2294310036165d99c3d0f7781c39c08436412
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Sat Jul 4 22:50:09 2026 +0000
Publish built docs triggered by 6ccbcd54c38ca3b1072f8b1695855d6f1d973e8d
---
_sources/contributors-guide/development.md.txt | 9 +
_sources/index.rst.txt | 6 +
_sources/upgrading/54.0.0.md.txt | 125 ++++++++++
_sources/upgrading/index.rst.txt | 24 ++
changelog/0.10.0.html | 7 +
changelog/0.11.0.html | 7 +
changelog/0.12.0.html | 7 +
changelog/0.5.0.html | 13 +-
changelog/0.6.0.html | 7 +
changelog/0.7.0.html | 7 +
changelog/0.8.0.html | 7 +
changelog/0.9.0.html | 7 +
changelog/43.0.0.html | 7 +
changelog/44.0.0.html | 7 +
changelog/45.0.0.html | 7 +
changelog/46.0.0.html | 7 +
changelog/47.0.0.html | 7 +
changelog/48.0.0.html | 7 +
changelog/49.0.0.html | 7 +
changelog/50.0.0.html | 7 +
changelog/51.0.0.html | 7 +
changelog/52.0.0.html | 7 +
changelog/53.0.0.html | 7 +
changelog/index.html | 7 +
community/communication.html | 7 +
contributors-guide/architecture.html | 13 +-
contributors-guide/code-organization.html | 7 +
contributors-guide/development.html | 17 ++
genindex.html | 7 +
index.html | 13 +
objects.inv | Bin 1084 -> 1112 bytes
search.html | 7 +
searchindex.js | 2 +-
.../development.html => upgrading/54.0.0.html | 267 +++++++++++----------
.../communication.html => upgrading/index.html | 94 +++-----
user-guide/cli.html | 7 +
user-guide/configs.html | 7 +
user-guide/deployment/cargo-install.html | 7 +
user-guide/deployment/docker-compose.html | 7 +
user-guide/deployment/docker.html | 7 +
user-guide/deployment/index.html | 7 +
user-guide/deployment/kubernetes.html | 7 +
user-guide/deployment/quick-start.html | 7 +
user-guide/extending-components.html | 7 +
user-guide/extensions-example.html | 7 +
user-guide/faq.html | 7 +
user-guide/introduction.html | 7 +
user-guide/metrics.html | 7 +
user-guide/python/cloud-storage.html | 7 +
user-guide/python/index.html | 7 +
user-guide/python/jupyter.html | 7 +
user-guide/python/quickstart.html | 7 +
user-guide/rust.html | 7 +
user-guide/scheduler.html | 7 +
user-guide/spark-compatible-functions.html | 7 +
user-guide/tuning-guide.html | 7 +
56 files changed, 691 insertions(+), 200 deletions(-)
diff --git a/_sources/contributors-guide/development.md.txt b/_sources/contributors-guide/development.md.txt
index a54ae08f2..a361c897f 100644
--- a/_sources/contributors-guide/development.md.txt
+++ b/_sources/contributors-guide/development.md.txt
@@ -156,3 +156,12 @@ This includes instructions for:
- Running benchmarks against DataFusion and Ballista
- Comparing performance with Apache Spark
- Running load tests
+
+## Upgrade notes
+
+When a change breaks a public API, renames or removes a configuration key or CLI
+flag, changes a default that alters query plans or results, or changes the
+wire/serialization format, add an entry describing the change and the required
+action to the current unreleased page under
+[`docs/source/upgrading/`](../upgrading/index.rst). This keeps the upgrade guide
+complete for the next release.
diff --git a/_sources/index.rst.txt b/_sources/index.rst.txt
index b14743be6..e66e23752 100644
--- a/_sources/index.rst.txt
+++ b/_sources/index.rst.txt
@@ -64,6 +64,12 @@ Table of content
changelog/index
+.. toctree::
+ :maxdepth: 1
+ :caption: Upgrade Guides
+
+ upgrading/index
+
.. _toc.contributors:
.. toctree::
diff --git a/_sources/upgrading/54.0.0.md.txt b/_sources/upgrading/54.0.0.md.txt
new file mode 100644
index 000000000..0b3a28249
--- /dev/null
+++ b/_sources/upgrading/54.0.0.md.txt
@@ -0,0 +1,125 @@
+<!---
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+-->
+
+# Upgrade Guides
+
+## Ballista 54.0.0
+
+**Note:** Ballista `54.0.0` has not been released yet. The information provided
+in this section pertains to features and changes that have already been merged
+to the main branch and are awaiting release in this version.
+
+### For library and embedding users
+
+#### Upgrade to DataFusion 54
+
+Ballista `54.0.0` upgrades its DataFusion dependency to `54.0.0`. Code built on
+`ballista-core` / DataFusion APIs must move with it. See DataFusion's own
+[Upgrade Guide for 54.0.0](https://datafusion.apache.org/library-user-guide/upgrading/54.0.0.html)
+for the DataFusion-side API changes.
+
+#### `job_id` is now a newtype
+
+Scheduler job identifiers are no longer bare `String`s. `ballista-core` now
+exports a transparent `JobId` newtype (`ballista_core::JobId`) so a job id can
+no longer be confused with another string identifier at the type level. Public
+signatures that previously carried a `String`/`&str` job id now carry a `JobId`
+/ `&JobId` — for example `DistributedQueryExec::job_id()` now returns
+`Option<JobId>` instead of `Option<String>`. Construct one with
+`JobId::new(...)` or `.into()`, and recover the inner string with `.as_str()`
+or `.into_inner()`.
+
+```rust
+// before
+let id: Option<String> = query_exec.job_id();
+
+// after
+use ballista_core::JobId;
+let id: Option<JobId> = query_exec.job_id();
+let id_str: Option<String> = id.map(|id| id.into_inner());
+```
+
+### For cluster operators
+
+#### CORS origins and methods are configured via CLI flags
+
+The scheduler REST API no longer reads CORS configuration from environment
+variables. The `BALLISTA_CORS_ALLOWED_ORIGINS` and
+`BALLISTA_CORS_ALLOWED_METHODS` environment variables are removed and replaced
+by the `--cors-allowed-origins` and `--cors-allowed-methods` scheduler CLI
+flags (each a comma-separated list; `*` allows any). If you set these
+environment variables, move the values to the flags — otherwise the scheduler
+falls back to its defaults (origins `http://localhost:8080` and
+`https://nightlies.apache.org`; methods `GET`, `PATCH`, `OPTIONS`).
+
+```
+# before (environment variables)
+BALLISTA_CORS_ALLOWED_ORIGINS=https://example.com \
+BALLISTA_CORS_ALLOWED_METHODS=GET,PATCH \
+ ballista-scheduler
+
+# after (scheduler CLI flags)
+ballista-scheduler \
+ --cors-allowed-origins https://example.com \
+ --cors-allowed-methods GET,PATCH
+```
+
+### Planner and execution behavior changes
+
+#### The static planner now broadcasts small join build sides
+
+Ballista previously disabled `CollectLeft` broadcast joins entirely (both
+`datafusion.optimizer.hash_join_single_partition_threshold` and
+`hash_join_single_partition_threshold_rows` defaulted to `0`). In `54.0.0`
+those defaults are raised to `10 MB` (`10485760`) and `1000000` rows, and the
+static `DefaultDistributedPlanner` now converts a `SortMergeJoinExec` whose
+smaller side fits under `ballista.optimizer.broadcast_join_threshold_bytes`
+(default `10 MB`) into a broadcast `CollectLeft` hash join. This conversion is
+governed by the new `ballista.optimizer.broadcast_sort_merge_join_enabled`
+config key, which defaults to `true`.
+
+The consequence is that join plans — and therefore performance and shuffle
+behavior — change on upgrade **even with AQE off**. Broadcast is applied only
+to join types that are safe to broadcast (inner and right-side variants); other
+join types remain repartitioned. To restore the previous behavior, set
+`ballista.optimizer.broadcast_sort_merge_join_enabled = false`,
+`ballista.optimizer.broadcast_join_threshold_bytes = 0`,
+`datafusion.optimizer.hash_join_single_partition_threshold = 0`, and
+`hash_join_single_partition_threshold_rows = 0`.
+
+#### Serialized empty projections
+
+The plan serialization for a filter that projects to zero columns changed. In
+`53.x` an empty projection (`Some([])`) and "all columns" (`None`) both encoded
+to an empty list and decoded back to `None`, shifting downstream column indices;
+the scheduler now rewrites such filters into a serde-safe form before
+serialization. Together with the DataFusion 54 protobuf bump, this means a
+`54.0.0` scheduler and a `53.x` executor (or vice versa) cannot reliably
+exchange serialized plans. Upgrade schedulers and executors together — do not
+run a mixed-version cluster across this upgrade.
+
+#### AQE join behavior (opt-in)
+
+If you have enabled `ballista.planner.adaptive.enabled = true`, adaptive join
+selection now delays the join decision and can promote a small build side to a
+broadcast (`CollectLeft`) hash join at runtime, and empty-join inputs are
+short-circuited by the propagate-empty rule. This changes the runtime join
+plans (and their results' timing/shape) for adaptive clusters; it is gated by
+`ballista.planner.adaptive_join.enabled` (default `true`). Clusters using the
+default (AQE off) are unaffected.
diff --git a/_sources/upgrading/index.rst.txt b/_sources/upgrading/index.rst.txt
new file mode 100644
index 000000000..078853ee9
--- /dev/null
+++ b/_sources/upgrading/index.rst.txt
@@ -0,0 +1,24 @@
+.. Licensed to the Apache Software Foundation (ASF) under one
+.. or more contributor license agreements. See the NOTICE file
+.. distributed with this work for additional information
+.. regarding copyright ownership. The ASF licenses this file
+.. to you under the Apache License, Version 2.0 (the
+.. "License"); you may not use this file except in compliance
+.. with the License. You may obtain a copy of the License at
+
+.. http://www.apache.org/licenses/LICENSE-2.0
+
+.. Unless required by applicable law or agreed to in writing,
+.. software distributed under the License is distributed on an
+.. "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+.. KIND, either express or implied. See the License for the
+.. specific language governing permissions and limitations
+.. under the License.
+
+Upgrade Guides
+==============
+
+.. toctree::
+ :maxdepth: 1
+
+ Ballista 54.0.0 <54.0.0>
diff --git a/changelog/0.10.0.html b/changelog/0.10.0.html
index f490b991d..e0e2d4868 100644
--- a/changelog/0.10.0.html
+++ b/changelog/0.10.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/0.11.0.html b/changelog/0.11.0.html
index 27b7f6ee0..01b64a1e2 100644
--- a/changelog/0.11.0.html
+++ b/changelog/0.11.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/0.12.0.html b/changelog/0.12.0.html
index a79cd867a..e59ee38db 100644
--- a/changelog/0.12.0.html
+++ b/changelog/0.12.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/0.5.0.html b/changelog/0.5.0.html
index 63d656f16..880dbd486 100644
--- a/changelog/0.5.0.html
+++ b/changelog/0.5.0.html
@@ -46,7 +46,7 @@
<script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Ballista Architecture" href="../contributors-guide/architecture.html" />
+ <link rel="next" title="Upgrade Guides" href="../upgrading/index.html" />
<link rel="prev" title="Apache DataFusion Ballista 0.6.0 Changelog" href="0.6.0.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -557,11 +564,11 @@ under the License.
</div>
</a>
<a class="right-next"
- href="../contributors-guide/architecture.html"
+ href="../upgrading/index.html"
title="next page">
<div class="prev-next-info">
<p class="prev-next-subtitle">next</p>
- <p class="prev-next-title">Ballista Architecture</p>
+ <p class="prev-next-title">Upgrade Guides</p>
</div>
<i class="fa-solid fa-angle-right"></i>
</a>
diff --git a/changelog/0.6.0.html b/changelog/0.6.0.html
index c3c78c013..b146f9cd3 100644
--- a/changelog/0.6.0.html
+++ b/changelog/0.6.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/0.7.0.html b/changelog/0.7.0.html
index f9e15a539..e509b86fb 100644
--- a/changelog/0.7.0.html
+++ b/changelog/0.7.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/0.8.0.html b/changelog/0.8.0.html
index 09d6f96e6..4d2cad562 100644
--- a/changelog/0.8.0.html
+++ b/changelog/0.8.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/0.9.0.html b/changelog/0.9.0.html
index 5adc1f4a7..134a94d4c 100644
--- a/changelog/0.9.0.html
+++ b/changelog/0.9.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/43.0.0.html b/changelog/43.0.0.html
index e79d13c92..6a95149bb 100644
--- a/changelog/43.0.0.html
+++ b/changelog/43.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/44.0.0.html b/changelog/44.0.0.html
index 57bcd042b..4060d811c 100644
--- a/changelog/44.0.0.html
+++ b/changelog/44.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/45.0.0.html b/changelog/45.0.0.html
index 816ce3571..c165404d8 100644
--- a/changelog/45.0.0.html
+++ b/changelog/45.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/46.0.0.html b/changelog/46.0.0.html
index b191c9669..954e3b54b 100644
--- a/changelog/46.0.0.html
+++ b/changelog/46.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/47.0.0.html b/changelog/47.0.0.html
index 67da1fa02..21610b662 100644
--- a/changelog/47.0.0.html
+++ b/changelog/47.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/48.0.0.html b/changelog/48.0.0.html
index 139097269..78b1ce762 100644
--- a/changelog/48.0.0.html
+++ b/changelog/48.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/49.0.0.html b/changelog/49.0.0.html
index 4e7c98b00..a3d37f711 100644
--- a/changelog/49.0.0.html
+++ b/changelog/49.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/50.0.0.html b/changelog/50.0.0.html
index 4bde22cfc..2d9c9285b 100644
--- a/changelog/50.0.0.html
+++ b/changelog/50.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/51.0.0.html b/changelog/51.0.0.html
index b8d3d06dd..883736f5a 100644
--- a/changelog/51.0.0.html
+++ b/changelog/51.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/52.0.0.html b/changelog/52.0.0.html
index 1c41d8f1f..b7e994cc8 100644
--- a/changelog/52.0.0.html
+++ b/changelog/52.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/53.0.0.html b/changelog/53.0.0.html
index 48fe34472..33a31c281 100644
--- a/changelog/53.0.0.html
+++ b/changelog/53.0.0.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/changelog/index.html b/changelog/index.html
index aca4aa5f4..3927e7a56 100644
--- a/changelog/index.html
+++ b/changelog/index.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/community/communication.html b/community/communication.html
index 209e514b9..45bacaf71 100644
--- a/community/communication.html
+++ b/community/communication.html
@@ -288,6 +288,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/contributors-guide/architecture.html b/contributors-guide/architecture.html
index 751c963bb..d32137f45 100644
--- a/contributors-guide/architecture.html
+++ b/contributors-guide/architecture.html
@@ -47,7 +47,7 @@
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="Ballista Code Organization" href="code-organization.html" />
- <link rel="prev" title="Apache DataFusion Ballista 0.5.0 Changelog" href="../changelog/0.5.0.html" />
+ <link rel="prev" title="Upgrade Guides" href="../upgrading/54.0.0.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<meta name="docsearch:version" content="" />
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="current nav bd-sidenav">
<li class="toctree-l1 current active"><a class="current reference internal" href="#">Ballista Architecture</a></li>
@@ -555,12 +562,12 @@ and <a class="reference external" href="https://github.com/apache/datafusion-bal
<div class="prev-next-area">
<a class="left-prev"
- href="../changelog/0.5.0.html"
+ href="../upgrading/54.0.0.html"
title="previous page">
<i class="fa-solid fa-angle-left"></i>
<div class="prev-next-info">
<p class="prev-next-subtitle">previous</p>
- <p class="prev-next-title">Apache DataFusion Ballista 0.5.0 Changelog</p>
+ <p class="prev-next-title">Upgrade Guides</p>
</div>
</a>
<a class="right-next"
diff --git a/contributors-guide/code-organization.html b/contributors-guide/code-organization.html
index 1e1e1a07a..b0de5fc27 100644
--- a/contributors-guide/code-organization.html
+++ b/contributors-guide/code-organization.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="current nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
diff --git a/contributors-guide/development.html b/contributors-guide/development.html
index f8349a27f..1b9c376ad 100644
--- a/contributors-guide/development.html
+++ b/contributors-guide/development.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="current nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
@@ -500,6 +507,15 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
<li><p>Running load tests</p></li>
</ul>
</section>
+<section id="upgrade-notes">
+<h2>Upgrade notes<a class="headerlink" href="#upgrade-notes" title="Link to this heading">#</a></h2>
+<p>When a change breaks a public API, renames or removes a configuration key or CLI
+flag, changes a default that alters query plans or results, or changes the
+wire/serialization format, add an entry describing the change and the required
+action to the current unreleased page under
+<a class="reference internal" href="../upgrading/index.html"><span class="std std-doc"><code class="docutils literal notranslate"><span class="pre">docs/source/upgrading/</span></code></span></a>. This keeps the upgrade guide
+complete for the next release.</p>
+</section>
</section>
@@ -561,6 +577,7 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
</ul>
</li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#benchmarking">Benchmarking</a></li>
+<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#upgrade-notes">Upgrade notes</a></li>
</ul>
</nav></div>
diff --git a/genindex.html b/genindex.html
index 64c7a1e38..78583afb6 100644
--- a/genindex.html
+++ b/genindex.html
@@ -284,6 +284,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/index.html b/index.html
index bf3bcc5ac..43b992b12 100644
--- a/index.html
+++ b/index.html
@@ -290,6 +290,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -380,6 +387,12 @@
<li class="toctree-l1"><a class="reference internal" href="changelog/index.html">Changelog</a></li>
</ul>
</div>
+<div class="toctree-wrapper compound">
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="upgrading/index.html">Upgrade Guides</a></li>
+</ul>
+</div>
<div class="toctree-wrapper compound" id="toc-contributors">
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul>
diff --git a/objects.inv b/objects.inv
index 44b11d9ce..38651ed38 100644
Binary files a/objects.inv and b/objects.inv differ
diff --git a/search.html b/search.html
index 66fee7cc5..65f4b6d1c 100644
--- a/search.html
+++ b/search.html
@@ -283,6 +283,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/searchindex.js b/searchindex.js
index 5d9e79aca..20d743f8b 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles":{"Adaptive Query Execution (Experimental)":[[45,"adaptive-query-execution-experimental"]],"Aggregate Functions":[[44,"aggregate-functions"]],"Apache DataFusion Ballista":[[24,null]],"Apache DataFusion Ballista 0.10.0 Changelog":[[0,null]],"Apache DataFusion Ballista 0.11.0 Changelog":[[1,null]],"Apache DataFusion Ballista 0.12.0 Changelog":[[2,null]],"Apache DataFusion Ballista 0.5.0 Changelog":[[3,null]],"Apache DataFusion Ballista 0.6.0 Changelog":[[4,null] [...]
\ No newline at end of file
+Search.setIndex({"alltitles":{"AQE join behavior (opt-in)":[[25,"aqe-join-behavior-opt-in"]],"Adaptive Query Execution (Experimental)":[[47,"adaptive-query-execution-experimental"]],"Aggregate Functions":[[46,"aggregate-functions"]],"Apache DataFusion Ballista":[[24,null]],"Apache DataFusion Ballista 0.10.0 Changelog":[[0,null]],"Apache DataFusion Ballista 0.11.0 Changelog":[[1,null]],"Apache DataFusion Ballista 0.12.0 Changelog":[[2,null]],"Apache DataFusion Ballista 0.5.0 Changelog":[[ [...]
\ No newline at end of file
diff --git a/contributors-guide/development.html b/upgrading/54.0.0.html
similarity index 55%
copy from contributors-guide/development.html
copy to upgrading/54.0.0.html
index f8349a27f..1afe9056f 100644
--- a/contributors-guide/development.html
+++ b/upgrading/54.0.0.html
@@ -8,7 +8,7 @@
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
- <title>Ballista Development — Apache DataFusion Ballista documentation</title>
+ <title>Upgrade Guides — Apache DataFusion Ballista documentation</title>
@@ -42,12 +42,12 @@
<script src="../_static/documentation_options.js?v=5929fcd5"></script>
<script src="../_static/doctools.js?v=fd6eb6e6"></script>
<script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
- <script>DOCUMENTATION_OPTIONS.pagename = 'contributors-guide/development';</script>
+ <script>DOCUMENTATION_OPTIONS.pagename = 'upgrading/54.0.0';</script>
<script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
- <link rel="next" title="Communication" href="../community/communication.html" />
- <link rel="prev" title="Ballista Code Organization" href="code-organization.html" />
+ <link rel="next" title="Ballista Architecture" href="../contributors-guide/architecture.html" />
+ <link rel="prev" title="Upgrade Guides" href="index.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<meta name="docsearch:version" content="" />
@@ -289,11 +289,18 @@
</ul>
</details></li>
</ul>
-<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
<ul class="current nav bd-sidenav">
-<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
-<li class="toctree-l1"><a class="reference internal" href="code-organization.html">Ballista Code Organization</a></li>
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Ballista Development</a></li>
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Upgrade Guides</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
@@ -343,7 +350,10 @@
<i class="fa-solid fa-home"></i>
</a>
</li>
- <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Ballista Development</span></li>
+
+ <li class="breadcrumb-item"><a href="index.html" class="nav-link">Upgrade Guides</a></li>
+
+ <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Upgrade Guides</span></li>
</ul>
</nav>
</div>
@@ -378,127 +388,112 @@
specific language governing permissions and limitations
under the License.
-->
-<section id="ballista-development">
-<h1>Ballista Development<a class="headerlink" href="#ballista-development" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<section id="development-environment">
-<h2>Development Environment<a class="headerlink" href="#development-environment" title="Link to this heading">#</a></h2>
-<p>The easiest way to get started if you are using VSCode or IntelliJ IDEA is to open the provided <a class="reference external" href="https://containers.dev/overview">Dev Container</a>
-which will install all the required dependencies including Rust, Docker, Node.js and Yarn. A Dev Container is a
-development environment that runs in a Docker container. It is configured with all the required dependencies to
-build and test the project. It also includes VS Code and the Rust and Node.js extensions. Other supporting tools
-that use Dev Containers can be seen <a class="reference external" href="https://containers.dev/supporting">here</a></p>
-<p>To use the Dev Container, open the project in VS Code and then click the “Reopen in Container” button in the
-bottom right corner of the IDE.</p>
-<p>If you are not using the Dev Container or VScode, you will need to install these dependencies yourself.</p>
-<ul class="simple">
-<li><p><a class="reference external" href="https://www.rust-lang.org/tools/install">Rust</a></p></li>
-<li><p><a class="reference external" href="https://protobuf.dev/downloads/">Protobuf Compiler</a> is required to build the project.</p></li>
-<li><p><a class="reference external" href="https://nodejs.org/en/download/">Node.js</a> is required to build the project.</p></li>
-<li><p><a class="reference external" href="https://classic.yarnpkg.com/en/docs/install">Yarn</a> is required to build the UI.</p></li>
-<li><p><a class="reference external" href="https://docs.docker.com/get-docker/">Docker</a> is required to run the integration tests.</p></li>
-</ul>
+<section id="upgrade-guides">
+<h1>Upgrade Guides<a class="headerlink" href="#upgrade-guides" title="Link to this heading">#</a></h1>
+<section id="ballista-54-0-0">
+<h2>Ballista 54.0.0<a class="headerlink" href="#ballista-54-0-0" title="Link to this heading">#</a></h2>
+<p><strong>Note:</strong> Ballista <code class="docutils literal notranslate"><span class="pre">54.0.0</span></code> has not been released yet. The information provided
+in this section pertains to features and changes that have already been merged
+to the main branch and are awaiting release in this version.</p>
+<section id="for-library-and-embedding-users">
+<h3>For library and embedding users<a class="headerlink" href="#for-library-and-embedding-users" title="Link to this heading">#</a></h3>
+<section id="upgrade-to-datafusion-54">
+<h4>Upgrade to DataFusion 54<a class="headerlink" href="#upgrade-to-datafusion-54" title="Link to this heading">#</a></h4>
+<p>Ballista <code class="docutils literal notranslate"><span class="pre">54.0.0</span></code> upgrades its DataFusion dependency to <code class="docutils literal notranslate"><span class="pre">54.0.0</span></code>. Code built on
+<code class="docutils literal notranslate"><span class="pre">ballista-core</span></code> / DataFusion APIs must move with it. See DataFusion’s own
+<a class="reference external" href="https://datafusion.apache.org/library-user-guide/upgrading/54.0.0.html">Upgrade Guide for 54.0.0</a>
+for the DataFusion-side API changes.</p>
</section>
-<section id="build-the-project">
-<h2>Build the project<a class="headerlink" href="#build-the-project" title="Link to this heading">#</a></h2>
-<p>From the root of the project, build release binaries.</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>cargo<span class="w"> </span>build<span class="w"> </span>--release
+<section id="job-id-is-now-a-newtype">
+<h4><code class="docutils literal notranslate"><span class="pre">job_id</span></code> is now a newtype<a class="headerlink" href="#job-id-is-now-a-newtype" title="Link to this heading">#</a></h4>
+<p>Scheduler job identifiers are no longer bare <code class="docutils literal notranslate"><span class="pre">String</span></code>s. <code class="docutils literal notranslate"><span class="pre">ballista-core</span></code> now
+exports a transparent <code class="docutils literal notranslate"><span class="pre">JobId</span></code> newtype (<code class="docutils literal notranslate"><span class="pre">ballista_core::JobId</span></code>) so a job id can
+no longer be confused with another string identifier at the type level. Public
+signatures that previously carried a <code class="docutils literal notranslate"><span class="pre">String</span></code>/<code class="docutils literal notranslate"><span class="pre">&str</span></code> job id now carry a <code class="docutils literal notranslate"><span class="pre">JobId</span></code>
+/ <code class="docutils literal notranslate"><span class="pre">&JobId</span></code> — for example <code class="docutils literal notranslate"><span class="pre">DistributedQueryExec::job_id()</span></code> now returns
+<code class="docutils literal notranslate"><span class="pre">Option<JobId></span></code> instead of <code class="docutils literal notranslate"><span class="pre">Option<String></span></code>. Construct one with
+<code class="docutils literal notranslate"><span class="pre">JobId::new(...)</span></code> or <code class="docutils literal notranslate"><span class="pre">.into()</span></code>, and recover the inner string with <code class="docutils literal notranslate"><span class="pre">.as_str()</span></code>
+or <code class="docutils literal notranslate"><span class="pre">.into_inner()</span></code>.</p>
+<div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="c1">// before</span>
+<span class="kd">let</span><span class="w"> </span><span class="n">id</span><span class="p">:</span><span class="w"> </span><span class="nb">Option</span><span class="o"><</span><span class="nb">String</span><span class="o">></span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">query_exec</span><span class="p">.</span><span class="n">job_id</span><span class="p">();</span>
+
+<span class="c1">// after</span>
+<span class="k">use</span><span class="w"> </span><span class="n">ballista_core</span><span class="p">::</span><span class="n">JobId</span><span class="p">;</span>
+<span class="kd">let</span><span class="w"> </span><span class="n">id</span><span class="p">:</span><span class="w"> </span><span class="nb">Option</span><span class="o"><</span><span class="n">JobId</span><span class="o">></span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">query_exec</span><span class="p">.</span><span class="n">job_id</span><span class="p">();</span>
+<span class="kd">let</span><span class="w"> </span><span class="n">id_str</span><span class="p">:</span><span class="w"> </span><span class="nb">Option</span><span class="o"><</span><span class="nb">String</span><span class="o">></span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">id</span><span class="p">.</span><span class="n">map</span><span class="p">(</span><span class="o">|</span><span class="n">id</span><span class="o">|</span><span [...]
</pre></div>
</div>
</section>
-<section id="testing-the-project">
-<h2>Testing the project<a class="headerlink" href="#testing-the-project" title="Link to this heading">#</a></h2>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>cargo<span class="w"> </span><span class="nb">test</span>
-</pre></div>
-</div>
</section>
-<section id="running-the-examples">
-<h2>Running the examples<a class="headerlink" href="#running-the-examples" title="Link to this heading">#</a></h2>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>examples
-cargo<span class="w"> </span>run<span class="w"> </span>--example<span class="w"> </span>standalone_sql<span class="w"> </span>--features<span class="o">=</span>ballista/standalone
+<section id="for-cluster-operators">
+<h3>For cluster operators<a class="headerlink" href="#for-cluster-operators" title="Link to this heading">#</a></h3>
+<section id="cors-origins-and-methods-are-configured-via-cli-flags">
+<h4>CORS origins and methods are configured via CLI flags<a class="headerlink" href="#cors-origins-and-methods-are-configured-via-cli-flags" title="Link to this heading">#</a></h4>
+<p>The scheduler REST API no longer reads CORS configuration from environment
+variables. The <code class="docutils literal notranslate"><span class="pre">BALLISTA_CORS_ALLOWED_ORIGINS</span></code> and
+<code class="docutils literal notranslate"><span class="pre">BALLISTA_CORS_ALLOWED_METHODS</span></code> environment variables are removed and replaced
+by the <code class="docutils literal notranslate"><span class="pre">--cors-allowed-origins</span></code> and <code class="docutils literal notranslate"><span class="pre">--cors-allowed-methods</span></code> scheduler CLI
+flags (each a comma-separated list; <code class="docutils literal notranslate"><span class="pre">*</span></code> allows any). If you set these
+environment variables, move the values to the flags — otherwise the scheduler
+falls back to its defaults (origins <code class="docutils literal notranslate"><span class="pre">http://localhost:8080</span></code> and
+<code class="docutils literal notranslate"><span class="pre">https://nightlies.apache.org</span></code>; methods <code class="docutils literal notranslate"><span class="pre">GET</span></code>, <code class="docutils literal notranslate"><span class="pre">PATCH</span></code>, <code class="docutils literal notranslate"><span class="pre">OPTIONS</span></code>).</p>
+<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="c1"># before (environment variables)</span>
+<span class="n">BALLISTA_CORS_ALLOWED_ORIGINS</span><span class="o">=</span><span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">example</span><span class="o">.</span><span class="n">com</span> \
+<span class="n">BALLISTA_CORS_ALLOWED_METHODS</span><span class="o">=</span><span class="n">GET</span><span class="p">,</span><span class="n">PATCH</span> \
+ <span class="n">ballista</span><span class="o">-</span><span class="n">scheduler</span>
+
+<span class="c1"># after (scheduler CLI flags)</span>
+<span class="n">ballista</span><span class="o">-</span><span class="n">scheduler</span> \
+ <span class="o">--</span><span class="n">cors</span><span class="o">-</span><span class="n">allowed</span><span class="o">-</span><span class="n">origins</span> <span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">example</span><span class="o">.</span><span class="n">com</span> \
+ <span class="o">--</span><span class="n">cors</span><span class="o">-</span><span class="n">allowed</span><span class="o">-</span><span class="n">methods</span> <span class="n">GET</span><span class="p">,</span><span class="n">PATCH</span>
</pre></div>
</div>
</section>
-<section id="building-the-python-client-from-source">
-<h2>Building the Python Client from Source<a class="headerlink" href="#building-the-python-client-from-source" title="Link to this heading">#</a></h2>
-<p>The Python client (<code class="docutils literal notranslate"><span class="pre">ballista</span></code> on PyPI) lives in the <code class="docutils literal notranslate"><span class="pre">python/</span></code> directory and is versioned and released
-independently from the main Ballista project, so it is intentionally not part of the default Cargo
-workspace. Building it from source uses <a class="reference external" href="https://www.maturin.rs/">maturin</a> to compile the Rust
-extension module and install it into a Python virtual environment.</p>
-<section id="prerequisites">
-<h3>Prerequisites<a class="headerlink" href="#prerequisites" title="Link to this heading">#</a></h3>
-<ul class="simple">
-<li><p>Python 3.10 or newer</p></li>
-<li><p>The Rust toolchain (see <a class="reference internal" href="#development-environment"><span class="xref myst">Development Environment</span></a>)</p></li>
-<li><p><a class="reference external" href="https://protobuf.dev/downloads/"><code class="docutils literal notranslate"><span class="pre">protoc</span></code></a> on your <code class="docutils literal notranslate"><span class="pre">PATH</span></code></p></li>
-</ul>
-<p>All commands in this section are run from the <code class="docutils literal notranslate"><span class="pre">python/</span></code> directory:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>python
-</pre></div>
-</div>
</section>
-<section id="create-a-virtual-environment">
-<h3>Create a virtual environment<a class="headerlink" href="#create-a-virtual-environment" title="Link to this heading">#</a></h3>
-<p>Using <code class="docutils literal notranslate"><span class="pre">pip</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>python3<span class="w"> </span>-m<span class="w"> </span>venv<span class="w"> </span>.venv
-<span class="nb">source</span><span class="w"> </span>.venv/bin/activate
-pip3<span class="w"> </span>install<span class="w"> </span>--upgrade<span class="w"> </span>pip
-pip3<span class="w"> </span>install<span class="w"> </span>-r<span class="w"> </span>requirements.txt
-</pre></div>
-</div>
-<p>The <code class="docutils literal notranslate"><span class="pre">pip</span></code> upgrade is required because <code class="docutils literal notranslate"><span class="pre">maturin</span> <span class="pre">develop</span></code> invokes <code class="docutils literal notranslate"><span class="pre">pip</span> <span class="pre">install</span> <span class="pre">--group</span></code>, which
-needs pip 25.1 or newer. The pip shipped with <code class="docutils literal notranslate"><span class="pre">python3</span> <span class="pre">-m</span> <span class="pre">venv</span></code> is often older than that.</p>
-<p>Using <a class="reference external" href="https://docs.astral.sh/uv/"><code class="docutils literal notranslate"><span class="pre">uv</span></code></a>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>sync<span class="w"> </span>--dev<span class="w"> </span>--no-install-package<span class="w"> </span>ballista
-</pre></div>
-</div>
+<section id="planner-and-execution-behavior-changes">
+<h3>Planner and execution behavior changes<a class="headerlink" href="#planner-and-execution-behavior-changes" title="Link to this heading">#</a></h3>
+<section id="the-static-planner-now-broadcasts-small-join-build-sides">
+<h4>The static planner now broadcasts small join build sides<a class="headerlink" href="#the-static-planner-now-broadcasts-small-join-build-sides" title="Link to this heading">#</a></h4>
+<p>Ballista previously disabled <code class="docutils literal notranslate"><span class="pre">CollectLeft</span></code> broadcast joins entirely (both
+<code class="docutils literal notranslate"><span class="pre">datafusion.optimizer.hash_join_single_partition_threshold</span></code> and
+<code class="docutils literal notranslate"><span class="pre">hash_join_single_partition_threshold_rows</span></code> defaulted to <code class="docutils literal notranslate"><span class="pre">0</span></code>). In <code class="docutils literal notranslate"><span class="pre">54.0.0</span></code>
+those defaults are raised to <code class="docutils literal notranslate"><span class="pre">10</span> <span class="pre">MB</span></code> (<code class="docutils literal notranslate"><span class="pre">10485760</span></code>) and <code class="docutils literal notranslate"><span class="pre">1000000</span></code> rows, and the
+static <code class="docutils literal notranslate"><span class="pre">DefaultDistributedPlanner</span></code> now converts a <code class="docutils literal notranslate"><span class="pre">SortMergeJoinExec</span></code> whose
+smaller side fits under <code class="docutils literal notranslate"><span class="pre">ballista.optimizer.broadcast_join_threshold_bytes</span></code>
+(default <code class="docutils literal notranslate"><span class="pre">10</span> <span class="pre">MB</span></code>) into a broadcast <code class="docutils literal notranslate"><span class="pre">CollectLeft</span></code> hash join. This conversion is
+governed by the new <code class="docutils literal notranslate"><span class="pre">ballista.optimizer.broadcast_sort_merge_join_enabled</span></code>
+config key, which defaults to <code class="docutils literal notranslate"><span class="pre">true</span></code>.</p>
+<p>The consequence is that join plans — and therefore performance and shuffle
+behavior — change on upgrade <strong>even with AQE off</strong>. Broadcast is applied only
+to join types that are safe to broadcast (inner and right-side variants); other
+join types remain repartitioned. To restore the previous behavior, set
+<code class="docutils literal notranslate"><span class="pre">ballista.optimizer.broadcast_sort_merge_join_enabled</span> <span class="pre">=</span> <span class="pre">false</span></code>,
+<code class="docutils literal notranslate"><span class="pre">ballista.optimizer.broadcast_join_threshold_bytes</span> <span class="pre">=</span> <span class="pre">0</span></code>,
+<code class="docutils literal notranslate"><span class="pre">datafusion.optimizer.hash_join_single_partition_threshold</span> <span class="pre">=</span> <span class="pre">0</span></code>, and
+<code class="docutils literal notranslate"><span class="pre">hash_join_single_partition_threshold_rows</span> <span class="pre">=</span> <span class="pre">0</span></code>.</p>
</section>
-<section id="build-and-install">
-<h3>Build and install<a class="headerlink" href="#build-and-install" title="Link to this heading">#</a></h3>
-<p><code class="docutils literal notranslate"><span class="pre">maturin</span> <span class="pre">develop</span></code> compiles the Rust extension and installs it into the active virtual environment
-as an editable package, so subsequent Python imports pick up your local changes.</p>
-<p>Using <code class="docutils literal notranslate"><span class="pre">pip</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>maturin<span class="w"> </span>develop<span class="w"> </span><span class="c1"># debug build</span>
-maturin<span class="w"> </span>develop<span class="w"> </span>--release<span class="w"> </span><span class="c1"># release build (slower to compile, faster at runtime)</span>
-</pre></div>
-</div>
-<p>Using <code class="docutils literal notranslate"><span class="pre">uv</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>run<span class="w"> </span>--no-project<span class="w"> </span>maturin<span class="w"> </span>develop<span class="w"> </span>--uv
-</pre></div>
-</div>
-<p>To produce a wheel without installing it (for example, to share or publish):</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>run<span class="w"> </span>--no-project<span class="w"> </span>maturin<span class="w"> </span>build<span class="w"> </span>--release<span class="w"> </span>--strip
-</pre></div>
-</div>
+<section id="serialized-empty-projections">
+<h4>Serialized empty projections<a class="headerlink" href="#serialized-empty-projections" title="Link to this heading">#</a></h4>
+<p>The plan serialization for a filter that projects to zero columns changed. In
+<code class="docutils literal notranslate"><span class="pre">53.x</span></code> an empty projection (<code class="docutils literal notranslate"><span class="pre">Some([])</span></code>) and “all columns” (<code class="docutils literal notranslate"><span class="pre">None</span></code>) both encoded
+to an empty list and decoded back to <code class="docutils literal notranslate"><span class="pre">None</span></code>, shifting downstream column indices;
+the scheduler now rewrites such filters into a serde-safe form before
+serialization. Together with the DataFusion 54 protobuf bump, this means a
+<code class="docutils literal notranslate"><span class="pre">54.0.0</span></code> scheduler and a <code class="docutils literal notranslate"><span class="pre">53.x</span></code> executor (or vice versa) cannot reliably
+exchange serialized plans. Upgrade schedulers and executors together — do not
+run a mixed-version cluster across this upgrade.</p>
</section>
-<section id="run-the-tests">
-<h3>Run the tests<a class="headerlink" href="#run-the-tests" title="Link to this heading">#</a></h3>
-<p>Using <code class="docutils literal notranslate"><span class="pre">pip</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>python3<span class="w"> </span>-m<span class="w"> </span>pytest
-</pre></div>
-</div>
-<p>Using <code class="docutils literal notranslate"><span class="pre">uv</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>run<span class="w"> </span>--no-project<span class="w"> </span>pytest
-</pre></div>
-</div>
-<p>For more detail on the underlying workflow, including tips for improving build speed, see the
-<a class="reference external" href="https://datafusion.apache.org/python/contributor-guide/introduction.html">DataFusion Python contributor guide</a>.</p>
+<section id="aqe-join-behavior-opt-in">
+<h4>AQE join behavior (opt-in)<a class="headerlink" href="#aqe-join-behavior-opt-in" title="Link to this heading">#</a></h4>
+<p>If you have enabled <code class="docutils literal notranslate"><span class="pre">ballista.planner.adaptive.enabled</span> <span class="pre">=</span> <span class="pre">true</span></code>, adaptive join
+selection now delays the join decision and can promote a small build side to a
+broadcast (<code class="docutils literal notranslate"><span class="pre">CollectLeft</span></code>) hash join at runtime, and empty-join inputs are
+short-circuited by the propagate-empty rule. This changes the runtime join
+plans (and their results’ timing/shape) for adaptive clusters; it is gated by
+<code class="docutils literal notranslate"><span class="pre">ballista.planner.adaptive_join.enabled</span></code> (default <code class="docutils literal notranslate"><span class="pre">true</span></code>). Clusters using the
+default (AQE off) are unaffected.</p>
</section>
</section>
-<section id="benchmarking">
-<h2>Benchmarking<a class="headerlink" href="#benchmarking" title="Link to this heading">#</a></h2>
-<p>For performance testing and benchmarking with TPC-H and other datasets, see the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/benchmarks/README.md">benchmarks README</a>.</p>
-<p>This includes instructions for:</p>
-<ul class="simple">
-<li><p>Generating TPC-H test data</p></li>
-<li><p>Running benchmarks against DataFusion and Ballista</p></li>
-<li><p>Comparing performance with Apache Spark</p></li>
-<li><p>Running load tests</p></li>
-</ul>
</section>
</section>
@@ -513,20 +508,20 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
<div class="prev-next-area">
<a class="left-prev"
- href="code-organization.html"
+ href="index.html"
title="previous page">
<i class="fa-solid fa-angle-left"></i>
<div class="prev-next-info">
<p class="prev-next-subtitle">previous</p>
- <p class="prev-next-title">Ballista Code Organization</p>
+ <p class="prev-next-title">Upgrade Guides</p>
</div>
</a>
<a class="right-next"
- href="../community/communication.html"
+ href="../contributors-guide/architecture.html"
title="next page">
<div class="prev-next-info">
<p class="prev-next-subtitle">next</p>
- <p class="prev-next-title">Communication</p>
+ <p class="prev-next-title">Ballista Architecture</p>
</div>
<i class="fa-solid fa-angle-right"></i>
</a>
@@ -549,18 +544,24 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
</div>
<nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
<ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#development-environment">Development Environment</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#build-the-project">Build the project</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#testing-the-project">Testing the project</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#running-the-examples">Running the examples</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#building-the-python-client-from-source">Building the Python Client from Source</a><ul class="nav section-nav flex-column">
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#prerequisites">Prerequisites</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#create-a-virtual-environment">Create a virtual environment</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#build-and-install">Build and install</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#run-the-tests">Run the tests</a></li>
+<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-54-0-0">Ballista 54.0.0</a><ul class="nav section-nav flex-column">
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#for-library-and-embedding-users">For library and embedding users</a><ul class="nav section-nav flex-column">
+<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#upgrade-to-datafusion-54">Upgrade to DataFusion 54</a></li>
+<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#job-id-is-now-a-newtype"><code class="docutils literal notranslate"><span class="pre">job_id</span></code> is now a newtype</a></li>
+</ul>
+</li>
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#for-cluster-operators">For cluster operators</a><ul class="nav section-nav flex-column">
+<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#cors-origins-and-methods-are-configured-via-cli-flags">CORS origins and methods are configured via CLI flags</a></li>
+</ul>
+</li>
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#planner-and-execution-behavior-changes">Planner and execution behavior changes</a><ul class="nav section-nav flex-column">
+<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#the-static-planner-now-broadcasts-small-join-build-sides">The static planner now broadcasts small join build sides</a></li>
+<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#serialized-empty-projections">Serialized empty projections</a></li>
+<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#aqe-join-behavior-opt-in">AQE join behavior (opt-in)</a></li>
+</ul>
+</li>
</ul>
</li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#benchmarking">Benchmarking</a></li>
</ul>
</nav></div>
@@ -568,7 +569,7 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
<div class="tocsection editthispage">
- <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/contributors-guide/development.md">
+ <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/upgrading/54.0.0.md">
<i class="fa-solid fa-pencil"></i>
@@ -583,7 +584,7 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
<div class="sidebar-secondary-item">
<div class="tocsection sourcelink">
- <a href="../_sources/contributors-guide/development.md.txt">
+ <a href="../_sources/upgrading/54.0.0.md.txt">
<i class="fa-solid fa-file-lines"></i> Show Source
</a>
</div>
diff --git a/community/communication.html b/upgrading/index.html
similarity index 84%
copy from community/communication.html
copy to upgrading/index.html
index 209e514b9..0864ee9c3 100644
--- a/community/communication.html
+++ b/upgrading/index.html
@@ -8,7 +8,7 @@
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
- <title>Communication — Apache DataFusion Ballista documentation</title>
+ <title>Upgrade Guides — Apache DataFusion Ballista documentation</title>
@@ -42,11 +42,12 @@
<script src="../_static/documentation_options.js?v=5929fcd5"></script>
<script src="../_static/doctools.js?v=fd6eb6e6"></script>
<script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
- <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+ <script>DOCUMENTATION_OPTIONS.pagename = 'upgrading/index';</script>
<script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
- <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+ <link rel="next" title="Upgrade Guides" href="54.0.0.html" />
+ <link rel="prev" title="Apache DataFusion Ballista 0.5.0 Changelog" href="../changelog/0.5.0.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<meta name="docsearch:version" content="" />
@@ -288,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="current reference internal" href="#">Upgrade Guides</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -296,8 +304,8 @@
<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
</ul>
@@ -342,7 +350,7 @@
<i class="fa-solid fa-home"></i>
</a>
</li>
- <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+ <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Upgrade Guides</span></li>
</ul>
</nav>
</div>
@@ -359,44 +367,13 @@
<div id="searchbox"></div>
<article class="bd-article">
- <!---
- Licensed to the Apache Software Foundation (ASF) under one
- or more contributor license agreements. See the NOTICE file
- distributed with this work for additional information
- regarding copyright ownership. The ASF licenses this file
- to you under the Apache License, Version 2.0 (the
- "License"); you may not use this file except in compliance
- with the License. You may obtain a copy of the License at
-
- http://www.apache.org/licenses/LICENSE-2.0
-
- Unless required by applicable law or agreed to in writing,
- software distributed under the License is distributed on an
- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- KIND, either express or implied. See the License for the
- specific language governing permissions and limitations
- under the License.
--->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+ <section id="upgrade-guides">
+<h1>Upgrade Guides<a class="headerlink" href="#upgrade-guides" title="Link to this heading">#</a></h1>
+<div class="toctree-wrapper compound">
+<ul>
+<li class="toctree-l1"><a class="reference internal" href="54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</div>
</section>
@@ -410,13 +387,22 @@ quick and small design discussions. For major design change proposals, we encour
<div class="prev-next-area">
<a class="left-prev"
- href="../contributors-guide/development.html"
+ href="../changelog/0.5.0.html"
title="previous page">
<i class="fa-solid fa-angle-left"></i>
<div class="prev-next-info">
<p class="prev-next-subtitle">previous</p>
- <p class="prev-next-title">Ballista Development</p>
+ <p class="prev-next-title">Apache DataFusion Ballista 0.5.0 Changelog</p>
+ </div>
+ </a>
+ <a class="right-next"
+ href="54.0.0.html"
+ title="next page">
+ <div class="prev-next-info">
+ <p class="prev-next-subtitle">next</p>
+ <p class="prev-next-title">Upgrade Guides</p>
</div>
+ <i class="fa-solid fa-angle-right"></i>
</a>
</div>
</footer>
@@ -430,22 +416,10 @@ quick and small design discussions. For major design change proposals, we encour
<div class="sidebar-secondary-item">
-<div
- id="pst-page-navigation-heading-2"
- class="page-toc tocsection onthispage">
- <i class="fa-solid fa-list"></i> On this page
- </div>
- <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
- <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
- </nav></div>
-
- <div class="sidebar-secondary-item">
<div class="tocsection editthispage">
- <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+ <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/upgrading/index.rst">
<i class="fa-solid fa-pencil"></i>
@@ -460,7 +434,7 @@ quick and small design discussions. For major design change proposals, we encour
<div class="sidebar-secondary-item">
<div class="tocsection sourcelink">
- <a href="../_sources/community/communication.md.txt">
+ <a href="../_sources/upgrading/index.rst.txt">
<i class="fa-solid fa-file-lines"></i> Show Source
</a>
</div>
diff --git a/user-guide/cli.html b/user-guide/cli.html
index 2e3a7b942..d5e881282 100644
--- a/user-guide/cli.html
+++ b/user-guide/cli.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/configs.html b/user-guide/configs.html
index 99f8b11ce..e32088daa 100644
--- a/user-guide/configs.html
+++ b/user-guide/configs.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/deployment/cargo-install.html b/user-guide/deployment/cargo-install.html
index 8536a6067..591debfa3 100644
--- a/user-guide/deployment/cargo-install.html
+++ b/user-guide/deployment/cargo-install.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/deployment/docker-compose.html b/user-guide/deployment/docker-compose.html
index 342fceff2..87ca1556a 100644
--- a/user-guide/deployment/docker-compose.html
+++ b/user-guide/deployment/docker-compose.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/deployment/docker.html b/user-guide/deployment/docker.html
index 2e669ee01..bd7aebbbc 100644
--- a/user-guide/deployment/docker.html
+++ b/user-guide/deployment/docker.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/deployment/index.html b/user-guide/deployment/index.html
index 29683cae0..66a2a891c 100644
--- a/user-guide/deployment/index.html
+++ b/user-guide/deployment/index.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/deployment/kubernetes.html b/user-guide/deployment/kubernetes.html
index e639e2a9b..a76cff6fb 100644
--- a/user-guide/deployment/kubernetes.html
+++ b/user-guide/deployment/kubernetes.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/deployment/quick-start.html b/user-guide/deployment/quick-start.html
index 36007aa9f..c79a7027f 100644
--- a/user-guide/deployment/quick-start.html
+++ b/user-guide/deployment/quick-start.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/extending-components.html b/user-guide/extending-components.html
index 93aaa949e..9655afdc9 100644
--- a/user-guide/extending-components.html
+++ b/user-guide/extending-components.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/extensions-example.html b/user-guide/extensions-example.html
index 07acbaac2..ebd5df7bb 100644
--- a/user-guide/extensions-example.html
+++ b/user-guide/extensions-example.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/faq.html b/user-guide/faq.html
index a77464552..ad9b811ee 100644
--- a/user-guide/faq.html
+++ b/user-guide/faq.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/introduction.html b/user-guide/introduction.html
index ed2449938..ffd16617a 100644
--- a/user-guide/introduction.html
+++ b/user-guide/introduction.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/metrics.html b/user-guide/metrics.html
index 532b18b97..aae28a63a 100644
--- a/user-guide/metrics.html
+++ b/user-guide/metrics.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/python/cloud-storage.html b/user-guide/python/cloud-storage.html
index 94649f926..694ccc1a0 100644
--- a/user-guide/python/cloud-storage.html
+++ b/user-guide/python/cloud-storage.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/python/index.html b/user-guide/python/index.html
index 2cd85bc65..69141dcbe 100644
--- a/user-guide/python/index.html
+++ b/user-guide/python/index.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/python/jupyter.html b/user-guide/python/jupyter.html
index a08962240..8bbc75fb9 100644
--- a/user-guide/python/jupyter.html
+++ b/user-guide/python/jupyter.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/python/quickstart.html b/user-guide/python/quickstart.html
index 97ab89714..eaeea5978 100644
--- a/user-guide/python/quickstart.html
+++ b/user-guide/python/quickstart.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/rust.html b/user-guide/rust.html
index ea56dddd2..2ec88ec90 100644
--- a/user-guide/rust.html
+++ b/user-guide/rust.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/scheduler.html b/user-guide/scheduler.html
index 9954a324a..73337df09 100644
--- a/user-guide/scheduler.html
+++ b/user-guide/scheduler.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/spark-compatible-functions.html b/user-guide/spark-compatible-functions.html
index 6b62786ea..5df620d1d 100644
--- a/user-guide/spark-compatible-functions.html
+++ b/user-guide/spark-compatible-functions.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
diff --git a/user-guide/tuning-guide.html b/user-guide/tuning-guide.html
index a5b0ecb44..1a07ab0a9 100644
--- a/user-guide/tuning-guide.html
+++ b/user-guide/tuning-guide.html
@@ -289,6 +289,13 @@
</ul>
</details></li>
</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Upgrade Guides</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../upgrading/index.html">Upgrade Guides</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../upgrading/54.0.0.html">Ballista 54.0.0</a></li>
+</ul>
+</details></li>
+</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org