You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/06/29 13:40:50 UTC

(datafusion-ballista) branch asf-site updated: Publish built docs triggered by 278c1ad09c128511d0c786156188020ad5d9ffd0

This is an automated email from the ASF dual-hosted git repository.

github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-ballista.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new dbf66b53a Publish built docs triggered by 278c1ad09c128511d0c786156188020ad5d9ffd0
dbf66b53a is described below

commit dbf66b53a6292ca7fcaeb062cad1bd558d8a9bb9
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Mon Jun 29 13:40:45 2026 +0000

    Publish built docs triggered by 278c1ad09c128511d0c786156188020ad5d9ffd0
---
 _sources/changelog/0.10.0.md.txt                   |  95 +++
 _sources/changelog/0.11.0.md.txt                   |  99 +++
 _sources/changelog/0.12.0.md.txt                   | 119 ++++
 _sources/changelog/0.5.0.md.txt                    | 174 +++++
 _sources/changelog/0.6.0.md.txt                    | 105 +++
 _sources/changelog/0.7.0.md.txt                    | 165 +++++
 _sources/changelog/0.8.0.md.txt                    |  64 ++
 _sources/changelog/0.9.0.md.txt                    | 184 ++++++
 _sources/changelog/43.0.0.md.txt                   | 146 +++++
 _sources/changelog/44.0.0.md.txt                   |  56 ++
 _sources/changelog/45.0.0.md.txt                   |  45 ++
 _sources/changelog/46.0.0.md.txt                   |  58 ++
 _sources/changelog/47.0.0.md.txt                   |  48 ++
 _sources/changelog/48.0.0.md.txt                   |  44 ++
 _sources/changelog/49.0.0.md.txt                   |  58 ++
 _sources/changelog/50.0.0.md.txt                   |  46 ++
 _sources/changelog/51.0.0.md.txt                   |  45 ++
 _sources/changelog/52.0.0.md.txt                   |  92 +++
 _sources/changelog/53.0.0.md.txt                   | 233 +++++++
 _sources/changelog/index.md.txt                    |  46 ++
 _sources/index.rst.txt                             |   6 +
 changelog/0.10.0.html                              | 555 ++++++++++++++++
 changelog/0.11.0.html                              | 559 ++++++++++++++++
 changelog/0.12.0.html                              | 579 +++++++++++++++++
 changelog/0.5.0.html                               | 633 +++++++++++++++++++
 changelog/0.6.0.html                               | 564 +++++++++++++++++
 changelog/0.7.0.html                               | 625 ++++++++++++++++++
 .../communication.html => changelog/0.8.0.html     | 169 +++--
 changelog/0.9.0.html                               | 644 +++++++++++++++++++
 changelog/43.0.0.html                              | 606 ++++++++++++++++++
 .../44.0.0.html                                    | 174 ++---
 .../communication.html => changelog/45.0.0.html    | 150 +++--
 .../communication.html => changelog/46.0.0.html    | 163 +++--
 .../47.0.0.html                                    | 170 +++--
 .../48.0.0.html                                    | 166 +++--
 .../communication.html => changelog/49.0.0.html    | 163 +++--
 .../communication.html => changelog/50.0.0.html    | 152 +++--
 .../communication.html => changelog/51.0.0.html    | 151 +++--
 .../development.html => changelog/52.0.0.html      | 299 ++++-----
 changelog/53.0.0.html                              | 703 +++++++++++++++++++++
 .../communication.html => changelog/index.html     | 147 +++--
 community/communication.html                       |  25 +
 contributors-guide/architecture.html               |  31 +-
 contributors-guide/code-organization.html          |  25 +
 contributors-guide/development.html                |  25 +
 genindex.html                                      |  25 +
 index.html                                         |  31 +
 objects.inv                                        | Bin 884 -> 1084 bytes
 search.html                                        |  25 +
 searchindex.js                                     |   2 +-
 user-guide/cli.html                                |  25 +
 user-guide/configs.html                            |  25 +
 user-guide/deployment/cargo-install.html           |  25 +
 user-guide/deployment/docker-compose.html          |  25 +
 user-guide/deployment/docker.html                  |  25 +
 user-guide/deployment/index.html                   |  25 +
 user-guide/deployment/kubernetes.html              |  25 +
 user-guide/deployment/quick-start.html             |  25 +
 user-guide/extending-components.html               |  25 +
 user-guide/extensions-example.html                 |  31 +-
 user-guide/faq.html                                |  25 +
 user-guide/introduction.html                       |  25 +
 user-guide/metrics.html                            |  25 +
 user-guide/python/cloud-storage.html               |  25 +
 user-guide/python/index.html                       |  25 +
 user-guide/python/jupyter.html                     |  25 +
 user-guide/python/quickstart.html                  |  25 +
 user-guide/rust.html                               |  25 +
 user-guide/scheduler.html                          |  25 +
 user-guide/spark-compatible-functions.html         |  25 +
 user-guide/tuning-guide.html                       |  25 +
 71 files changed, 9170 insertions(+), 850 deletions(-)

diff --git a/_sources/changelog/0.10.0.md.txt b/_sources/changelog/0.10.0.md.txt
new file mode 100644
index 000000000..2984a207b
--- /dev/null
+++ b/_sources/changelog/0.10.0.md.txt
@@ -0,0 +1,95 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.10.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/0.9.0...0.10.0)
+
+**Implemented enhancements:**
+
+- Add user guide section on prometheus metrics [\#507](https://github.com/apache/datafusion-ballista/issues/507)
+- Don't throw error when job path not exist in remove_job_data [\#502](https://github.com/apache/datafusion-ballista/issues/502)
+- Fix clippy warning [\#494](https://github.com/apache/datafusion-ballista/issues/494)
+- Use job_data_clean_up_interval_seconds == 0 to indicate executor_cleanup_enable [\#488](https://github.com/apache/datafusion-ballista/issues/488)
+- Add a config for tracing log rolling policy for both scheduler and executor [\#486](https://github.com/apache/datafusion-ballista/issues/486)
+- Set up repo where we can push benchmark results [\#473](https://github.com/apache/datafusion-ballista/issues/473)
+- Make the delayed time interval for cleanup job data in both scheduler and executor configurable [\#469](https://github.com/apache/datafusion-ballista/issues/469)
+- Add some validation for the remove_job_data grpc service [\#467](https://github.com/apache/datafusion-ballista/issues/467)
+- Add ability to build docker images using `release-lto` profile [\#463](https://github.com/apache/datafusion-ballista/issues/463)
+- Suggest users download \(rather than build\) the FlightSQL JDBC Driver [\#460](https://github.com/apache/datafusion-ballista/issues/460)
+- Clean up legacy job shuffle data [\#459](https://github.com/apache/datafusion-ballista/issues/459)
+- Add grpc service for the scheduler to make it able to be triggered by client explicitly [\#458](https://github.com/apache/datafusion-ballista/issues/458)
+- Replace Mutex\<HashMap\> by using DashMap [\#448](https://github.com/apache/datafusion-ballista/issues/448)
+- Refine log level [\#446](https://github.com/apache/datafusion-ballista/issues/446)
+- Upgrade to DataFusion 14.0.0 [\#445](https://github.com/apache/datafusion-ballista/issues/445)
+- Add a feature for hdfs3 [\#419](https://github.com/apache/datafusion-ballista/issues/419)
+- Add optional flag which advertises host for Arrow Flight SQL [\#418](https://github.com/apache/datafusion-ballista/issues/418)
+- Partitioning reasoning in DataFusion and Ballista [\#284](https://github.com/apache/datafusion-ballista/issues/284)
+- Stop wasting time in CI on MIRI runs [\#283](https://github.com/apache/datafusion-ballista/issues/283)
+- Publish Docker images as part of each release [\#236](https://github.com/apache/datafusion-ballista/issues/236)
+- Cleanup job/stage status from TaskManager and clean up shuffle data after a period after JobFinished [\#185](https://github.com/apache/datafusion-ballista/issues/185)
+
+**Fixed bugs:**
+
+- build broken: configure_me_codegen retroactively reserved `bind_host` [\#519](https://github.com/apache/datafusion-ballista/issues/519)
+- Return empty results for SQLs with order by [\#451](https://github.com/apache/datafusion-ballista/issues/451)
+- ballista scheduler is not taken inline parameters into account [\#443](https://github.com/apache/datafusion-ballista/issues/443)
+- \[FlightSQL\] Cannot connect with Tableau Desktop [\#428](https://github.com/apache/datafusion-ballista/issues/428)
+- Benchmark q15 fails [\#372](https://github.com/apache/datafusion-ballista/issues/372)
+- Incorrect documentation for building Ballista on Linux when using docker-compose [\#362](https://github.com/apache/datafusion-ballista/issues/362)
+- Scheduler silently replaces `ParquetExec` with `EmptyExec` if data path is not correctly mounted in container [\#353](https://github.com/apache/datafusion-ballista/issues/353)
+- SQL with order by limit returns nothing [\#334](https://github.com/apache/datafusion-ballista/issues/334)
+
+**Documentation updates:**
+
+- README updates [\#433](https://github.com/apache/datafusion-ballista/pull/433) ([andygrove](https://github.com/andygrove))
+
+**Merged pull requests:**
+
+- configure_me_codegen retroactively reserved on our `bind_host` parame… [\#520](https://github.com/apache/datafusion-ballista/pull/520) ([avantgardnerio](https://github.com/avantgardnerio))
+- Bump actions/cache from 2 to 3 [\#517](https://github.com/apache/datafusion-ballista/pull/517) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Update graphviz-rust requirement from 0.3.0 to 0.4.0 [\#515](https://github.com/apache/datafusion-ballista/pull/515) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Add Prometheus metrics endpoint [\#511](https://github.com/apache/datafusion-ballista/pull/511) ([thinkharderdev](https://github.com/thinkharderdev))
+- Enable tests that work since upgrading to DataFusion 14 [\#510](https://github.com/apache/datafusion-ballista/pull/510) ([andygrove](https://github.com/andygrove))
+- Update hashbrown requirement from 0.12 to 0.13 [\#506](https://github.com/apache/datafusion-ballista/pull/506) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Don't throw error when job shuffle data path not exist in executor [\#503](https://github.com/apache/datafusion-ballista/pull/503) ([yahoNanJing](https://github.com/yahoNanJing))
+- Upgrade to DataFusion 14.0.0 and Arrow 26.0.0 [\#499](https://github.com/apache/datafusion-ballista/pull/499) ([andygrove](https://github.com/andygrove))
+- Fix clippy warning [\#495](https://github.com/apache/datafusion-ballista/pull/495) ([yahoNanJing](https://github.com/yahoNanJing))
+- Stop wasting time in CI on MIRI runs [\#491](https://github.com/apache/datafusion-ballista/pull/491) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Remove executor config executor_cleanup_enable and make the configuation name for executor cleanup more intuitive [\#489](https://github.com/apache/datafusion-ballista/pull/489) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add a config for tracing log rolling policy for both scheduler and executor [\#487](https://github.com/apache/datafusion-ballista/pull/487) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add grpc service of cleaning up job shuffle data for the scheduler to make it able to be triggered by client explicitly [\#485](https://github.com/apache/datafusion-ballista/pull/485) ([yahoNanJing](https://github.com/yahoNanJing))
+- \[Minor\] Bump DataFusion [\#480](https://github.com/apache/datafusion-ballista/pull/480) ([Dandandan](https://github.com/Dandandan))
+- Remove benchmark results from README [\#478](https://github.com/apache/datafusion-ballista/pull/478) ([andygrove](https://github.com/andygrove))
+- Update `flightsql.md` to provide correct instruction [\#476](https://github.com/apache/datafusion-ballista/pull/476) ([iajoiner](https://github.com/iajoiner))
+- Add support for Tableau [\#475](https://github.com/apache/datafusion-ballista/pull/475) ([avantgardnerio](https://github.com/avantgardnerio))
+- Add SchedulerConfig for the scheduler configurations, like event_loop_buffer_size, finished_job_data_clean_up_interval_seconds, finished_job_state_clean_up_interval_seconds [\#472](https://github.com/apache/datafusion-ballista/pull/472) ([yahoNanJing](https://github.com/yahoNanJing))
+- Bump DataFusion [\#471](https://github.com/apache/datafusion-ballista/pull/471) ([Dandandan](https://github.com/Dandandan))
+- Add some validation for remove_job_data in the executor server [\#468](https://github.com/apache/datafusion-ballista/pull/468) ([yahoNanJing](https://github.com/yahoNanJing))
+- Update documentation to reflect the release of the FlightSQL JDBC Driver [\#461](https://github.com/apache/datafusion-ballista/pull/461) ([avantgardnerio](https://github.com/avantgardnerio))
+- Bump DataFusion version [\#453](https://github.com/apache/datafusion-ballista/pull/453) ([andygrove](https://github.com/andygrove))
+- Add shuffle for SortPreservingMergeExec physical operator [\#452](https://github.com/apache/datafusion-ballista/pull/452) ([yahoNanJing](https://github.com/yahoNanJing))
+- Replace Mutex\<HashMap\> by using DashMap [\#449](https://github.com/apache/datafusion-ballista/pull/449) ([yahoNanJing](https://github.com/yahoNanJing))
+- Refine log level for trial info and periodically invoked places [\#447](https://github.com/apache/datafusion-ballista/pull/447) ([yahoNanJing](https://github.com/yahoNanJing))
+- MINOR: Add `set -e` to scripts, fix a typo [\#444](https://github.com/apache/datafusion-ballista/pull/444) ([andygrove](https://github.com/andygrove))
+- Add optional flag which advertises host for Arrow Flight SQL \#418 [\#442](https://github.com/apache/datafusion-ballista/pull/442) ([DaltonModlin](https://github.com/DaltonModlin))
+- Reorder joins after resolving stage inputs [\#441](https://github.com/apache/datafusion-ballista/pull/441) ([Dandandan](https://github.com/Dandandan))
+- Add a feature for hdfs3 [\#439](https://github.com/apache/datafusion-ballista/pull/439) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add Spark benchmarks [\#438](https://github.com/apache/datafusion-ballista/pull/438) ([andygrove](https://github.com/andygrove))
+- scheduler now verifies that `file://` ListingTable URLs are accessible [\#414](https://github.com/apache/datafusion-ballista/pull/414) ([andygrove](https://github.com/andygrove))
diff --git a/_sources/changelog/0.11.0.md.txt b/_sources/changelog/0.11.0.md.txt
new file mode 100644
index 000000000..7dc454b04
--- /dev/null
+++ b/_sources/changelog/0.11.0.md.txt
@@ -0,0 +1,99 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.11.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/0.10.0...0.11.0)
+
+**Implemented enhancements:**
+
+- Remove `python` since it has been moved to its own repo, `datafusion-ballista-python` [\#653](https://github.com/apache/datafusion-ballista/issues/653)
+- Add executor self-registration mechanism in the heartbeat service [\#648](https://github.com/apache/datafusion-ballista/issues/648)
+- Upgrade to DataFusion 17 [\#638](https://github.com/apache/datafusion-ballista/issues/638)
+- Move Python bindings to separate repo? [\#635](https://github.com/apache/datafusion-ballista/issues/635)
+- Implement new release process [\#622](https://github.com/apache/datafusion-ballista/issues/622)
+- Change default branch name from master to main [\#618](https://github.com/apache/datafusion-ballista/issues/618)
+- Update latest datafusion dependency [\#610](https://github.com/apache/datafusion-ballista/issues/610)
+- Implement optimizer rule to remove redundant repartitioning [\#608](https://github.com/apache/datafusion-ballista/issues/608)
+- ballista-cli as \(docker\) images [\#600](https://github.com/apache/datafusion-ballista/issues/600)
+- Update contributor guide [\#598](https://github.com/apache/datafusion-ballista/issues/598)
+- Fix cargo clippy [\#570](https://github.com/apache/datafusion-ballista/issues/570)
+- Support Alibaba Cloud OSS with ObjectStore [\#566](https://github.com/apache/datafusion-ballista/issues/566)
+- Refactor `StateBackendClient` to be a higher-level interface [\#554](https://github.com/apache/datafusion-ballista/issues/554)
+- Make it concurrently to launch tasks to executors [\#544](https://github.com/apache/datafusion-ballista/issues/544)
+- Simplify docs [\#531](https://github.com/apache/datafusion-ballista/issues/531)
+- Provide an in-memory StateBackend [\#505](https://github.com/apache/datafusion-ballista/issues/505)
+- Add support for Azure blob storage [\#294](https://github.com/apache/datafusion-ballista/issues/294)
+- Add a workflow to build the image and publish it to the package [\#71](https://github.com/apache/datafusion-ballista/issues/71)
+
+**Fixed bugs:**
+
+- Rust / Check Cargo.toml formatting \(amd64, stable\) \(pull_request\) Failing [\#662](https://github.com/apache/datafusion-ballista/issues/662)
+- Protobuf parsing error [\#646](https://github.com/apache/datafusion-ballista/issues/646)
+- jobs from python client not showing up in Scheduler UI [\#625](https://github.com/apache/datafusion-ballista/issues/625)
+- ballista ui fails to build [\#594](https://github.com/apache/datafusion-ballista/issues/594)
+- cargo build --release fails for ballista-scheduler [\#590](https://github.com/apache/datafusion-ballista/issues/590)
+- docker build fails [\#589](https://github.com/apache/datafusion-ballista/issues/589)
+- Multi-scheduler Job Starvation [\#585](https://github.com/apache/datafusion-ballista/issues/585)
+- Cannot query file from S3 [\#559](https://github.com/apache/datafusion-ballista/issues/559)
+- Benchmark q16 fails [\#373](https://github.com/apache/datafusion-ballista/issues/373)
+
+**Documentation updates:**
+
+- Check in benchmark image [\#647](https://github.com/apache/datafusion-ballista/pull/647) ([andygrove](https://github.com/andygrove))
+- MINOR: Fix benchmark image link [\#596](https://github.com/apache/datafusion-ballista/pull/596) ([andygrove](https://github.com/andygrove))
+
+**Merged pull requests:**
+
+- Upgrade to DataFusion 18 [\#668](https://github.com/apache/datafusion-ballista/pull/668) ([andygrove](https://github.com/andygrove))
+- Enable physical plan round-trip tests [\#666](https://github.com/apache/datafusion-ballista/pull/666) ([andygrove](https://github.com/andygrove))
+- Upgrade to DataFusion 18.0.0-rc1 [\#664](https://github.com/apache/datafusion-ballista/pull/664) ([andygrove](https://github.com/andygrove))
+- add test_util to make examples work well [\#661](https://github.com/apache/datafusion-ballista/pull/661) ([jiangzhx](https://github.com/jiangzhx))
+- Minor refactor to reduce duplicate code [\#659](https://github.com/apache/datafusion-ballista/pull/659) ([andygrove](https://github.com/andygrove))
+- Cluster state refactor Part 2 [\#658](https://github.com/apache/datafusion-ballista/pull/658) ([thinkharderdev](https://github.com/thinkharderdev))
+- Remove `python` dir & python-related workflows [\#654](https://github.com/apache/datafusion-ballista/pull/654) ([iajoiner](https://github.com/iajoiner))
+- Add executor self-registration mechanism in the heartbeat service [\#649](https://github.com/apache/datafusion-ballista/pull/649) ([yahoNanJing](https://github.com/yahoNanJing))
+- Upgrade to DataFusion 17 [\#639](https://github.com/apache/datafusion-ballista/pull/639) ([avantgardnerio](https://github.com/avantgardnerio))
+- Upgrade to DataFusion 16 \(again\) [\#636](https://github.com/apache/datafusion-ballista/pull/636) ([avantgardnerio](https://github.com/avantgardnerio))
+- Update release process documentation [\#632](https://github.com/apache/datafusion-ballista/pull/632) ([andygrove](https://github.com/andygrove))
+- Implement new release process [\#623](https://github.com/apache/datafusion-ballista/pull/623) ([andygrove](https://github.com/andygrove))
+- Update contributor guide [\#617](https://github.com/apache/datafusion-ballista/pull/617) ([andygrove](https://github.com/andygrove))
+- Fix Cargo.toml format issue [\#616](https://github.com/apache/datafusion-ballista/pull/616) ([andygrove](https://github.com/andygrove))
+- Refactor scheduler main [\#615](https://github.com/apache/datafusion-ballista/pull/615) ([andygrove](https://github.com/andygrove))
+- Refactor executor main [\#614](https://github.com/apache/datafusion-ballista/pull/614) ([andygrove](https://github.com/andygrove))
+- Update datafusion dependency to the latest version [\#612](https://github.com/apache/datafusion-ballista/pull/612) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add support for Azure Blob Storage [\#599](https://github.com/apache/datafusion-ballista/pull/599) ([aidankovacic-8451](https://github.com/aidankovacic-8451))
+- Python: add method to get explain output as a string [\#593](https://github.com/apache/datafusion-ballista/pull/593) ([andygrove](https://github.com/andygrove))
+- Handle job resubmission [\#586](https://github.com/apache/datafusion-ballista/pull/586) ([thinkharderdev](https://github.com/thinkharderdev))
+- updated readme to contain correct versions of dependencies. [\#580](https://github.com/apache/datafusion-ballista/pull/580) ([saikrishna1-bidgely](https://github.com/saikrishna1-bidgely))
+- Update graphviz-rust requirement from 0.4.0 to 0.5.0 [\#574](https://github.com/apache/datafusion-ballista/pull/574) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Super minor spelling error [\#573](https://github.com/apache/datafusion-ballista/pull/573) ([jdye64](https://github.com/jdye64))
+- Fix cargo clippy [\#571](https://github.com/apache/datafusion-ballista/pull/571) ([yahoNanJing](https://github.com/yahoNanJing))
+- Support Alibaba Cloud OSS with ObjectStore [\#567](https://github.com/apache/datafusion-ballista/pull/567) ([r4ntix](https://github.com/r4ntix))
+- fix\(ui\): fix last seen [\#562](https://github.com/apache/datafusion-ballista/pull/562) ([duyet](https://github.com/duyet))
+- Cluster state refactor part 1 [\#560](https://github.com/apache/datafusion-ballista/pull/560) ([thinkharderdev](https://github.com/thinkharderdev))
+- Make it concurrently to launch tasks to executors [\#557](https://github.com/apache/datafusion-ballista/pull/557) ([yahoNanJing](https://github.com/yahoNanJing))
+- Update datafusion requirement from 14.0.0 to 15.0.0 [\#552](https://github.com/apache/datafusion-ballista/pull/552) ([yahoNanJing](https://github.com/yahoNanJing))
+- docs: fix style in the Helm readme [\#551](https://github.com/apache/datafusion-ballista/pull/551) ([haoxins](https://github.com/haoxins))
+- Fix Helm chart's image format [\#550](https://github.com/apache/datafusion-ballista/pull/550) ([haoxins](https://github.com/haoxins))
+- Update env_logger requirement from 0.9 to 0.10 [\#539](https://github.com/apache/datafusion-ballista/pull/539) ([dependabot[bot]](https://github.com/apps/dependabot))
+- only build docker images on rc tags [\#535](https://github.com/apache/datafusion-ballista/pull/535) ([andygrove](https://github.com/andygrove))
+- Remove `--locked` when building Python wheels [\#533](https://github.com/apache/datafusion-ballista/pull/533) ([andygrove](https://github.com/andygrove))
+- Bump actions/labeler from 4.0.2 to 4.1.0 [\#525](https://github.com/apache/datafusion-ballista/pull/525) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Provide a memory StateBackendClient [\#523](https://github.com/apache/datafusion-ballista/pull/523) ([yahoNanJing](https://github.com/yahoNanJing))
diff --git a/_sources/changelog/0.12.0.md.txt b/_sources/changelog/0.12.0.md.txt
new file mode 100644
index 000000000..8c271e04d
--- /dev/null
+++ b/_sources/changelog/0.12.0.md.txt
@@ -0,0 +1,119 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.12.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/0.11.0...0.12.0)
+
+**Documentation updates:**
+
+- docs: fix link [#799](https://github.com/apache/datafusion-ballista/pull/799) (haoxins)
+
+**Merged pull requests:**
+
+- [minor] remove outdate todo [#683](https://github.com/apache/datafusion-ballista/pull/683) (Ted-Jiang)
+- Add executor terminating status for graceful shutdown [#667](https://github.com/apache/datafusion-ballista/pull/667) (thinkharderdev)
+- Allow `BallistaContext::read_*` methods to read multiple paths. [#679](https://github.com/apache/datafusion-ballista/pull/679) (luckylsk34)
+- Update scheduler.md [#657](https://github.com/apache/datafusion-ballista/pull/657) (psvri)
+- Mark `SchedulerState` as pub [#688](https://github.com/apache/datafusion-ballista/pull/688) (Dandandan)
+- Update graphviz-rust requirement from 0.5.0 to 0.6.1 [#651](https://github.com/apache/datafusion-ballista/pull/651) (dependabot[bot])
+- Upgrade DataFusion to 19.0.0 [#691](https://github.com/apache/datafusion-ballista/pull/691) (r4ntix)
+- Update release docs [#692](https://github.com/apache/datafusion-ballista/pull/692) (andygrove)
+- Mark `SchedulerServer::with_task_launcher` as pub [#695](https://github.com/apache/datafusion-ballista/pull/695) (Dandandan)
+- Make task_manager pub [#698](https://github.com/apache/datafusion-ballista/pull/698) (Dandandan)
+- Add ExecutionEngine abstraction [#687](https://github.com/apache/datafusion-ballista/pull/687) (andygrove)
+- Allow accessing s3 locations in client mode [#700](https://github.com/apache/datafusion-ballista/pull/700) (luckylsk34)
+- git clone branch incorrect [#699](https://github.com/apache/datafusion-ballista/pull/699) (BubbaJoe)
+- Fix for error message during testing [#707](https://github.com/apache/datafusion-ballista/pull/707) (yahoNanJing)
+- Upgrade datafusion to 20.0.0 & sqlparser to to 0.32.0 [#711](https://github.com/apache/datafusion-ballista/pull/711) (r4ntix)
+- Update README.md [#729](https://github.com/apache/datafusion-ballista/pull/729) (jiangzhx)
+- Update link to scheduler proto file in dev docs [#713](https://github.com/apache/datafusion-ballista/pull/713) (JAicewizard)
+- Fix `show tables` fails [#715](https://github.com/apache/datafusion-ballista/pull/715) (r4ntix)
+- Remove redundant fields in ExecutorManager [#728](https://github.com/apache/datafusion-ballista/pull/728) (yahoNanJing)
+- Fix parameter '--config-backend' to '--cluster-backend' [#720](https://github.com/apache/datafusion-ballista/pull/720) (paolorechia)
+- Upgrade DataFusion to 21.0.0 [#727](https://github.com/apache/datafusion-ballista/pull/727) (r4ntix)
+- [minor] remove useless brackets [#739](https://github.com/apache/datafusion-ballista/pull/739) (Ted-Jiang)
+- Only decode plan in `LaunchMultiTaskParams` once [#743](https://github.com/apache/datafusion-ballista/pull/743) (Dandandan)
+- Upgrade DataFusion to 22.0.0 [#740](https://github.com/apache/datafusion-ballista/pull/740) (r4ntix)
+- [feature] support shuffle read with retry when facing IO error. [#738](https://github.com/apache/datafusion-ballista/pull/738) (Ted-Jiang)
+- [log] Print long running task status. [#750](https://github.com/apache/datafusion-ballista/pull/750) (Ted-Jiang)
+- Upgrade DataFusion to 23.0.0 [#755](https://github.com/apache/datafusion-ballista/pull/755) (yahoNanJing)
+- Fix plan metrics length and stage metrics length not match [#764](https://github.com/apache/datafusion-ballista/pull/764) (yahoNanJing)
+- added match arms to create ClusterStorageConfig [#766](https://github.com/apache/datafusion-ballista/pull/766) (BokarevNik)
+- [Improve] refactor the offer_reservation avoid wait result [#760](https://github.com/apache/datafusion-ballista/pull/760) (Ted-Jiang)
+- [fea] Avoid multithreaded write lock conflicts in event queue. [#754](https://github.com/apache/datafusion-ballista/pull/754) (Ted-Jiang)
+- Upgrade DataFusion to 24.0.0, Object_Store to 0.5.6 [#769](https://github.com/apache/datafusion-ballista/pull/769) (r4ntix)
+- Refine create_datafusion_context() [#778](https://github.com/apache/datafusion-ballista/pull/778) (yahoNanJing)
+- Remove output_partitioning for task definition [#776](https://github.com/apache/datafusion-ballista/pull/776) (yahoNanJing)
+- Upgrade DataFusion to 25.0.0 [#779](https://github.com/apache/datafusion-ballista/pull/779) (r4ntix)
+- Disable the ansi feature of tracing-subscriber [#784](https://github.com/apache/datafusion-ballista/pull/784) (yahoNanJing)
+- Add config grpc_server_max_decoding_message_size to make the maximum size of a decoded message at the grpc server side configurable [#782](https://github.com/apache/datafusion-ballista/pull/782) (yahoNanJing)
+- Fix nodejs issues in Docker build [#731](https://github.com/apache/datafusion-ballista/pull/731) (jnaous)
+- Upgrade node version to fix build in `main` [#794](https://github.com/apache/datafusion-ballista/pull/794) (avantgardnerio)
+- Remove redundant mod session_registry [#792](https://github.com/apache/datafusion-ballista/pull/792) (yahoNanJing)
+- Make last_seen_ts_threshold for getting alive executor at the scheduler side larger than the heartbeat time interval [#786](https://github.com/apache/datafusion-ballista/pull/786) (yahoNanJing)
+- Remove the prometheus-metrics from the default feature [#788](https://github.com/apache/datafusion-ballista/pull/788) (yahoNanJing)
+- Refine the ExecuteQuery grpc interface [#790](https://github.com/apache/datafusion-ballista/pull/790) (yahoNanJing)
+- Add config to collect statistics, enable in TPC-H benchmark [#796](https://github.com/apache/datafusion-ballista/pull/796) (Dandandan)
+- Add support for GCS data sources [#805](https://github.com/apache/datafusion-ballista/pull/805) (haoxins)
+- Update DataFusion to 26 [#798](https://github.com/apache/datafusion-ballista/pull/798) (Dandandan)
+- Issue 162 build docker image in ci [#716](https://github.com/apache/datafusion-ballista/pull/716) (paolorechia)
+- Fix index out of bounds panic [#819](https://github.com/apache/datafusion-ballista/pull/819) (yahoNanJing)
+- Refactor the TaskDefinition by changing encoding execution plan to the decoded one [#817](https://github.com/apache/datafusion-ballista/pull/817) (yahoNanJing)
+- Fix ballista-cli docs [#800](https://github.com/apache/datafusion-ballista/pull/800) (jonahgao)
+- docs: fix link [#799](https://github.com/apache/datafusion-ballista/pull/799) (haoxins)
+- Implement the with_new_children for ShuffleReaderExec [#821](https://github.com/apache/datafusion-ballista/pull/821) (yahoNanJing)
+- Update to point to the correct documentation [#838](https://github.com/apache/datafusion-ballista/pull/838) (dadepo)
+- Remove ExecutorReservation and change the task assignment philosophy from executor first to task first [#823](https://github.com/apache/datafusion-ballista/pull/823) (yahoNanJing)
+- Upgrade DataFusion to 27.0.0 [#834](https://github.com/apache/datafusion-ballista/pull/834) (r4ntix)
+- Reduce the number of calls to `create_logical_plan` [#842](https://github.com/apache/datafusion-ballista/pull/842) (jonahgao)
+- Bump semver from 5.7.1 to 5.7.2 in /ballista/scheduler/ui [#843](https://github.com/apache/datafusion-ballista/pull/843) (dependabot[bot])
+- Bump actions/labeler from 4.1.0 to 4.3.0 [#841](https://github.com/apache/datafusion-ballista/pull/841) (dependabot[bot])
+- Bump tough-cookie from 4.1.2 to 4.1.3 in /ballista/scheduler/ui [#840](https://github.com/apache/datafusion-ballista/pull/840) (dependabot[bot])
+- Update flatbuffers requirement from 22.9.29 to 23.5.26 [#801](https://github.com/apache/datafusion-ballista/pull/801) (dependabot[bot])
+- Update dirs requirement from 4.0.0 to 5.0.1 [#767](https://github.com/apache/datafusion-ballista/pull/767) (dependabot[bot])
+- Update libloading requirement from 0.7.3 to 0.8.0 [#761](https://github.com/apache/datafusion-ballista/pull/761) (dependabot[bot])
+- Introduce a cache crate supporting concurrent cache value loading [#825](https://github.com/apache/datafusion-ballista/pull/825) (yahoNanJing)
+- Fix cargo clippy for latest rust version [#848](https://github.com/apache/datafusion-ballista/pull/848) (yahoNanJing)
+- Introduce CachedBasedObjectStoreRegistry to use data source cache transparently [#827](https://github.com/apache/datafusion-ballista/pull/827) (yahoNanJing)
+- Add ConsistentHash for node topology management [#830](https://github.com/apache/datafusion-ballista/pull/830) (yahoNanJing)
+- Implement 3-phase consistent hash based task assignment policy [#833](https://github.com/apache/datafusion-ballista/pull/833) (yahoNanJing)
+- Update tonic requirement from 0.8 to 0.9 [#733](https://github.com/apache/datafusion-ballista/pull/733) (dependabot[bot])
+- Update itertools requirement from 0.10 to 0.11 [#844](https://github.com/apache/datafusion-ballista/pull/844) (dependabot[bot])
+- Update etcd-client requirement from 0.10 to 0.11 [#845](https://github.com/apache/datafusion-ballista/pull/845) (dependabot[bot])
+- Update hashbrown requirement from 0.13 to 0.14 [#846](https://github.com/apache/datafusion-ballista/pull/846) (dependabot[bot])
+- Bump word-wrap from 1.2.3 to 1.2.4 in /ballista/scheduler/ui [#849](https://github.com/apache/datafusion-ballista/pull/849) (dependabot[bot])
+- Update hdfs requirement from 0.1.1 to 0.1.4 [#856](https://github.com/apache/datafusion-ballista/pull/856) (yahoNanJing)
+- Update to DataFusion 28 [#858](https://github.com/apache/datafusion-ballista/pull/858) (Dandandan)
+- Upgrade datafusion to 30.0.0 [#866](https://github.com/apache/datafusion-ballista/pull/866) (r4ntix)
+- refactor: port get_scan_files to Ballista [#877](https://github.com/apache/datafusion-ballista/pull/877) (alamb)
+- Upgrade datafusion to 31.0.0 [#878](https://github.com/apache/datafusion-ballista/pull/878) (r4ntix)
+- Upgrade datafusion to 32.0.0 [#899](https://github.com/apache/datafusion-ballista/pull/899) (r4ntix)
+- Update to DataFusion 33 [#900](https://github.com/apache/datafusion-ballista/pull/900) (Dandandan)
+- Refactor lru mod, remove linked_hash_map [#918](https://github.com/apache/datafusion-ballista/pull/918) (PsiACE)
+- Dynamically optimize aggregate (count) based on shuffle stats [#919](https://github.com/apache/datafusion-ballista/pull/919) (Dandandan)
+- Use lz4 compression for shuffle files & flight stream, refactoring / improvements [#920](https://github.com/apache/datafusion-ballista/pull/920) (Dandandan)
+- Make max encoding message size configurable [#928](https://github.com/apache/datafusion-ballista/pull/928) (andygrove)
+- Set max message size to 16MB in gRPC clients [#931](https://github.com/apache/datafusion-ballista/pull/931) (andygrove)
+- Upgrade to DataFusion 34.0.0-rc1 [#927](https://github.com/apache/datafusion-ballista/pull/927) (andygrove)
+- Use official DF 34 release [#939](https://github.com/apache/datafusion-ballista/pull/939) (andygrove)
+- Use StreamWriter instead of FileWriter [#943](https://github.com/apache/datafusion-ballista/pull/943) (avantgardnerio)
+- Remove some TODO comments related to context fetching schemas from scheduler [#946](https://github.com/apache/datafusion-ballista/pull/946) (andygrove)
+- Fix Docker build [#947](https://github.com/apache/datafusion-ballista/pull/947) (andygrove)
+- Fix regression in DataFrame.write_xxx [#945](https://github.com/apache/datafusion-ballista/pull/945) (andygrove)
diff --git a/_sources/changelog/0.5.0.md.txt b/_sources/changelog/0.5.0.md.txt
new file mode 100644
index 000000000..38d0355da
--- /dev/null
+++ b/_sources/changelog/0.5.0.md.txt
@@ -0,0 +1,174 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.5.0 Changelog
+
+[Full Changelog](https://github.com/apache/arrow-datafusion/compare/4.0.0...ballista-0.5.0)
+
+**Breaking changes:**
+
+- \[ballista\] support date_part and date_turnc ser/de, pass tpch 7 [\#840](https://github.com/apache/arrow-datafusion/pull/840) ([houqp](https://github.com/houqp))
+- Box ScalarValue:Lists, reduce size by half size [\#788](https://github.com/apache/arrow-datafusion/pull/788) ([alamb](https://github.com/alamb))
+- Support DataFrame.collect for Ballista DataFrames [\#785](https://github.com/apache/arrow-datafusion/pull/785) ([andygrove](https://github.com/andygrove))
+- JOIN conditions are order dependent [\#778](https://github.com/apache/arrow-datafusion/pull/778) ([seddonm1](https://github.com/seddonm1))
+- UnresolvedShuffleExec should represent a single shuffle [\#727](https://github.com/apache/arrow-datafusion/pull/727) ([andygrove](https://github.com/andygrove))
+- Ballista: Make shuffle partitions configurable in benchmarks [\#702](https://github.com/apache/arrow-datafusion/pull/702) ([andygrove](https://github.com/andygrove))
+- Rename MergeExec to CoalescePartitionsExec [\#635](https://github.com/apache/arrow-datafusion/pull/635) ([andygrove](https://github.com/andygrove))
+- Ballista: Rename QueryStageExec to ShuffleWriterExec [\#633](https://github.com/apache/arrow-datafusion/pull/633) ([andygrove](https://github.com/andygrove))
+- fix 593, reduce cloning by taking ownership in logical planner's `from` fn [\#610](https://github.com/apache/arrow-datafusion/pull/610) ([Jimexist](https://github.com/Jimexist))
+- fix join column handling logic for `On` and `Using` constraints [\#605](https://github.com/apache/arrow-datafusion/pull/605) ([houqp](https://github.com/houqp))
+- Move ballista standalone mode to client [\#589](https://github.com/apache/arrow-datafusion/pull/589) ([edrevo](https://github.com/edrevo))
+- Ballista: Implement map-side shuffle [\#543](https://github.com/apache/arrow-datafusion/pull/543) ([andygrove](https://github.com/andygrove))
+- ShuffleReaderExec now supports multiple locations per partition [\#541](https://github.com/apache/arrow-datafusion/pull/541) ([andygrove](https://github.com/andygrove))
+- Make external hostname in executor optional [\#232](https://github.com/apache/arrow-datafusion/pull/232) ([edrevo](https://github.com/edrevo))
+- Remove namespace from executors [\#75](https://github.com/apache/arrow-datafusion/pull/75) ([edrevo](https://github.com/edrevo))
+- Support qualified columns in queries [\#55](https://github.com/apache/arrow-datafusion/pull/55) ([houqp](https://github.com/houqp))
+- Read CSV format text from stdin or memory [\#54](https://github.com/apache/arrow-datafusion/pull/54) ([heymind](https://github.com/heymind))
+- Remove Ballista DataFrame [\#48](https://github.com/apache/arrow-datafusion/pull/48) ([andygrove](https://github.com/andygrove))
+- Use atomics for SQLMetric implementation, remove unused name field [\#25](https://github.com/apache/arrow-datafusion/pull/25) ([returnString](https://github.com/returnString))
+
+**Implemented enhancements:**
+
+- Add crate documentation for Ballista crates [\#830](https://github.com/apache/arrow-datafusion/issues/830)
+- Support DataFrame.collect for Ballista DataFrames [\#787](https://github.com/apache/arrow-datafusion/issues/787)
+- Ballista: Prep for supporting shuffle correctly, part one [\#736](https://github.com/apache/arrow-datafusion/issues/736)
+- Ballista: Implement physical plan serde for ShuffleWriterExec [\#710](https://github.com/apache/arrow-datafusion/issues/710)
+- Ballista: Finish implementing shuffle mechanism [\#707](https://github.com/apache/arrow-datafusion/issues/707)
+- Rename QueryStageExec to ShuffleWriterExec [\#542](https://github.com/apache/arrow-datafusion/issues/542)
+- Ballista ShuffleReaderExec should be able to read from multiple locations per partition [\#540](https://github.com/apache/arrow-datafusion/issues/540)
+- \[Ballista\] Use deployments in k8s user guide [\#473](https://github.com/apache/arrow-datafusion/issues/473)
+- Ballista refactor QueryStageExec in preparation for map-side shuffle [\#458](https://github.com/apache/arrow-datafusion/issues/458)
+- Ballista: Implement map-side of shuffle [\#456](https://github.com/apache/arrow-datafusion/issues/456)
+- Refactor Ballista to separate Flight logic from execution logic [\#449](https://github.com/apache/arrow-datafusion/issues/449)
+- Use published versions of arrow rather than github shas [\#393](https://github.com/apache/arrow-datafusion/issues/393)
+- BallistaContext::collect\(\) logging is too noisy [\#352](https://github.com/apache/arrow-datafusion/issues/352)
+- Update Ballista to use new physical plan formatter utility [\#343](https://github.com/apache/arrow-datafusion/issues/343)
+- Add Ballista Getting Started documentation [\#329](https://github.com/apache/arrow-datafusion/issues/329)
+- Remove references to ballistacompute Docker Hub repo [\#325](https://github.com/apache/arrow-datafusion/issues/325)
+- Implement scalable distributed joins [\#63](https://github.com/apache/arrow-datafusion/issues/63)
+- Remove hard-coded Ballista version from scripts [\#32](https://github.com/apache/arrow-datafusion/issues/32)
+- Implement streaming versions of Dataframe.collect methods [\#789](https://github.com/apache/arrow-datafusion/pull/789) ([andygrove](https://github.com/andygrove))
+- Ballista shuffle is finally working as intended, providing scalable distributed joins [\#750](https://github.com/apache/arrow-datafusion/pull/750) ([andygrove](https://github.com/andygrove))
+- Update to use arrow 5.0 [\#721](https://github.com/apache/arrow-datafusion/pull/721) ([alamb](https://github.com/alamb))
+- Implement serde for ShuffleWriterExec [\#712](https://github.com/apache/arrow-datafusion/pull/712) ([andygrove](https://github.com/andygrove))
+- dedup using join column in wildcard expansion [\#678](https://github.com/apache/arrow-datafusion/pull/678) ([houqp](https://github.com/houqp))
+- Implement metrics for shuffle read and write [\#676](https://github.com/apache/arrow-datafusion/pull/676) ([andygrove](https://github.com/andygrove))
+- Remove hard-coded PartitionMode from Ballista serde [\#637](https://github.com/apache/arrow-datafusion/pull/637) ([andygrove](https://github.com/andygrove))
+- Ballista: Implement scalable distributed joins [\#634](https://github.com/apache/arrow-datafusion/pull/634) ([andygrove](https://github.com/andygrove))
+- Add Keda autoscaling for ballista in k8s [\#586](https://github.com/apache/arrow-datafusion/pull/586) ([edrevo](https://github.com/edrevo))
+- Add some resiliency to lost executors [\#568](https://github.com/apache/arrow-datafusion/pull/568) ([edrevo](https://github.com/edrevo))
+- Add `partition by` constructs in window functions and modify logical planning [\#501](https://github.com/apache/arrow-datafusion/pull/501) ([Jimexist](https://github.com/Jimexist))
+- Support anti join [\#482](https://github.com/apache/arrow-datafusion/pull/482) ([Dandandan](https://github.com/Dandandan))
+- add `order by` construct in window function and logical plans [\#463](https://github.com/apache/arrow-datafusion/pull/463) ([Jimexist](https://github.com/Jimexist))
+- Refactor Ballista executor so that FlightService delegates to an Executor struct [\#450](https://github.com/apache/arrow-datafusion/pull/450) ([andygrove](https://github.com/andygrove))
+- implement lead and lag built-in window function [\#429](https://github.com/apache/arrow-datafusion/pull/429) ([Jimexist](https://github.com/Jimexist))
+- Implement fmt_as for ShuffleReaderExec [\#400](https://github.com/apache/arrow-datafusion/pull/400) ([andygrove](https://github.com/andygrove))
+- Add window expression part 1 - logical and physical planning, structure, to/from proto, and explain, for empty over clause only [\#334](https://github.com/apache/arrow-datafusion/pull/334) ([Jimexist](https://github.com/Jimexist))
+- \[breaking change\] fix 265, log should be log10, and add ln [\#271](https://github.com/apache/arrow-datafusion/pull/271) ([Jimexist](https://github.com/Jimexist))
+- Allow table providers to indicate their type for catalog metadata [\#205](https://github.com/apache/arrow-datafusion/pull/205) ([returnString](https://github.com/returnString))
+- Add query 19 to TPC-H regression tests [\#59](https://github.com/apache/arrow-datafusion/pull/59) ([Dandandan](https://github.com/Dandandan))
+- Use arrow eq kernels in CaseWhen expression evaluation [\#52](https://github.com/apache/arrow-datafusion/pull/52) ([Dandandan](https://github.com/Dandandan))
+- Add option param for standalone mode [\#42](https://github.com/apache/arrow-datafusion/pull/42) ([djKooks](https://github.com/djKooks))
+- \[DataFusion\] Optimize hash join inner workings, null handling fix [\#24](https://github.com/apache/arrow-datafusion/pull/24) ([Dandandan](https://github.com/Dandandan))
+- \[Ballista\] Docker files for ui [\#22](https://github.com/apache/arrow-datafusion/pull/22) ([msathis](https://github.com/msathis))
+
+**Fixed bugs:**
+
+- Ballista: TPC-H q3 @ SF=1000 never completes [\#835](https://github.com/apache/arrow-datafusion/issues/835)
+- Ballista does not support MIN/MAX aggregate functions [\#832](https://github.com/apache/arrow-datafusion/issues/832)
+- Ballista docker images fail to build [\#828](https://github.com/apache/arrow-datafusion/issues/828)
+- Ballista: UnresolvedShuffleExec should only have a single stage_id [\#726](https://github.com/apache/arrow-datafusion/issues/726)
+- Ballista integration tests are failing [\#623](https://github.com/apache/arrow-datafusion/issues/623)
+- Integration test build failure due to arrow-rs using unstable feature [\#596](https://github.com/apache/arrow-datafusion/issues/596)
+- `cargo build` cannot build the project [\#531](https://github.com/apache/arrow-datafusion/issues/531)
+- ShuffleReaderExec does not get formatted correctly in displayable physical plan [\#399](https://github.com/apache/arrow-datafusion/issues/399)
+- Implement serde for MIN and MAX [\#833](https://github.com/apache/arrow-datafusion/pull/833) ([andygrove](https://github.com/andygrove))
+- Ballista: Prep for fixing shuffle mechansim, part 1 [\#738](https://github.com/apache/arrow-datafusion/pull/738) ([andygrove](https://github.com/andygrove))
+- Ballista: Shuffle write bug fix [\#714](https://github.com/apache/arrow-datafusion/pull/714) ([andygrove](https://github.com/andygrove))
+- honor table name for csv/parquet scan in ballista plan serde [\#629](https://github.com/apache/arrow-datafusion/pull/629) ([houqp](https://github.com/houqp))
+- MINOR: Fix integration tests by adding datafusion-cli module to docker image [\#322](https://github.com/apache/arrow-datafusion/pull/322) ([andygrove](https://github.com/andygrove))
+
+**Documentation updates:**
+
+- Add minimal crate documentation for Ballista crates [\#831](https://github.com/apache/arrow-datafusion/pull/831) ([andygrove](https://github.com/andygrove))
+- Add Ballista examples [\#775](https://github.com/apache/arrow-datafusion/pull/775) ([andygrove](https://github.com/andygrove))
+- Update ballista.proto link in architecture doc [\#502](https://github.com/apache/arrow-datafusion/pull/502) ([terrycorley](https://github.com/terrycorley))
+- Update k8s user guide to use deployments [\#474](https://github.com/apache/arrow-datafusion/pull/474) ([edrevo](https://github.com/edrevo))
+- use prettier to format md files [\#367](https://github.com/apache/arrow-datafusion/pull/367) ([Jimexist](https://github.com/Jimexist))
+- Make it easier for developers to find Ballista documentation [\#330](https://github.com/apache/arrow-datafusion/pull/330) ([andygrove](https://github.com/andygrove))
+- Instructions for cross-compiling Ballista to the Raspberry Pi [\#263](https://github.com/apache/arrow-datafusion/pull/263) ([andygrove](https://github.com/andygrove))
+- Add install guide in README [\#236](https://github.com/apache/arrow-datafusion/pull/236) ([djKooks](https://github.com/djKooks))
+
+**Performance improvements:**
+
+- Ballista: Avoid sleeping between polling for tasks [\#698](https://github.com/apache/arrow-datafusion/pull/698) ([Dandandan](https://github.com/Dandandan))
+- Make BallistaContext::collect streaming [\#535](https://github.com/apache/arrow-datafusion/pull/535) ([edrevo](https://github.com/edrevo))
+
+**Closed issues:**
+
+- Confirm git tagging strategy for releases [\#770](https://github.com/apache/arrow-datafusion/issues/770)
+- arrow::util::pretty::pretty_format_batches missing [\#769](https://github.com/apache/arrow-datafusion/issues/769)
+- move the `assert_batches_eq!` macros to a non part of datafusion [\#745](https://github.com/apache/arrow-datafusion/issues/745)
+- fix an issue where aliases are not respected in generating downstream schemas in window expr [\#592](https://github.com/apache/arrow-datafusion/issues/592)
+- make the planner to print more succinct and useful information in window function explain clause [\#526](https://github.com/apache/arrow-datafusion/issues/526)
+- move window frame module to be in `logical_plan` [\#517](https://github.com/apache/arrow-datafusion/issues/517)
+- use a more rust idiomatic way of handling nth_value [\#448](https://github.com/apache/arrow-datafusion/issues/448)
+- Make Ballista not depend on arrow directly [\#446](https://github.com/apache/arrow-datafusion/issues/446)
+- create a test with more than one partition for window functions [\#435](https://github.com/apache/arrow-datafusion/issues/435)
+- Implement hash-partitioned hash aggregate [\#27](https://github.com/apache/arrow-datafusion/issues/27)
+- Consider using GitHub pages for DataFusion/Ballista documentation [\#18](https://github.com/apache/arrow-datafusion/issues/18)
+- Add Ballista to default cargo workspace [\#17](https://github.com/apache/arrow-datafusion/issues/17)
+- Update "repository" in Cargo.toml [\#16](https://github.com/apache/arrow-datafusion/issues/16)
+- Consolidate TPC-H benchmarks [\#6](https://github.com/apache/arrow-datafusion/issues/6)
+- \[Ballista\] Fix integration test script [\#4](https://github.com/apache/arrow-datafusion/issues/4)
+- Ballista should not have separate DataFrame implementation [\#2](https://github.com/apache/arrow-datafusion/issues/2)
+
+**Merged pull requests:**
+
+- Change datatype of tpch keys from Int32 to UInt64 to support sf=1000 [\#836](https://github.com/apache/arrow-datafusion/pull/836) ([andygrove](https://github.com/andygrove))
+- Add ballista-examples to docker build [\#829](https://github.com/apache/arrow-datafusion/pull/829) ([andygrove](https://github.com/andygrove))
+- Update dependencies: prost to 0.8 and tonic to 0.5 [\#818](https://github.com/apache/arrow-datafusion/pull/818) ([alamb](https://github.com/alamb))
+- Move `hash_array` into hash_utils.rs [\#807](https://github.com/apache/arrow-datafusion/pull/807) ([alamb](https://github.com/alamb))
+- Fix: Update clippy lints for Rust 1.54 [\#794](https://github.com/apache/arrow-datafusion/pull/794) ([alamb](https://github.com/alamb))
+- MINOR: Remove unused Ballista query execution code path [\#732](https://github.com/apache/arrow-datafusion/pull/732) ([andygrove](https://github.com/andygrove))
+- \[fix\] benchmark run with compose [\#666](https://github.com/apache/arrow-datafusion/pull/666) ([rdettai](https://github.com/rdettai))
+- bring back dev scripts for ballista [\#648](https://github.com/apache/arrow-datafusion/pull/648) ([Jimexist](https://github.com/Jimexist))
+- Remove unnecessary mutex [\#639](https://github.com/apache/arrow-datafusion/pull/639) ([edrevo](https://github.com/edrevo))
+- round trip TPCH queries in tests [\#630](https://github.com/apache/arrow-datafusion/pull/630) ([houqp](https://github.com/houqp))
+- Fix build [\#627](https://github.com/apache/arrow-datafusion/pull/627) ([andygrove](https://github.com/andygrove))
+- in ballista also check for UI prettier changes [\#578](https://github.com/apache/arrow-datafusion/pull/578) ([Jimexist](https://github.com/Jimexist))
+- turn on clippy rule for needless borrow [\#545](https://github.com/apache/arrow-datafusion/pull/545) ([Jimexist](https://github.com/Jimexist))
+- reuse datafusion physical planner in ballista building from protobuf [\#532](https://github.com/apache/arrow-datafusion/pull/532) ([Jimexist](https://github.com/Jimexist))
+- update cargo.toml in python crate and fix unit test due to hash joins [\#483](https://github.com/apache/arrow-datafusion/pull/483) ([Jimexist](https://github.com/Jimexist))
+- make `VOLUME` declaration in tpch datagen docker absolute [\#466](https://github.com/apache/arrow-datafusion/pull/466) ([crepererum](https://github.com/crepererum))
+- Refactor QueryStageExec in preparation for implementing map-side shuffle [\#459](https://github.com/apache/arrow-datafusion/pull/459) ([andygrove](https://github.com/andygrove))
+- Simplified usage of `use arrow` in ballista. [\#447](https://github.com/apache/arrow-datafusion/pull/447) ([jorgecarleitao](https://github.com/jorgecarleitao))
+- Benchmark subcommand to distinguish between DataFusion and Ballista [\#402](https://github.com/apache/arrow-datafusion/pull/402) ([jgoday](https://github.com/jgoday))
+- \#352: BallistaContext::collect\(\) logging is too noisy [\#394](https://github.com/apache/arrow-datafusion/pull/394) ([jgoday](https://github.com/jgoday))
+- cleanup function return type fn [\#350](https://github.com/apache/arrow-datafusion/pull/350) ([Jimexist](https://github.com/Jimexist))
+- Update Ballista to use new physical plan formatter utility [\#344](https://github.com/apache/arrow-datafusion/pull/344) ([andygrove](https://github.com/andygrove))
+- Update arrow dependencies again [\#341](https://github.com/apache/arrow-datafusion/pull/341) ([alamb](https://github.com/alamb))
+- Remove references to Ballista Docker images published to ballistacompute Docker Hub repo [\#326](https://github.com/apache/arrow-datafusion/pull/326) ([andygrove](https://github.com/andygrove))
+- Update arrow-rs deps [\#317](https://github.com/apache/arrow-datafusion/pull/317) ([alamb](https://github.com/alamb))
+- Update arrow deps [\#269](https://github.com/apache/arrow-datafusion/pull/269) ([alamb](https://github.com/alamb))
+- Enable redundant_field_names clippy lint [\#261](https://github.com/apache/arrow-datafusion/pull/261) ([Dandandan](https://github.com/Dandandan))
+- Update arrow-rs deps \(to fix build due to flatbuffers update\) [\#224](https://github.com/apache/arrow-datafusion/pull/224) ([alamb](https://github.com/alamb))
+- update arrow-rs deps to latest master [\#216](https://github.com/apache/arrow-datafusion/pull/216) ([alamb](https://github.com/alamb))
+
+\* _This Changelog was automatically generated by [github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)_
diff --git a/_sources/changelog/0.6.0.md.txt b/_sources/changelog/0.6.0.md.txt
new file mode 100644
index 000000000..965758611
--- /dev/null
+++ b/_sources/changelog/0.6.0.md.txt
@@ -0,0 +1,105 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.6.0 Changelog
+
+[Full Changelog](https://github.com/apache/arrow-datafusion/compare/ballista-0.5.0...ballista-0.6.0)
+
+**Breaking changes:**
+
+- File partitioning for ListingTable [\#1141](https://github.com/apache/arrow-datafusion/pull/1141) ([rdettai](https://github.com/rdettai))
+- Register tables in BallistaContext using TableProviders instead of Dataframe [\#1028](https://github.com/apache/arrow-datafusion/pull/1028) ([rdettai](https://github.com/rdettai))
+- Make TableProvider.scan\(\) and PhysicalPlanner::create_physical_plan\(\) async [\#1013](https://github.com/apache/arrow-datafusion/pull/1013) ([rdettai](https://github.com/rdettai))
+- Reorganize table providers by table format [\#1010](https://github.com/apache/arrow-datafusion/pull/1010) ([rdettai](https://github.com/rdettai))
+- Move CBOs and Statistics to physical plan [\#965](https://github.com/apache/arrow-datafusion/pull/965) ([rdettai](https://github.com/rdettai))
+- Update to sqlparser v 0.10.0 [\#934](https://github.com/apache/arrow-datafusion/pull/934) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([alamb](https://github.com/alamb))
+- FilePartition and PartitionedFile for scanning flexibility [\#932](https://github.com/apache/arrow-datafusion/pull/932) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([yjshen](https://github.com/yjshen))
+- Improve SQLMetric APIs, port existing metrics [\#908](https://github.com/apache/arrow-datafusion/pull/908) ([alamb](https://github.com/alamb))
+- Add support for EXPLAIN ANALYZE [\#858](https://github.com/apache/arrow-datafusion/pull/858) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([alamb](https://github.com/alamb))
+- Rename concurrency to target_partitions [\#706](https://github.com/apache/arrow-datafusion/pull/706) ([andygrove](https://github.com/andygrove))
+
+**Implemented enhancements:**
+
+- Update datafusion-cli to support Ballista, or implement new ballista-cli [\#886](https://github.com/apache/arrow-datafusion/issues/886)
+- Prepare Ballista crates for publishing [\#509](https://github.com/apache/arrow-datafusion/issues/509)
+- Add drop table support [\#1266](https://github.com/apache/arrow-datafusion/pull/1266) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([viirya](https://github.com/viirya))
+- use arrow 6.1.0 [\#1255](https://github.com/apache/arrow-datafusion/pull/1255) ([Jimexist](https://github.com/Jimexist))
+- Add support for `create table as` via MemTable [\#1243](https://github.com/apache/arrow-datafusion/pull/1243) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([Dandandan](https://github.com/Dandandan))
+- add values list expression [\#1165](https://github.com/apache/arrow-datafusion/pull/1165) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([Jimexist](https://github.com/Jimexist))
+- Multiple files per partitions for CSV Avro Json [\#1138](https://github.com/apache/arrow-datafusion/pull/1138) ([rdettai](https://github.com/rdettai))
+- Implement INTERSECT & INTERSECT DISTINCT [\#1135](https://github.com/apache/arrow-datafusion/pull/1135) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([xudong963](https://github.com/xudong963))
+- Simplify file struct abstractions [\#1120](https://github.com/apache/arrow-datafusion/pull/1120) ([rdettai](https://github.com/rdettai))
+- Implement `is [not] distinct from` [\#1117](https://github.com/apache/arrow-datafusion/pull/1117) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([Dandandan](https://github.com/Dandandan))
+- add digest\(utf8, method\) function and refactor all current hash digest functions [\#1090](https://github.com/apache/arrow-datafusion/pull/1090) ([Jimexist](https://github.com/Jimexist))
+- \[crypto\] add `blake3` algorithm to `digest` function [\#1086](https://github.com/apache/arrow-datafusion/pull/1086) ([Jimexist](https://github.com/Jimexist))
+- \[crypto\] add blake2b and blake2s functions [\#1081](https://github.com/apache/arrow-datafusion/pull/1081) ([Jimexist](https://github.com/Jimexist))
+- Update sqlparser-rs to 0.11 [\#1052](https://github.com/apache/arrow-datafusion/pull/1052) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([alamb](https://github.com/alamb))
+- remove hard coded partition count in ballista logicalplan deserialization [\#1044](https://github.com/apache/arrow-datafusion/pull/1044) ([xudong963](https://github.com/xudong963))
+- Indexed field access for List [\#1006](https://github.com/apache/arrow-datafusion/pull/1006) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([Igosuki](https://github.com/Igosuki))
+- Update DataFusion to arrow 6.0 [\#984](https://github.com/apache/arrow-datafusion/pull/984) ([alamb](https://github.com/alamb))
+- Implement Display for Expr, improve operator display [\#971](https://github.com/apache/arrow-datafusion/pull/971) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([matthewmturner](https://github.com/matthewmturner))
+- ObjectStore API to read from remote storage systems [\#950](https://github.com/apache/arrow-datafusion/pull/950) ([yjshen](https://github.com/yjshen))
+- fixes \#933 replace placeholder fmt_as fr ExecutionPlan impls [\#939](https://github.com/apache/arrow-datafusion/pull/939) ([tiphaineruy](https://github.com/tiphaineruy))
+- Support `NotLike` in Ballista [\#916](https://github.com/apache/arrow-datafusion/pull/916) ([Dandandan](https://github.com/Dandandan))
+- Avro Table Provider [\#910](https://github.com/apache/arrow-datafusion/pull/910) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([Igosuki](https://github.com/Igosuki))
+- Add BaselineMetrics, Timestamp metrics, add for `CoalescePartitionsExec`, rename output_time -\> elapsed_compute [\#909](https://github.com/apache/arrow-datafusion/pull/909) ([alamb](https://github.com/alamb))
+- \[Ballista\] Add executor last seen info to the ui [\#895](https://github.com/apache/arrow-datafusion/pull/895) ([msathis](https://github.com/msathis))
+- add cross join support to ballista [\#891](https://github.com/apache/arrow-datafusion/pull/891) ([houqp](https://github.com/houqp))
+- Add Ballista support to DataFusion CLI [\#889](https://github.com/apache/arrow-datafusion/pull/889) ([andygrove](https://github.com/andygrove))
+- Add support for PostgreSQL regex match [\#870](https://github.com/apache/arrow-datafusion/pull/870) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([b41sh](https://github.com/b41sh))
+
+**Fixed bugs:**
+
+- Test execution_plans::shuffle_writer::tests::test Fail [\#1040](https://github.com/apache/arrow-datafusion/issues/1040)
+- Integration test fails to build docker images [\#918](https://github.com/apache/arrow-datafusion/issues/918)
+- Ballista: Remove hard-coded concurrency from logical plan serde code [\#708](https://github.com/apache/arrow-datafusion/issues/708)
+- How can I make ballista distributed compute work? [\#327](https://github.com/apache/arrow-datafusion/issues/327)
+- fix subquery alias [\#1067](https://github.com/apache/arrow-datafusion/pull/1067) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([xudong963](https://github.com/xudong963))
+- Fix compilation for ballista in stand-alone mode [\#1008](https://github.com/apache/arrow-datafusion/pull/1008) ([Igosuki](https://github.com/Igosuki))
+
+**Documentation updates:**
+
+- Add Ballista roadmap [\#1166](https://github.com/apache/arrow-datafusion/pull/1166) ([andygrove](https://github.com/andygrove))
+- Adds note on compatible rust version [\#1097](https://github.com/apache/arrow-datafusion/pull/1097) ([1nF0rmed](https://github.com/1nF0rmed))
+- implement `approx_distinct` function using HyperLogLog [\#1087](https://github.com/apache/arrow-datafusion/pull/1087) ([Jimexist](https://github.com/Jimexist))
+- Improve User Guide [\#954](https://github.com/apache/arrow-datafusion/pull/954) ([andygrove](https://github.com/andygrove))
+- Update plan_query_stages doc [\#951](https://github.com/apache/arrow-datafusion/pull/951) ([rdettai](https://github.com/rdettai))
+- \[DataFusion\] - Add show and show_limit function for DataFrame [\#923](https://github.com/apache/arrow-datafusion/pull/923) ([francis-du](https://github.com/francis-du))
+- update docs related to protoc and optional syntax [\#902](https://github.com/apache/arrow-datafusion/pull/902) ([Jimexist](https://github.com/Jimexist))
+- Improve Ballista crate README content [\#878](https://github.com/apache/arrow-datafusion/pull/878) ([andygrove](https://github.com/andygrove))
+
+**Performance improvements:**
+
+- optimize build profile for datafusion python binding, cli and ballista [\#1137](https://github.com/apache/arrow-datafusion/pull/1137) ([houqp](https://github.com/houqp))
+
+**Closed issues:**
+
+- InList expr with NULL literals do not work [\#1190](https://github.com/apache/arrow-datafusion/issues/1190)
+- update the homepage README to include values, `approx_distinct`, etc. [\#1171](https://github.com/apache/arrow-datafusion/issues/1171)
+- \[Python\]: Inconsistencies with Python package name [\#1011](https://github.com/apache/arrow-datafusion/issues/1011)
+- Wanting to contribute to project where to start? [\#983](https://github.com/apache/arrow-datafusion/issues/983)
+- delete redundant code [\#973](https://github.com/apache/arrow-datafusion/issues/973)
+- How to build DataFusion python wheel [\#853](https://github.com/apache/arrow-datafusion/issues/853)
+- Produce a design for a metrics framework [\#21](https://github.com/apache/arrow-datafusion/issues/21)
+
+**Merged pull requests:**
+
+- \[nit\] simplify ballista executor `CollectExec` impl codes [\#1140](https://github.com/apache/arrow-datafusion/pull/1140) ([panarch](https://github.com/panarch))
+
+For older versions, see [apache/arrow/CHANGELOG.md](https://github.com/apache/arrow/blob/master/CHANGELOG.md)
diff --git a/_sources/changelog/0.7.0.md.txt b/_sources/changelog/0.7.0.md.txt
new file mode 100644
index 000000000..7fffd781f
--- /dev/null
+++ b/_sources/changelog/0.7.0.md.txt
@@ -0,0 +1,165 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.7.0 Changelog
+
+[Full Changelog](https://github.com/apache/arrow-datafusion/compare/7.1.0-rc1...ballista-0.7.0)
+
+**Breaking changes:**
+
+- Make `ExecutionPlan::execute` Sync [\#2434](https://github.com/apache/arrow-datafusion/pull/2434) ([tustvold](https://github.com/tustvold))
+- Add `Expr::Exists` to represent EXISTS subquery expression [\#2339](https://github.com/apache/arrow-datafusion/pull/2339) ([andygrove](https://github.com/andygrove))
+- Remove dependency from `LogicalPlan::TableScan` to `ExecutionPlan` [\#2284](https://github.com/apache/arrow-datafusion/pull/2284) ([andygrove](https://github.com/andygrove))
+- Move logical expression type-coercion code from `physical-expr` crate to `expr` crate [\#2257](https://github.com/apache/arrow-datafusion/pull/2257) ([andygrove](https://github.com/andygrove))
+- feat: 2061 create external table ddl table partition cols [\#2099](https://github.com/apache/arrow-datafusion/pull/2099) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([jychen7](https://github.com/jychen7))
+- Reorganize the project folders [\#2081](https://github.com/apache/arrow-datafusion/pull/2081) ([yahoNanJing](https://github.com/yahoNanJing))
+- Support more ScalarFunction in Ballista [\#2008](https://github.com/apache/arrow-datafusion/pull/2008) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Merge dataframe and dataframe imp [\#1998](https://github.com/apache/arrow-datafusion/pull/1998) ([vchag](https://github.com/vchag))
+- Rename `ExecutionContext` to `SessionContext`, `ExecutionContextState` to `SessionState`, add `TaskContext` to support multi-tenancy configurations - Part 1 [\#1987](https://github.com/apache/arrow-datafusion/pull/1987) ([mingmwang](https://github.com/mingmwang))
+- Add Coalesce function [\#1969](https://github.com/apache/arrow-datafusion/pull/1969) ([msathis](https://github.com/msathis))
+- Add Create Schema functionality in SQL [\#1959](https://github.com/apache/arrow-datafusion/pull/1959) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([matthewmturner](https://github.com/matthewmturner))
+- remove sync constraint of SendableRecordBatchStream [\#1884](https://github.com/apache/arrow-datafusion/pull/1884) ([doki23](https://github.com/doki23))
+
+**Implemented enhancements:**
+
+- Add `CREATE VIEW` [\#2279](https://github.com/apache/arrow-datafusion/pull/2279) ([matthewmturner](https://github.com/matthewmturner))
+- \[Ballista\] Support Union in ballista. [\#2098](https://github.com/apache/arrow-datafusion/pull/2098) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Add missing aggr_expr to PhysicalExprNode for Ballista. [\#1989](https://github.com/apache/arrow-datafusion/pull/1989) ([Ted-Jiang](https://github.com/Ted-Jiang))
+
+**Fixed bugs:**
+
+- Ballista integration tests no longer work [\#2440](https://github.com/apache/arrow-datafusion/issues/2440)
+- Ballista crates cannot be released from DafaFusion 7.0.0 source release [\#1980](https://github.com/apache/arrow-datafusion/issues/1980)
+- protobuf OctetLength should be deserialized as octet_length, not length [\#1834](https://github.com/apache/arrow-datafusion/pull/1834) ([carols10cents](https://github.com/carols10cents))
+
+**Documentation updates:**
+
+- MINOR: Make crate READMEs consistent [\#2437](https://github.com/apache/arrow-datafusion/pull/2437) ([andygrove](https://github.com/andygrove))
+- docs: Update the Ballista dev env instructions [\#2419](https://github.com/apache/arrow-datafusion/pull/2419) ([haoxins](https://github.com/haoxins))
+- Revise document of installing ballista pinned to specified version [\#2034](https://github.com/apache/arrow-datafusion/pull/2034) ([WinkerDu](https://github.com/WinkerDu))
+- Fix typos \(Datafusion -\> DataFusion\) [\#1993](https://github.com/apache/arrow-datafusion/pull/1993) ([andygrove](https://github.com/andygrove))
+
+**Performance improvements:**
+
+- Introduce StageManager for managing tasks stage by stage [\#1983](https://github.com/apache/arrow-datafusion/pull/1983) ([yahoNanJing](https://github.com/yahoNanJing))
+
+**Closed issues:**
+
+- Make expected result string in unit tests more readable [\#2412](https://github.com/apache/arrow-datafusion/issues/2412)
+- remove duplicated `fn aggregate()` in aggregate expression tests [\#2399](https://github.com/apache/arrow-datafusion/issues/2399)
+- split `distinct_expression.rs` into `count_distinct.rs` and `array_agg_distinct.rs` [\#2385](https://github.com/apache/arrow-datafusion/issues/2385)
+- move sql tests in `context.rs` to corresponding test files in `datafustion/core/tests/sql` [\#2328](https://github.com/apache/arrow-datafusion/issues/2328)
+- Date32/Date64 as join keys for merge join [\#2314](https://github.com/apache/arrow-datafusion/issues/2314)
+- Error precision and scale for decimal coercion in logic comparison [\#2232](https://github.com/apache/arrow-datafusion/issues/2232)
+- Support Multiple row layout [\#2188](https://github.com/apache/arrow-datafusion/issues/2188)
+- Discussion: Is Ballista a standalone system or framework [\#1916](https://github.com/apache/arrow-datafusion/issues/1916)
+
+**Merged pull requests:**
+
+- MINOR: Enable multi-statement benchmark queries [\#2507](https://github.com/apache/arrow-datafusion/pull/2507) ([andygrove](https://github.com/andygrove))
+- Persist session configs in scheduler [\#2501](https://github.com/apache/arrow-datafusion/pull/2501) ([thinkharderdev](https://github.com/thinkharderdev))
+- Update to `sqlparser` `0.17.0` [\#2500](https://github.com/apache/arrow-datafusion/pull/2500) ([alamb](https://github.com/alamb))
+- Limit cpu cores used when generating changelog [\#2494](https://github.com/apache/arrow-datafusion/pull/2494) ([andygrove](https://github.com/andygrove))
+- MINOR: Parameterize changelog script [\#2484](https://github.com/apache/arrow-datafusion/pull/2484) ([jychen7](https://github.com/jychen7))
+- Fix stage key extraction [\#2472](https://github.com/apache/arrow-datafusion/pull/2472) ([thinkharderdev](https://github.com/thinkharderdev))
+- Add support for list_dir\(\) on local fs [\#2467](https://github.com/apache/arrow-datafusion/pull/2467) ([wjones127](https://github.com/wjones127))
+- minor: update versions and paths in changelog scripts [\#2429](https://github.com/apache/arrow-datafusion/pull/2429) ([andygrove](https://github.com/andygrove))
+- Fix Ballista executing during plan [\#2428](https://github.com/apache/arrow-datafusion/pull/2428) ([tustvold](https://github.com/tustvold))
+- Re-organize and rename aggregates physical plan [\#2388](https://github.com/apache/arrow-datafusion/pull/2388) ([yjshen](https://github.com/yjshen))
+- Upgrade to arrow 13 [\#2382](https://github.com/apache/arrow-datafusion/pull/2382) ([alamb](https://github.com/alamb))
+- Grouped Aggregate in row format [\#2375](https://github.com/apache/arrow-datafusion/pull/2375) ([yjshen](https://github.com/yjshen))
+- Stop optimizing queries twice [\#2369](https://github.com/apache/arrow-datafusion/pull/2369) ([andygrove](https://github.com/andygrove))
+- Bump follow-redirects from 1.13.2 to 1.14.9 in /ballista/ui/scheduler [\#2325](https://github.com/apache/arrow-datafusion/pull/2325) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Move FileType enum from sql module to logical_plan module [\#2290](https://github.com/apache/arrow-datafusion/pull/2290) ([andygrove](https://github.com/andygrove))
+- Add BatchPartitioner \(\#2285\) [\#2287](https://github.com/apache/arrow-datafusion/pull/2287) ([tustvold](https://github.com/tustvold))
+- Update uuid requirement from 0.8 to 1.0 [\#2280](https://github.com/apache/arrow-datafusion/pull/2280) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump async from 2.6.3 to 2.6.4 in /ballista/ui/scheduler [\#2277](https://github.com/apache/arrow-datafusion/pull/2277) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump minimist from 1.2.5 to 1.2.6 in /ballista/ui/scheduler [\#2276](https://github.com/apache/arrow-datafusion/pull/2276) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump url-parse from 1.5.1 to 1.5.10 in /ballista/ui/scheduler [\#2275](https://github.com/apache/arrow-datafusion/pull/2275) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump nanoid from 3.1.20 to 3.3.3 in /ballista/ui/scheduler [\#2274](https://github.com/apache/arrow-datafusion/pull/2274) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Update to Arrow 12.0.0, update tonic and prost [\#2253](https://github.com/apache/arrow-datafusion/pull/2253) ([alamb](https://github.com/alamb))
+- Add ExecutorMetricsCollector interface [\#2234](https://github.com/apache/arrow-datafusion/pull/2234) ([thinkharderdev](https://github.com/thinkharderdev))
+- minor: add editor config file [\#2224](https://github.com/apache/arrow-datafusion/pull/2224) ([jackwener](https://github.com/jackwener))
+- \[Ballista\] Enable ApproxPercentileWithWeight in Ballista and fill UT [\#2192](https://github.com/apache/arrow-datafusion/pull/2192) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- make nightly clippy happy [\#2186](https://github.com/apache/arrow-datafusion/pull/2186) ([xudong963](https://github.com/xudong963))
+- \[Ballista\]Make PhysicalAggregateExprNode has repeated PhysicalExprNode [\#2184](https://github.com/apache/arrow-datafusion/pull/2184) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Add LogicalPlan::SubqueryAlias [\#2172](https://github.com/apache/arrow-datafusion/pull/2172) ([andygrove](https://github.com/andygrove))
+- Implement fast path of with_new_children\(\) in ExecutionPlan [\#2168](https://github.com/apache/arrow-datafusion/pull/2168) ([mingmwang](https://github.com/mingmwang))
+- \[MINOR\] ignore suspicious slow test in Ballista [\#2167](https://github.com/apache/arrow-datafusion/pull/2167) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- enable explain for ballista [\#2163](https://github.com/apache/arrow-datafusion/pull/2163) ([doki23](https://github.com/doki23))
+- Add delimiter for create external table [\#2162](https://github.com/apache/arrow-datafusion/pull/2162) ([matthewmturner](https://github.com/matthewmturner))
+- Update sqlparser requirement from 0.15 to 0.16 [\#2152](https://github.com/apache/arrow-datafusion/pull/2152) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Add IF NOT EXISTS to `CREATE TABLE` and `CREATE EXTERNAL TABLE` [\#2143](https://github.com/apache/arrow-datafusion/pull/2143) ([matthewmturner](https://github.com/matthewmturner))
+- Update quarterly roadmap for Q2 [\#2133](https://github.com/apache/arrow-datafusion/pull/2133) ([matthewmturner](https://github.com/matthewmturner))
+- \[Ballista\] Add ballista plugin manager and UDF plugin [\#2131](https://github.com/apache/arrow-datafusion/pull/2131) ([gaojun2048](https://github.com/gaojun2048))
+- Serialize scalar UDFs in physical plan [\#2130](https://github.com/apache/arrow-datafusion/pull/2130) ([thinkharderdev](https://github.com/thinkharderdev))
+- doc: update release schedule [\#2110](https://github.com/apache/arrow-datafusion/pull/2110) ([jychen7](https://github.com/jychen7))
+- Reduce repetition in Decimal binary kernels, upgrade to arrow 11.1 [\#2107](https://github.com/apache/arrow-datafusion/pull/2107) ([alamb](https://github.com/alamb))
+- update zlib version to 1.2.12 [\#2106](https://github.com/apache/arrow-datafusion/pull/2106) ([waitingkuo](https://github.com/waitingkuo))
+- Add CREATE DATABASE command to SQL [\#2094](https://github.com/apache/arrow-datafusion/pull/2094) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([matthewmturner](https://github.com/matthewmturner))
+- Refactor SessionContext, BallistaContext to support multi-tenancy configurations - Part 3 [\#2091](https://github.com/apache/arrow-datafusion/pull/2091) ([mingmwang](https://github.com/mingmwang))
+- Remove dependency of common for the storage crate [\#2076](https://github.com/apache/arrow-datafusion/pull/2076) ([yahoNanJing](https://github.com/yahoNanJing))
+- [MINOR] fix doc in `EXTRACT\(field FROM source\) [\#2074](https://github.com/apache/arrow-datafusion/pull/2074) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- \[Bug\]\[Datafusion\] fix TaskContext session_config bug [\#2070](https://github.com/apache/arrow-datafusion/pull/2070) ([gaojun2048](https://github.com/gaojun2048))
+- Short-circuit evaluation for `CaseWhen` [\#2068](https://github.com/apache/arrow-datafusion/pull/2068) ([yjshen](https://github.com/yjshen))
+- split datafusion-object-store module [\#2065](https://github.com/apache/arrow-datafusion/pull/2065) ([yahoNanJing](https://github.com/yahoNanJing))
+- Change log level for noisy logs [\#2060](https://github.com/apache/arrow-datafusion/pull/2060) ([thinkharderdev](https://github.com/thinkharderdev))
+- Update to arrow/parquet 11.0 [\#2048](https://github.com/apache/arrow-datafusion/pull/2048) ([alamb](https://github.com/alamb))
+- minor: format comments \(`//` to `//`\) [\#2047](https://github.com/apache/arrow-datafusion/pull/2047) ([jackwener](https://github.com/jackwener))
+- use cargo-tomlfmt to check Cargo.toml formatting in CI [\#2033](https://github.com/apache/arrow-datafusion/pull/2033) ([WinkerDu](https://github.com/WinkerDu))
+- Refactor SessionContext, SessionState and SessionConfig to support multi-tenancy configurations - Part 2 [\#2029](https://github.com/apache/arrow-datafusion/pull/2029) ([mingmwang](https://github.com/mingmwang))
+- Simplify prerequisites for running examples [\#2028](https://github.com/apache/arrow-datafusion/pull/2028) ([doki23](https://github.com/doki23))
+- Use SessionContext to parse Expr protobuf [\#2024](https://github.com/apache/arrow-datafusion/pull/2024) ([thinkharderdev](https://github.com/thinkharderdev))
+- Fix stuck issue for the load testing of Push-based task scheduling [\#2006](https://github.com/apache/arrow-datafusion/pull/2006) ([yahoNanJing](https://github.com/yahoNanJing))
+- Fixing a typo in documentation [\#1997](https://github.com/apache/arrow-datafusion/pull/1997) ([psvri](https://github.com/psvri))
+- Fix minor clippy issue [\#1995](https://github.com/apache/arrow-datafusion/pull/1995) ([alamb](https://github.com/alamb))
+- Make it possible to only scan part of a parquet file in a partition [\#1990](https://github.com/apache/arrow-datafusion/pull/1990) ([yjshen](https://github.com/yjshen))
+- Update Dockerfile to fix integration tests [\#1982](https://github.com/apache/arrow-datafusion/pull/1982) ([andygrove](https://github.com/andygrove))
+- Update sqlparser requirement from 0.14 to 0.15 [\#1966](https://github.com/apache/arrow-datafusion/pull/1966) ([dependabot[bot]](https://github.com/apps/dependabot))
+- fix logical conflict with protobuf [\#1958](https://github.com/apache/arrow-datafusion/pull/1958) ([alamb](https://github.com/alamb))
+- Update to arrow 10.0.0, pyo3 0.16 [\#1957](https://github.com/apache/arrow-datafusion/pull/1957) ([alamb](https://github.com/alamb))
+- update jit-related dependencies [\#1953](https://github.com/apache/arrow-datafusion/pull/1953) ([xudong963](https://github.com/xudong963))
+- Allow different types of query variables \(`@@var`\) rather than just string [\#1943](https://github.com/apache/arrow-datafusion/pull/1943) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([maxburke](https://github.com/maxburke))
+- Pruning serialization [\#1941](https://github.com/apache/arrow-datafusion/pull/1941) ([thinkharderdev](https://github.com/thinkharderdev))
+- Fix select from EmptyExec always return 0 row after optimizer passes [\#1938](https://github.com/apache/arrow-datafusion/pull/1938) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Introduce Ballista query stage scheduler [\#1935](https://github.com/apache/arrow-datafusion/pull/1935) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add db benchmark script [\#1928](https://github.com/apache/arrow-datafusion/pull/1928) ([matthewmturner](https://github.com/matthewmturner))
+- fix a typo [\#1919](https://github.com/apache/arrow-datafusion/pull/1919) ([vchag](https://github.com/vchag))
+- \[MINOR\] Update copyright year in Docs [\#1918](https://github.com/apache/arrow-datafusion/pull/1918) ([alamb](https://github.com/alamb))
+- add metadata to DFSchema, close \#1806. [\#1914](https://github.com/apache/arrow-datafusion/pull/1914) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([jiacai2050](https://github.com/jiacai2050))
+- Refactor scheduler state mod [\#1913](https://github.com/apache/arrow-datafusion/pull/1913) ([yahoNanJing](https://github.com/yahoNanJing))
+- Refactor the event channel [\#1912](https://github.com/apache/arrow-datafusion/pull/1912) ([yahoNanJing](https://github.com/yahoNanJing))
+- Refactor scheduler server [\#1911](https://github.com/apache/arrow-datafusion/pull/1911) ([yahoNanJing](https://github.com/yahoNanJing))
+- Clippy fix on nightly [\#1907](https://github.com/apache/arrow-datafusion/pull/1907) ([yjshen](https://github.com/yjshen))
+- Updated Rust version to 1.59 in all the files [\#1903](https://github.com/apache/arrow-datafusion/pull/1903) ([NaincyKumariKnoldus](https://github.com/NaincyKumariKnoldus))
+- Remove uneeded Mutex in Ballista Client [\#1898](https://github.com/apache/arrow-datafusion/pull/1898) ([alamb](https://github.com/alamb))
+- Create a `datafusion-proto` crate for datafusion protobuf serialization [\#1887](https://github.com/apache/arrow-datafusion/pull/1887) ([carols10cents](https://github.com/carols10cents))
+- Fix clippy lints [\#1885](https://github.com/apache/arrow-datafusion/pull/1885) ([HaoYang670](https://github.com/HaoYang670))
+- Separate cpu-bound \(query-execution\) and IO-bound\(heartbeat\) to … [\#1883](https://github.com/apache/arrow-datafusion/pull/1883) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- \[Minor\] Clean up DecimalArray API Usage [\#1869](https://github.com/apache/arrow-datafusion/pull/1869) [[sql](https://github.com/apache/arrow-datafusion/labels/sql)] ([alamb](https://github.com/alamb))
+- Changes after went through "Datafusion as a library section" [\#1868](https://github.com/apache/arrow-datafusion/pull/1868) ([nonontb](https://github.com/nonontb))
+- Remove allow unused imports from ballista-core, then fix all warnings [\#1853](https://github.com/apache/arrow-datafusion/pull/1853) ([carols10cents](https://github.com/carols10cents))
+- Update to arrow 9.1.0 [\#1851](https://github.com/apache/arrow-datafusion/pull/1851) ([alamb](https://github.com/alamb))
+- move some tests out of context and into sql [\#1846](https://github.com/apache/arrow-datafusion/pull/1846) ([alamb](https://github.com/alamb))
+- Fix compiling ballista in standalone mode, add build to CI [\#1839](https://github.com/apache/arrow-datafusion/pull/1839) ([alamb](https://github.com/alamb))
+- Update documentation example for change in API [\#1812](https://github.com/apache/arrow-datafusion/pull/1812) ([alamb](https://github.com/alamb))
+- Refactor scheduler state with different management policy for volatile and stable states [\#1810](https://github.com/apache/arrow-datafusion/pull/1810) ([yahoNanJing](https://github.com/yahoNanJing))
+- DataFusion + Conbench Integration [\#1791](https://github.com/apache/arrow-datafusion/pull/1791) ([dianaclarke](https://github.com/dianaclarke))
+- Enable periodic cleanup of work_dir directories in ballista executor [\#1783](https://github.com/apache/arrow-datafusion/pull/1783) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Use`eq_dyn`, `neq_dyn`, `lt_dyn`, `lt_eq_dyn`, `gt_dyn`, `gt_eq_dyn` kernels from arrow [\#1475](https://github.com/apache/arrow-datafusion/pull/1475) ([alamb](https://github.com/alamb))
diff --git a/_sources/changelog/0.8.0.md.txt b/_sources/changelog/0.8.0.md.txt
new file mode 100644
index 000000000..b8e5b7382
--- /dev/null
+++ b/_sources/changelog/0.8.0.md.txt
@@ -0,0 +1,64 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.8.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/0.7.0...0.8.0)
+
+**Implemented enhancements:**
+
+- Executor should use all available cores by default [\#218](https://github.com/apache/datafusion-ballista/issues/218)
+- Update task status to the task job curator scheduler [\#179](https://github.com/apache/datafusion-ballista/issues/179)
+- update datafusion and arrow to 20.0.0 [\#176](https://github.com/apache/datafusion-ballista/issues/176)
+- No scheduler logs when deployed to k8s [\#165](https://github.com/apache/datafusion-ballista/issues/165)
+- Upgrade to DataFusion 11.0.0 [\#163](https://github.com/apache/datafusion-ballista/issues/163)
+- Better encapsulation for ExecutionGraph [\#149](https://github.com/apache/datafusion-ballista/issues/149)
+- A stage may act as the input of multiple stages [\#144](https://github.com/apache/datafusion-ballista/issues/144)
+- Executor Lost handling [\#143](https://github.com/apache/datafusion-ballista/issues/143)
+- Cancel a running query. [\#139](https://github.com/apache/datafusion-ballista/issues/139)
+- Ignore the previous job_id inside fill_reservations\(\) [\#138](https://github.com/apache/datafusion-ballista/issues/138)
+- Normalize the serialization and deserialization places of protobuf structs [\#137](https://github.com/apache/datafusion-ballista/issues/137)
+- Remove revive offer event loop [\#136](https://github.com/apache/datafusion-ballista/issues/136)
+- Remove Keyspace::QueuedJobs [\#133](https://github.com/apache/datafusion-ballista/issues/133)
+- Spawn a thread for execution plan generation [\#131](https://github.com/apache/datafusion-ballista/issues/131)
+- Introduce CuratorTaskManager for make an active job be curated by only one scheduler [\#130](https://github.com/apache/datafusion-ballista/issues/130)
+- Using tokio tracing for log file [\#122](https://github.com/apache/datafusion-ballista/issues/122)
+- Ballista Executor report plan/operators metrics to Ballista Scheduler when task finish [\#116](https://github.com/apache/datafusion-ballista/issues/116)
+- Add timeout settings for Grpc Client [\#114](https://github.com/apache/datafusion-ballista/issues/114)
+- Add log level config in ballista [\#102](https://github.com/apache/datafusion-ballista/issues/102)
+- Use another channel to update the status of a task set for executor [\#96](https://github.com/apache/datafusion-ballista/issues/96)
+- Add config for concurrent_task in executor [\#94](https://github.com/apache/datafusion-ballista/issues/94)
+- Ballista should support Arrow FlightSQL [\#92](https://github.com/apache/datafusion-ballista/issues/92)
+- Why not include the `ballista-cli` in the member of workspace [\#88](https://github.com/apache/datafusion-ballista/issues/88)
+- Upgrade dependency of arrow-datafusion to commit d0d5564b8f689a01e542b8c1df829d74d0fab2b0 [\#84](https://github.com/apache/datafusion-ballista/issues/84)
+- Support sled path in config file. [\#79](https://github.com/apache/datafusion-ballista/issues/79)
+- Support for multi-scheduler deployments [\#39](https://github.com/apache/datafusion-ballista/issues/39)
+- Ballista 0.7.0 Release [\#126](https://github.com/apache/datafusion-ballista/issues/126)
+- Improvements to Ballista extensibility [\#8](https://github.com/apache/datafusion-ballista/issues/8)
+- Implement Python bindings for BallistaContext [\#15](https://github.com/apache/datafusion-ballista/issues/15)
+
+**Fixed bugs:**
+
+- Run example fails via PushStaged mode [\#214](https://github.com/apache/datafusion-ballista/issues/214)
+- Config settings in BallistaContext do not get passed to DataFusion context [\#213](https://github.com/apache/datafusion-ballista/issues/213)
+- Start scheduler fails with arguments "-s PushStaged" [\#207](https://github.com/apache/datafusion-ballista/issues/207)
+- FlightSQL is broken and CI isn't catching it [\#190](https://github.com/apache/datafusion-ballista/issues/190)
+- Query fails with "NULL is invalid as a DataFusion scalar value" [\#180](https://github.com/apache/datafusion-ballista/issues/180)
+- Executor doesn't compile, missing `tokio::signal` [\#171](https://github.com/apache/datafusion-ballista/issues/171)
+- Unable to build master [\#76](https://github.com/apache/datafusion-ballista/issues/76)
diff --git a/_sources/changelog/0.9.0.md.txt b/_sources/changelog/0.9.0.md.txt
new file mode 100644
index 000000000..7f3ba4832
--- /dev/null
+++ b/_sources/changelog/0.9.0.md.txt
@@ -0,0 +1,184 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 0.9.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/0.8.0...0.9.0)
+
+**Implemented enhancements:**
+
+- Support count distinct aggregation function [\#411](https://github.com/apache/datafusion-ballista/issues/411)
+- Use multi-task definition in pull-based execution loop [\#400](https://github.com/apache/datafusion-ballista/issues/400)
+- Make the scheduler event loop buffer size configurable [\#397](https://github.com/apache/datafusion-ballista/issues/397)
+- Remove active execution graph when the related job is successful or failed. [\#391](https://github.com/apache/datafusion-ballista/issues/391)
+- Improve launch task efficiency by calling LaunchMultiTask [\#389](https://github.com/apache/datafusion-ballista/issues/389)
+- Use `tokio::sync::Semaphore` to wait for available task slots [\#388](https://github.com/apache/datafusion-ballista/issues/388)
+- stdout and file log level settings are inconsistent [\#385](https://github.com/apache/datafusion-ballista/issues/385)
+- Use dedicated executor in pull based loop [\#383](https://github.com/apache/datafusion-ballista/issues/383)
+- Avoid calling scheduler when the executor cannot accept new tasks [\#377](https://github.com/apache/datafusion-ballista/issues/377)
+- Add round robin executor slots reservation policy for the scheduler to evenly assign tasks to executors [\#371](https://github.com/apache/datafusion-ballista/issues/371)
+- Switch to mimalloc and enable by default [\#369](https://github.com/apache/datafusion-ballista/issues/369)
+- Integration test script should use docker-compose [\#364](https://github.com/apache/datafusion-ballista/issues/364)
+- Use local shuffle reader in containerized environments [\#356](https://github.com/apache/datafusion-ballista/issues/356)
+- Add `--ext` option to benchmark [\#352](https://github.com/apache/datafusion-ballista/issues/352)
+- Add job cancel in the UI [\#350](https://github.com/apache/datafusion-ballista/issues/350)
+- Using local shuffle reader avoid flight rpc call. [\#346](https://github.com/apache/datafusion-ballista/issues/346)
+- Add a Helm Chart [\#321](https://github.com/apache/datafusion-ballista/issues/321)
+- \[UI\] Show list of query stages with metrics [\#306](https://github.com/apache/datafusion-ballista/issues/306)
+- \[UI\] Add ability to specify job name and have it show in the job listing page in the UI [\#277](https://github.com/apache/datafusion-ballista/issues/277)
+- \[UI\] Add ability to download query plans in dot format [\#276](https://github.com/apache/datafusion-ballista/issues/276)
+- \[UI\] Add ability to render query plans [\#275](https://github.com/apache/datafusion-ballista/issues/275)
+- Add REST API documentation to User Guide [\#272](https://github.com/apache/datafusion-ballista/issues/272)
+- Graceful shutdown: Handle `SIGTERM` [\#266](https://github.com/apache/datafusion-ballista/issues/266)
+- \[EPIC\] Scheduler UI [\#265](https://github.com/apache/datafusion-ballista/issues/265)
+- Introduce the datafusion-objectstore-hdfs in datafusion-contrib as an object store feature [\#259](https://github.com/apache/datafusion-ballista/issues/259)
+- Add a feature based object store provider [\#257](https://github.com/apache/datafusion-ballista/issues/257)
+- Add docker build files [\#248](https://github.com/apache/datafusion-ballista/issues/248)
+- Allow IDEs to recognize generated code [\#246](https://github.com/apache/datafusion-ballista/issues/246)
+- Add user guide section on Flight SQL support [\#230](https://github.com/apache/datafusion-ballista/issues/230)
+- `dev/release/README.md` is outdated [\#228](https://github.com/apache/datafusion-ballista/issues/228)
+- Make ShuffleReaderExec output less verbose [\#211](https://github.com/apache/datafusion-ballista/issues/211)
+- Add LaunchMultiTask rpc interface for executor [\#209](https://github.com/apache/datafusion-ballista/issues/209)
+- Make executor fetch shuffle partition data in parallel [\#208](https://github.com/apache/datafusion-ballista/issues/208)
+- Concurrency control and rate limit during shuffle reader [\#195](https://github.com/apache/datafusion-ballista/issues/195)
+- Update User Guide [\#160](https://github.com/apache/datafusion-ballista/issues/160)
+- Ballista 0.8.0 Release [\#159](https://github.com/apache/datafusion-ballista/issues/159)
+- Save encoded execution plan in the ExecutionStage to reduce cost of task serialization and deserialization [\#142](https://github.com/apache/datafusion-ballista/issues/142)
+- Failed task retry [\#140](https://github.com/apache/datafusion-ballista/issues/140)
+- Redefine the executor task slots [\#132](https://github.com/apache/datafusion-ballista/issues/132)
+- Use ArrowFlight bearer token auth to create a session key for FlightSql clients [\#112](https://github.com/apache/datafusion-ballista/issues/112)
+- Leverage Atomic for the in-memory states in Scheduler [\#101](https://github.com/apache/datafusion-ballista/issues/101)
+- Introduce the object stores in datafusion-contrib as optional features [\#87](https://github.com/apache/datafusion-ballista/issues/87)
+- Support multiple paths for ListingTableScanNode [\#75](https://github.com/apache/datafusion-ballista/issues/75)
+- Need clean up intermediate data in Ballista [\#9](https://github.com/apache/datafusion-ballista/issues/9)
+- Ballista does not support external file systems [\#10](https://github.com/apache/datafusion-ballista/issues/10)
+
+**Fixed bugs:**
+
+- Build errors in ./dev/build-ballista-rust.sh [\#407](https://github.com/apache/datafusion-ballista/issues/407)
+- The Ballista Scheduler Dockerfile copies a file that no longer exists [\#402](https://github.com/apache/datafusion-ballista/issues/402)
+- Benchmark q20 fails [\#374](https://github.com/apache/datafusion-ballista/issues/374)
+- Integration tests fail [\#360](https://github.com/apache/datafusion-ballista/issues/360)
+- Helm deploy fails [\#344](https://github.com/apache/datafusion-ballista/issues/344)
+- Executor get stopped unexpected [\#333](https://github.com/apache/datafusion-ballista/issues/333)
+- Executor poll work loop failure [\#311](https://github.com/apache/datafusion-ballista/issues/311)
+- Queries with `LIMIT` are failing with "PhysicalExtensionCodec is not provided" [\#300](https://github.com/apache/datafusion-ballista/issues/300)
+- Schema inference does not work in Ballista-cli with a remote context [\#287](https://github.com/apache/datafusion-ballista/issues/287)
+- There are bugs in the yarn build github misses but break our internal build [\#270](https://github.com/apache/datafusion-ballista/issues/270)
+- Race condition running docker-compose [\#267](https://github.com/apache/datafusion-ballista/issues/267)
+- Scheduler UI not working in Docker image [\#250](https://github.com/apache/datafusion-ballista/issues/250)
+- Use bind host rather than the external host for starting a local executor service [\#244](https://github.com/apache/datafusion-ballista/issues/244)
+- Initial query stages read parquet files and repartition them needlessly [\#243](https://github.com/apache/datafusion-ballista/issues/243)
+- Cannot build Docker images on macOS 12.5.1 with M1 chip [\#234](https://github.com/apache/datafusion-ballista/issues/234)
+- CLI uses DataFusion context if no host or port are provided [\#219](https://github.com/apache/datafusion-ballista/issues/219)
+- Unsupported binary operator `StringConcat` [\#201](https://github.com/apache/datafusion-ballista/issues/201)
+- Ballista assumes all aggregate expressions are not DISTINCT [\#5](https://github.com/apache/datafusion-ballista/issues/5)
+- Start ballista ui with docker, but it can not found ballista scheduler [\#11](https://github.com/apache/datafusion-ballista/issues/11)
+- Cannot build Ballista docker images on Apple silicon [\#17](https://github.com/apache/datafusion-ballista/issues/17)
+
+**Documentation updates:**
+
+- Fixup links in README.md [\#366](https://github.com/apache/datafusion-ballista/pull/366) ([romanz](https://github.com/romanz))
+- Update README in preparation for 0.9.0 release [\#318](https://github.com/apache/datafusion-ballista/pull/318) ([andygrove](https://github.com/andygrove))
+- User Guide improvements [\#274](https://github.com/apache/datafusion-ballista/pull/274) ([andygrove](https://github.com/andygrove))
+
+**Closed issues:**
+
+- Automatic version updates for github actions with dependabot [\#127](https://github.com/apache/datafusion-ballista/issues/127)
+
+**Merged pull requests:**
+
+- Return multiple tasks in poll_work based on free slots [\#429](https://github.com/apache/datafusion-ballista/pull/429) ([Dandandan](https://github.com/Dandandan))
+- Run integration tests as part of release verification script [\#426](https://github.com/apache/datafusion-ballista/pull/426) ([andygrove](https://github.com/andygrove))
+- Bump actions/setup-node from 2 to 3 [\#424](https://github.com/apache/datafusion-ballista/pull/424) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump actions/setup-python from 2 to 4 [\#423](https://github.com/apache/datafusion-ballista/pull/423) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump actions/checkout from 2 to 3 [\#422](https://github.com/apache/datafusion-ballista/pull/422) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump actions/download-artifact from 2 to 3 [\#421](https://github.com/apache/datafusion-ballista/pull/421) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump actions/upload-artifact from 2 to 3 [\#420](https://github.com/apache/datafusion-ballista/pull/420) ([dependabot[bot]](https://github.com/apps/dependabot))
+- MINOR: Fix yarn warnings [\#415](https://github.com/apache/datafusion-ballista/pull/415) ([andygrove](https://github.com/andygrove))
+- Fix q20 sql typo in benchmarks [\#409](https://github.com/apache/datafusion-ballista/pull/409) ([r4ntix](https://github.com/r4ntix))
+- MINOR: Add notes on Apache Reporter [\#401](https://github.com/apache/datafusion-ballista/pull/401) ([andygrove](https://github.com/andygrove))
+- Use local shuffle reader in containerized environments and some impro… [\#399](https://github.com/apache/datafusion-ballista/pull/399) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Make the scheduler event loop buffer size configurable [\#398](https://github.com/apache/datafusion-ballista/pull/398) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add RoundRobinLocal slots policy for caching executor data to avoid seld persistency [\#396](https://github.com/apache/datafusion-ballista/pull/396) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add round robin executor slots reservation policy for the scheduler to evenly assign tasks to executors [\#395](https://github.com/apache/datafusion-ballista/pull/395) ([yahoNanJing](https://github.com/yahoNanJing))
+- Improve launch task efficiency by calling LaunchMultiTask [\#394](https://github.com/apache/datafusion-ballista/pull/394) ([yahoNanJing](https://github.com/yahoNanJing))
+- Cache encoded stage plan [\#393](https://github.com/apache/datafusion-ballista/pull/393) ([yahoNanJing](https://github.com/yahoNanJing))
+- Remove active execution graph when the related job is successful or failed [\#392](https://github.com/apache/datafusion-ballista/pull/392) ([yahoNanJing](https://github.com/yahoNanJing))
+- Update flatbuffers requirement from 2.1.2 to 22.9.29 [\#390](https://github.com/apache/datafusion-ballista/pull/390) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Unified the log level configuration behavior [\#386](https://github.com/apache/datafusion-ballista/pull/386) ([r4ntix](https://github.com/r4ntix))
+- Add DistinctCount support [\#384](https://github.com/apache/datafusion-ballista/pull/384) ([r4ntix](https://github.com/r4ntix))
+- Pull-based execution loop improvements [\#380](https://github.com/apache/datafusion-ballista/pull/380) ([Dandandan](https://github.com/Dandandan))
+- Fix latest commit [\#379](https://github.com/apache/datafusion-ballista/pull/379) ([Dandandan](https://github.com/Dandandan))
+- Avoid calling scheduler when the executor cannot accept new tasks [\#378](https://github.com/apache/datafusion-ballista/pull/378) ([Dandandan](https://github.com/Dandandan))
+- Switch to mimalloc and enable by default in executor [\#370](https://github.com/apache/datafusion-ballista/pull/370) ([Dandandan](https://github.com/Dandandan))
+- Benchmark looks for path with and without extension [\#354](https://github.com/apache/datafusion-ballista/pull/354) ([andygrove](https://github.com/andygrove))
+- Implement job cancellation in UI [\#349](https://github.com/apache/datafusion-ballista/pull/349) ([Dandandan](https://github.com/Dandandan))
+- Using local shuffle reader avoid flight rpc call. [\#347](https://github.com/apache/datafusion-ballista/pull/347) ([Ted-Jiang](https://github.com/Ted-Jiang))
+- Make helm deployable [\#345](https://github.com/apache/datafusion-ballista/pull/345) ([avantgardnerio](https://github.com/avantgardnerio))
+- Benchmark & UI improvements [\#343](https://github.com/apache/datafusion-ballista/pull/343) ([andygrove](https://github.com/andygrove))
+- Add `cancel_job` REST API [\#340](https://github.com/apache/datafusion-ballista/pull/340) ([tfeda](https://github.com/tfeda))
+- Fix labeler [\#337](https://github.com/apache/datafusion-ballista/pull/337) ([andygrove](https://github.com/andygrove))
+- Upgrade to DataFusion 13.0.0 [\#336](https://github.com/apache/datafusion-ballista/pull/336) ([andygrove](https://github.com/andygrove))
+- Check executor id consistency when receive stop executor request [\#335](https://github.com/apache/datafusion-ballista/pull/335) ([yahoNanJing](https://github.com/yahoNanJing))
+- Enable more benchmark serde tests [\#331](https://github.com/apache/datafusion-ballista/pull/331) ([andygrove](https://github.com/andygrove))
+- Downgrade `docker-compose.yaml` to version 3.3 so that we can support Ubuntu 20.04.4 LTS [\#329](https://github.com/apache/datafusion-ballista/pull/329) ([andygrove](https://github.com/andygrove))
+- update labeler [\#326](https://github.com/apache/datafusion-ballista/pull/326) ([andygrove](https://github.com/andygrove))
+- Upgrade to DataFusion 13.0.0-rc1 [\#325](https://github.com/apache/datafusion-ballista/pull/325) ([andygrove](https://github.com/andygrove))
+- Dependabot stop suggesting arrow and datafusion updates [\#324](https://github.com/apache/datafusion-ballista/pull/324) ([andygrove](https://github.com/andygrove))
+- Show job stages metrics [\#323](https://github.com/apache/datafusion-ballista/pull/323) ([onthebridgetonowhere](https://github.com/onthebridgetonowhere))
+- Add helm chart [\#322](https://github.com/apache/datafusion-ballista/pull/322) ([avantgardnerio](https://github.com/avantgardnerio))
+- Atomic support for enhancement [\#319](https://github.com/apache/datafusion-ballista/pull/319) ([metesynnada](https://github.com/metesynnada))
+- Allow automatic schema inference when registering csv [\#313](https://github.com/apache/datafusion-ballista/pull/313) ([r4ntix](https://github.com/r4ntix))
+- Add ability to specify job name and have it show in the job listing page in the UI [\#312](https://github.com/apache/datafusion-ballista/pull/312) ([andygrove](https://github.com/andygrove))
+- Add REST API to generate DOT graph for individual query stage [\#310](https://github.com/apache/datafusion-ballista/pull/310) ([andygrove](https://github.com/andygrove))
+- \[UI\] Use tabbed pane with Queries and Executors tabs [\#309](https://github.com/apache/datafusion-ballista/pull/309) ([andygrove](https://github.com/andygrove))
+- REST API to get query stages [\#305](https://github.com/apache/datafusion-ballista/pull/305) ([andygrove](https://github.com/andygrove))
+- Add support for SortPreservingMergeExec; fix LIMIT bug [\#304](https://github.com/apache/datafusion-ballista/pull/304) ([andygrove](https://github.com/andygrove))
+- Add Python script to run benchmarks [\#302](https://github.com/apache/datafusion-ballista/pull/302) ([andygrove](https://github.com/andygrove))
+- \[UI\] Add ability to view query plans directly in the UI [\#301](https://github.com/apache/datafusion-ballista/pull/301) ([onthebridgetonowhere](https://github.com/onthebridgetonowhere))
+- Update datafusion.proto [\#299](https://github.com/apache/datafusion-ballista/pull/299) ([andygrove](https://github.com/andygrove))
+- Replace function `from_proto_binary_op` from upstream [\#298](https://github.com/apache/datafusion-ballista/pull/298) ([askoa](https://github.com/askoa))
+- Fix dead link in contribution guideline readme file [\#297](https://github.com/apache/datafusion-ballista/pull/297) ([onthebridgetonowhere](https://github.com/onthebridgetonowhere))
+- UI code cleanup [\#291](https://github.com/apache/datafusion-ballista/pull/291) ([KenSuenobu](https://github.com/KenSuenobu))
+- Add support for S3 data sources [\#290](https://github.com/apache/datafusion-ballista/pull/290) ([andygrove](https://github.com/andygrove))
+- Use latest datafusion [\#289](https://github.com/apache/datafusion-ballista/pull/289) ([andygrove](https://github.com/andygrove))
+- Fix documentation example [\#288](https://github.com/apache/datafusion-ballista/pull/288) ([onthebridgetonowhere](https://github.com/onthebridgetonowhere))
+- Improve formatting of job status in UI [\#286](https://github.com/apache/datafusion-ballista/pull/286) ([andygrove](https://github.com/andygrove))
+- Enabled download of dot files from Download icon [\#279](https://github.com/apache/datafusion-ballista/pull/279) ([KenSuenobu](https://github.com/KenSuenobu))
+- Executor graceful shutdown: Handle SIGTERM [\#278](https://github.com/apache/datafusion-ballista/pull/278) ([mingmwang](https://github.com/mingmwang))
+- Also run yarn build to catch JavaScript errors in CI [\#271](https://github.com/apache/datafusion-ballista/pull/271) ([avantgardnerio](https://github.com/avantgardnerio))
+- Store sessions so users can register tables and query them through flight [\#269](https://github.com/apache/datafusion-ballista/pull/269) ([avantgardnerio](https://github.com/avantgardnerio))
+- Fix compose for Ian [\#268](https://github.com/apache/datafusion-ballista/pull/268) ([avantgardnerio](https://github.com/avantgardnerio))
+- Task level retry and Stage level retry [\#261](https://github.com/apache/datafusion-ballista/pull/261) ([mingmwang](https://github.com/mingmwang))
+- Introduce the datafusion-objectstore-hdfs in datafusion-contrib as an object store feature [\#260](https://github.com/apache/datafusion-ballista/pull/260) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add a feature based object store provider [\#258](https://github.com/apache/datafusion-ballista/pull/258) ([yahoNanJing](https://github.com/yahoNanJing))
+- Make fetch shuffle partition data in parallel [\#256](https://github.com/apache/datafusion-ballista/pull/256) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add LaunchMultiTask rpc interface for executor [\#255](https://github.com/apache/datafusion-ballista/pull/255) ([yahoNanJing](https://github.com/yahoNanJing))
+- CLI uses ballista context instead of datafusion context in local mode [\#252](https://github.com/apache/datafusion-ballista/pull/252) ([r4ntix](https://github.com/r4ntix))
+- Fix Scheduler UI in Docker image [\#251](https://github.com/apache/datafusion-ballista/pull/251) ([andygrove](https://github.com/andygrove))
+- Generate into source folder to make IDEs happy [\#247](https://github.com/apache/datafusion-ballista/pull/247) ([avantgardnerio](https://github.com/avantgardnerio))
+- Use bind host rather than the external host for starting a local executor service [\#245](https://github.com/apache/datafusion-ballista/pull/245) ([yahoNanJing](https://github.com/yahoNanJing))
+- Add REST endpoint to get DOT graph of a job [\#242](https://github.com/apache/datafusion-ballista/pull/242) ([andygrove](https://github.com/andygrove))
+- Add list of jobs to scheduler UI [\#241](https://github.com/apache/datafusion-ballista/pull/241) ([andygrove](https://github.com/andygrove))
+- Clean up job data on both Scheduler and Executor [\#188](https://github.com/apache/datafusion-ballista/pull/188) ([mingmwang](https://github.com/mingmwang))
+- Update etcd-client requirement from 0.9 to 0.10 [\#111](https://github.com/apache/datafusion-ballista/pull/111) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump terser from 4.8.0 to 4.8.1 in /ballista/ui/scheduler [\#91](https://github.com/apache/datafusion-ballista/pull/91) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump jsdom from 16.4.0 to 16.7.0 in /ballista/ui/scheduler [\#74](https://github.com/apache/datafusion-ballista/pull/74) ([dependabot[bot]](https://github.com/apps/dependabot))
+- Bump numpy from 1.21.3 to 1.22.0 in /python [\#72](https://github.com/apache/datafusion-ballista/pull/72) ([dependabot[bot]](https://github.com/apps/dependabot))
diff --git a/_sources/changelog/43.0.0.md.txt b/_sources/changelog/43.0.0.md.txt
new file mode 100644
index 000000000..a206322d3
--- /dev/null
+++ b/_sources/changelog/43.0.0.md.txt
@@ -0,0 +1,146 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 43.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/0.12.0...43.0.0-rc2)
+
+**Implemented enhancements:**
+
+- feat: make max message size configurable for gRPC clients [#983](https://github.com/apache/datafusion-ballista/pull/983) (etolbakov)
+- feat: Upgrade to DataFusion 38 [#1048](https://github.com/apache/datafusion-ballista/pull/1048) (andygrove)
+- feat: Upgrade to DataFusion 39.0.0 [#1052](https://github.com/apache/datafusion-ballista/pull/1052) (andygrove)
+- feat: default instance for executor configuration [#1147](https://github.com/apache/datafusion-ballista/pull/1147) (milenkovicm)
+- feat: Expose Ballista Scheduler and Executor in Python [#1148](https://github.com/apache/datafusion-ballista/pull/1148) (milenkovicm)
+- feat: add test to check for `ctx.enable_url_table()` [#1155](https://github.com/apache/datafusion-ballista/pull/1155) (milenkovicm)
+
+**Documentation updates:**
+
+- docs: Add ASF attribution [#973](https://github.com/apache/datafusion-ballista/pull/973) (simicd)
+- Architecture guide [#977](https://github.com/apache/datafusion-ballista/pull/977) (andygrove)
+- docs: enhance the ballista-cli docs [#979](https://github.com/apache/datafusion-ballista/pull/979) (haoxins)
+- docs: update user guide with docker image information [#980](https://github.com/apache/datafusion-ballista/pull/980) (etolbakov)
+- docs: enhance the docs of Ballista client [#985](https://github.com/apache/datafusion-ballista/pull/985) (haoxins)
+- docs: list protoc dependency [#989](https://github.com/apache/datafusion-ballista/pull/989) (davidwilemski)
+- update asf yaml [#1007](https://github.com/apache/datafusion-ballista/pull/1007) (andygrove)
+- docs: Add workflow to publish documentation [#1040](https://github.com/apache/datafusion-ballista/pull/1040) (andygrove)
+- docs: Replace Arrow Ballista with DataFusion Ballista [#1041](https://github.com/apache/datafusion-ballista/pull/1041) (andygrove)
+- Add maintenance status note [#1043](https://github.com/apache/datafusion-ballista/pull/1043) (andygrove)
+- Remove helm from supported code [#1071](https://github.com/apache/datafusion-ballista/pull/1071) (milenkovicm)
+- Remove UI [#1072](https://github.com/apache/datafusion-ballista/pull/1072) (milenkovicm)
+- Remove HDFS support ... [#1073](https://github.com/apache/datafusion-ballista/pull/1073) (milenkovicm)
+- Removed Maintenance Notice [#1094](https://github.com/apache/datafusion-ballista/pull/1094) (tbar4)
+- Update root `README.md` and other documentation with latest changes [#1113](https://github.com/apache/datafusion-ballista/pull/1113) (milenkovicm)
+- docs: Update benchmarks [#1121](https://github.com/apache/datafusion-ballista/pull/1121) (andygrove)
+
+**Merged pull requests:**
+
+- PyBallista - Python SQL client for Ballista [#970](https://github.com/apache/datafusion-ballista/pull/970) (andygrove)
+- docs: Add ASF attribution [#973](https://github.com/apache/datafusion-ballista/pull/973) (simicd)
+- [Python] Add `read_csv` and `read_parquet` methods [#976](https://github.com/apache/datafusion-ballista/pull/976) (andygrove)
+- Architecture guide [#977](https://github.com/apache/datafusion-ballista/pull/977) (andygrove)
+- [Python] Add more methods to SessionContext [#978](https://github.com/apache/datafusion-ballista/pull/978) (andygrove)
+- [Python] Add `execute_logical_plan` to context [#972](https://github.com/apache/datafusion-ballista/pull/972) (andygrove)
+- Use correct product name in docs [#975](https://github.com/apache/datafusion-ballista/pull/975) (andygrove)
+- docs: enhance the ballista-cli docs [#979](https://github.com/apache/datafusion-ballista/pull/979) (haoxins)
+- docs: update user guide with docker image information [#980](https://github.com/apache/datafusion-ballista/pull/980) (etolbakov)
+- Upgrade Rust version to 1.72 to keep the same as DataFusion v35 [#982](https://github.com/apache/datafusion-ballista/pull/982) (haoxins)
+- build: Fix the ballista-cli Dockerfile [#981](https://github.com/apache/datafusion-ballista/pull/981) (haoxins)
+- feat: make max message size configurable for gRPC clients [#983](https://github.com/apache/datafusion-ballista/pull/983) (etolbakov)
+- Remove some hard-coded gRPC max message sizes [#984](https://github.com/apache/datafusion-ballista/pull/984) (andygrove)
+- docs: enhance the docs of Ballista client [#985](https://github.com/apache/datafusion-ballista/pull/985) (haoxins)
+- docs: list protoc dependency [#989](https://github.com/apache/datafusion-ballista/pull/989) (davidwilemski)
+- Fix ExecutorLost event debug info [#988](https://github.com/apache/datafusion-ballista/pull/988) (lewiszlw)
+- Fix shuffle writer test [#998](https://github.com/apache/datafusion-ballista/pull/998) (Jefffrey)
+- Bump graphviz-rust from 0.6.1 to 0.8.0 [#999](https://github.com/apache/datafusion-ballista/pull/999) (Jefffrey)
+- Add rust-toolchain.toml for clarity [#1014](https://github.com/apache/datafusion-ballista/pull/1014) (scnerd)
+- Fix executor metadata decode bug [#1004](https://github.com/apache/datafusion-ballista/pull/1004) (lewiszlw)
+- update asf yaml [#1007](https://github.com/apache/datafusion-ballista/pull/1007) (andygrove)
+- Fix Ballista rust.yml github workflow [#1026](https://github.com/apache/datafusion-ballista/pull/1026) (RaphaelMarinier)
+- Bump datafusion to 36.0.0 and make ballista compatible with it. [#1027](https://github.com/apache/datafusion-ballista/pull/1027) (RaphaelMarinier)
+- Make Ballista compatible with Datafusion 37.0.0 (from 36.0.0) [#1031](https://github.com/apache/datafusion-ballista/pull/1031) (RaphaelMarinier)
+- Fixes Setting Job Name Not Reflected in Ballista UI [#1039](https://github.com/apache/datafusion-ballista/pull/1039) (athultr1997)
+- docs: Add workflow to publish documentation [#1040](https://github.com/apache/datafusion-ballista/pull/1040) (andygrove)
+- [Docs] fix good_first_issue link in the contribution md doc [#1022](https://github.com/apache/datafusion-ballista/pull/1022) (Almaz-KG)
+- docs: Replace Arrow Ballista with DataFusion Ballista [#1041](https://github.com/apache/datafusion-ballista/pull/1041) (andygrove)
+- Fix job hangs when partition count of plan is zero [#1024](https://github.com/apache/datafusion-ballista/pull/1024) (lewiszlw)
+- Add maintenance status note [#1043](https://github.com/apache/datafusion-ballista/pull/1043) (andygrove)
+- Fix cargo build [#1045](https://github.com/apache/datafusion-ballista/pull/1045) (andygrove)
+- fix docker build in CI [#1046](https://github.com/apache/datafusion-ballista/pull/1046) (andygrove)
+- feat: Upgrade to DataFusion 38 [#1048](https://github.com/apache/datafusion-ballista/pull/1048) (andygrove)
+- Bump actions/setup-node from 3 to 4 [#909](https://github.com/apache/datafusion-ballista/pull/909) (dependabot[bot])
+- Bump actions/cache from 3 to 4 [#958](https://github.com/apache/datafusion-ballista/pull/958) (dependabot[bot])
+- feat: Upgrade to DataFusion 39.0.0 [#1052](https://github.com/apache/datafusion-ballista/pull/1052) (andygrove)
+- Update datafusion protobuf definitions [#1057](https://github.com/apache/datafusion-ballista/pull/1057) (palaska)
+- Fix regression with TPC-H benchmark [#1060](https://github.com/apache/datafusion-ballista/pull/1060) (andygrove)
+- Upgrade to Datafusion 41 [#1062](https://github.com/apache/datafusion-ballista/pull/1062) (palaska)
+- Remove helm from supported code [#1071](https://github.com/apache/datafusion-ballista/pull/1071) (milenkovicm)
+- Remove plugin subsystem [#1070](https://github.com/apache/datafusion-ballista/pull/1070) (milenkovicm)
+- Remove CI folder [#1074](https://github.com/apache/datafusion-ballista/pull/1074) (milenkovicm)
+- Code cleanup, move examples, remove unused files [#1075](https://github.com/apache/datafusion-ballista/pull/1075) (milenkovicm)
+- Remove UI [#1072](https://github.com/apache/datafusion-ballista/pull/1072) (milenkovicm)
+- Remove key-value stores for scheduler persistence [#1077](https://github.com/apache/datafusion-ballista/pull/1077) (milenkovicm)
+- Remove cache functionality [#1076](https://github.com/apache/datafusion-ballista/pull/1076) (milenkovicm)
+- Remove HDFS support ... [#1073](https://github.com/apache/datafusion-ballista/pull/1073) (milenkovicm)
+- Reorganise and remove dependencies [#1078](https://github.com/apache/datafusion-ballista/pull/1078) (milenkovicm)
+- Promote keda and flight-sql to optional features [#1079](https://github.com/apache/datafusion-ballista/pull/1079) (milenkovicm)
+- Update to datafusion 42 ... [#1080](https://github.com/apache/datafusion-ballista/pull/1080) (milenkovicm)
+- #1086 solve examples errors [#1087](https://github.com/apache/datafusion-ballista/pull/1087) (tbar4)
+- fix issue with not building python package ... [#1085](https://github.com/apache/datafusion-ballista/pull/1085) (milenkovicm)
+- another round of code cleanup ... [#1089](https://github.com/apache/datafusion-ballista/pull/1089) (milenkovicm)
+- Make rest-api optional feature ... [#1084](https://github.com/apache/datafusion-ballista/pull/1084) (milenkovicm)
+- fix clippy issues after updating to rust 1.82 [#1090](https://github.com/apache/datafusion-ballista/pull/1090) (milenkovicm)
+- Replace BallistaContext with SessionContext [#1088](https://github.com/apache/datafusion-ballista/pull/1088) (milenkovicm)
+- Removed Maintenance Notice [#1094](https://github.com/apache/datafusion-ballista/pull/1094) (tbar4)
+- Ergonomic way to setup/configure `SessionContextExt` [#1096](https://github.com/apache/datafusion-ballista/pull/1096) (milenkovicm)
+- Executor configuration extended .. [#1099](https://github.com/apache/datafusion-ballista/pull/1099) (milenkovicm)
+- fix issue with executor registration ... [#1101](https://github.com/apache/datafusion-ballista/pull/1101) (milenkovicm)
+- Deprecate `BallistaContext` [#1103](https://github.com/apache/datafusion-ballista/pull/1103) (milenkovicm)
+- fix imports after un-rebased PR [#1106](https://github.com/apache/datafusion-ballista/pull/1106) (milenkovicm)
+- Ballista proto cleanup [#1110](https://github.com/apache/datafusion-ballista/pull/1110) (milenkovicm)
+- Update and move deps to workspace [#1109](https://github.com/apache/datafusion-ballista/pull/1109) (milenkovicm)
+- Trim down `BallistaConfig` [#1108](https://github.com/apache/datafusion-ballista/pull/1108) (milenkovicm)
+- Remove build-in object store registry [#1114](https://github.com/apache/datafusion-ballista/pull/1114) (milenkovicm)
+- Update root `README.md` and other documentation with latest changes [#1113](https://github.com/apache/datafusion-ballista/pull/1113) (milenkovicm)
+- support window functions [#1112](https://github.com/apache/datafusion-ballista/pull/1112) (onursatici)
+- added a BallistaContext to ballista to allow for Remote or standalone [#1100](https://github.com/apache/datafusion-ballista/pull/1100) (tbar4)
+- Decommission `BallistaContext` [#1119](https://github.com/apache/datafusion-ballista/pull/1119) (milenkovicm)
+- docs: Update benchmarks [#1121](https://github.com/apache/datafusion-ballista/pull/1121) (andygrove)
+- Make easier to create custom schedulers and executors [#1118](https://github.com/apache/datafusion-ballista/pull/1118) (milenkovicm)
+- refactor: Move BallistaRegistry to better location [#1126](https://github.com/apache/datafusion-ballista/pull/1126) (milenkovicm)
+- refactor: BallistaLogicalExtensionCodec refactoring and improvements [#1127](https://github.com/apache/datafusion-ballista/pull/1127) (milenkovicm)
+- refactor: consolidate ballista tests [#1129](https://github.com/apache/datafusion-ballista/pull/1129) (milenkovicm)
+- refactor: SessionStateExt and SessionConfigExt [#1130](https://github.com/apache/datafusion-ballista/pull/1130) (milenkovicm)
+- chore: dependancy updates [#1131](https://github.com/apache/datafusion-ballista/pull/1131) (milenkovicm)
+- chore: fix warning mimaloc warning when building [#1137](https://github.com/apache/datafusion-ballista/pull/1137) (milenkovicm)
+- refactor: SessionBuilder to return Result<\_> [#1138](https://github.com/apache/datafusion-ballista/pull/1138) (milenkovicm)
+- chore: remove unused cache\_ options from executor [#1140](https://github.com/apache/datafusion-ballista/pull/1140) (milenkovicm)
+- updated maturin version and ccargo build to build yml [#1136](https://github.com/apache/datafusion-ballista/pull/1136) (tbar4)
+- chore: Fix clippy issues after rust update (1.83.0) [#1143](https://github.com/apache/datafusion-ballista/pull/1143) (milenkovicm)
+- Fix documentation example which still uses BallistaContext [#1145](https://github.com/apache/datafusion-ballista/pull/1145) (milenkovicm)
+- Ballista proto cleanup [#1146](https://github.com/apache/datafusion-ballista/pull/1146) (milenkovicm)
+- feat: default instance for executor configuration [#1147](https://github.com/apache/datafusion-ballista/pull/1147) (milenkovicm)
+- feat: Expose Ballista Scheduler and Executor in Python [#1148](https://github.com/apache/datafusion-ballista/pull/1148) (milenkovicm)
+- chore: dependency cleanup [#1150](https://github.com/apache/datafusion-ballista/pull/1150) (milenkovicm)
+- Update DataFusion to 43 [#1125](https://github.com/apache/datafusion-ballista/pull/1125) (Dandandan)
+- Reinstantiate join order optimization [#1122](https://github.com/apache/datafusion-ballista/pull/1122) (Dandandan)
+- add partitioning scheme for unresolved shuffle and shuffle reader exec [#1144](https://github.com/apache/datafusion-ballista/pull/1144) (onursatici)
+- chore: update py-df to 43.1 [#1152](https://github.com/apache/datafusion-ballista/pull/1152) (milenkovicm)
+- chore: no need to run python test in rust [#1154](https://github.com/apache/datafusion-ballista/pull/1154) (milenkovicm)
+- feat: add test to check for `ctx.enable_url_table()` [#1155](https://github.com/apache/datafusion-ballista/pull/1155) (milenkovicm)
diff --git a/_sources/changelog/44.0.0.md.txt b/_sources/changelog/44.0.0.md.txt
new file mode 100644
index 000000000..409717d6c
--- /dev/null
+++ b/_sources/changelog/44.0.0.md.txt
@@ -0,0 +1,56 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 44.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/43.0.0...44.0.0)
+
+**Implemented enhancements:**
+
+- feat: Job notification should emit job status for successful and failed jobs [#1165](https://github.com/apache/datafusion-ballista/pull/1165) (milenkovicm)
+- feat: executor supports pluggable arrow flight server [#1170](https://github.com/apache/datafusion-ballista/pull/1170) (milenkovicm)
+- feat: notify scheduler when a task fails [#1181](https://github.com/apache/datafusion-ballista/pull/1181) (milenkovicm)
+- feat: configure max grpc message size and disable view types in ballista [#1185](https://github.com/apache/datafusion-ballista/pull/1185) (milenkovicm)
+
+**Fixed bugs:**
+
+- fix: do not compile `keda.proto` if feature not used. [#1168](https://github.com/apache/datafusion-ballista/pull/1168) (milenkovicm)
+- fix: rest api `/api/executors` does not show executors if `TaskSchedulingPolicy::PullStaged` [#1175](https://github.com/apache/datafusion-ballista/pull/1175) (milenkovicm)
+
+**Documentation updates:**
+
+- doc: update ballista client front page [#1171](https://github.com/apache/datafusion-ballista/pull/1171) (milenkovicm)
+
+**Merged pull requests:**
+
+- chore: planner cleanup and refactor [#1160](https://github.com/apache/datafusion-ballista/pull/1160) (milenkovicm)
+- feat: Job notification should emit job status for successful and failed jobs [#1165](https://github.com/apache/datafusion-ballista/pull/1165) (milenkovicm)
+- chore: fix executor build issue on release [#1167](https://github.com/apache/datafusion-ballista/pull/1167) (milenkovicm)
+- fix: do not compile `keda.proto` if feature not used. [#1168](https://github.com/apache/datafusion-ballista/pull/1168) (milenkovicm)
+- chore: update to DF.44 [#1153](https://github.com/apache/datafusion-ballista/pull/1153) (milenkovicm)
+- chore: publicly expose datafusion in ballista client [#1169](https://github.com/apache/datafusion-ballista/pull/1169) (milenkovicm)
+- feat: executor supports pluggable arrow flight server [#1170](https://github.com/apache/datafusion-ballista/pull/1170) (milenkovicm)
+- doc: update ballista client front page [#1171](https://github.com/apache/datafusion-ballista/pull/1171) (milenkovicm)
+- fix: rest api `/api/executors` does not show executors if `TaskSchedulingPolicy::PullStaged` [#1175](https://github.com/apache/datafusion-ballista/pull/1175) (milenkovicm)
+- chore: generate change log for 44.0.0 [#1173](https://github.com/apache/datafusion-ballista/pull/1173) (milenkovicm)
+- feat: notify scheduler when a task fails [#1181](https://github.com/apache/datafusion-ballista/pull/1181) (milenkovicm)
+- feat: configure max grpc message size and disable view types in ballista [#1185](https://github.com/apache/datafusion-ballista/pull/1185) (milenkovicm)
+- chore: fix tpch data generator [#1186](https://github.com/apache/datafusion-ballista/pull/1186) (milenkovicm)
+- chore: fix clippy after rust 1.85 update [#1188](https://github.com/apache/datafusion-ballista/pull/1188) (milenkovicm)
+- chore: commit `Cargo.lock` file to make builds more predictable [#1190](https://github.com/apache/datafusion-ballista/pull/1190) (milenkovicm)
diff --git a/_sources/changelog/45.0.0.md.txt b/_sources/changelog/45.0.0.md.txt
new file mode 100644
index 000000000..241144aa1
--- /dev/null
+++ b/_sources/changelog/45.0.0.md.txt
@@ -0,0 +1,45 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 45.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/44.0.0...45.0.0)
+
+**Implemented enhancements:**
+
+- feat: improve executor logs [#1187](https://github.com/apache/datafusion-ballista/pull/1187) (milenkovicm)
+- feat: publish docker containers for executor and scheduler [#1200](https://github.com/apache/datafusion-ballista/pull/1200) (milenkovicm)
+
+**Merged pull requests:**
+
+- chore: minor release script fix [#1192](https://github.com/apache/datafusion-ballista/pull/1192) (andygrove)
+- feat: improve executor logs [#1187](https://github.com/apache/datafusion-ballista/pull/1187) (milenkovicm)
+- chore: update datafusion to v45 [#1176](https://github.com/apache/datafusion-ballista/pull/1176) (milenkovicm)
+- chore: Update changelog for 44.0.0 [#1191](https://github.com/apache/datafusion-ballista/pull/1191) (andygrove)
+- minor: fix repo and homepage url in `cargo.toml` [#1196](https://github.com/apache/datafusion-ballista/pull/1196) (milenkovicm)
+- chore(deps): bump ring from 0.17.11 to 0.17.13 [#1199](https://github.com/apache/datafusion-ballista/pull/1199) (dependabot[bot])
+- feat: publish docker containers for executor and scheduler [#1200](https://github.com/apache/datafusion-ballista/pull/1200) (milenkovicm)
+- minor: make `graphviz-rust` dependency optional [#1203](https://github.com/apache/datafusion-ballista/pull/1203) (milenkovicm)
+- doc: update docker related documentation [#1204](https://github.com/apache/datafusion-ballista/pull/1204) (milenkovicm)
+- chore: update python dependencies [#1197](https://github.com/apache/datafusion-ballista/pull/1197) (milenkovicm)
+- chore(deps): bump ring from 0.17.8 to 0.17.14 in /python [#1206](https://github.com/apache/datafusion-ballista/pull/1206) (dependabot[bot])
+- doc: remove arrow from doc title [#1207](https://github.com/apache/datafusion-ballista/pull/1207) (milenkovicm)
+- Fix unit tests in tpch.rs [#1195](https://github.com/apache/datafusion-ballista/pull/1195) (vmingchen)
+- documentation :: quick-start.md sample source code correction [#1213](https://github.com/apache/datafusion-ballista/pull/1213) (nj7)
+- doc: fix quick-start executor command [#1217](https://github.com/apache/datafusion-ballista/pull/1217) (westhide)
diff --git a/_sources/changelog/46.0.0.md.txt b/_sources/changelog/46.0.0.md.txt
new file mode 100644
index 000000000..f15227474
--- /dev/null
+++ b/_sources/changelog/46.0.0.md.txt
@@ -0,0 +1,58 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 46.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/45.0.0...46.0.0)
+
+**Implemented enhancements:**
+
+- feat: make task distribution policies pluggable [#1243](https://github.com/apache/datafusion-ballista/pull/1243) (milenkovicm)
+- feat: remove flight-sql from scheduler [#1228](https://github.com/apache/datafusion-ballista/pull/1228) (milenkovicm)
+- feat: ballista client collects (few) metrics [#1251](https://github.com/apache/datafusion-ballista/pull/1251) (milenkovicm)
+- feat: make execution_graph.stages() public [#1256](https://github.com/apache/datafusion-ballista/pull/1256) (milenkovicm)
+
+**Fixed bugs:**
+
+- fix: executor can't read s3 config in push-staged mode [#1236](https://github.com/apache/datafusion-ballista/pull/1236) (mmooyyii)
+
+**Merged pull requests:**
+
+- chore: Remove some arrow references [#1232](https://github.com/apache/datafusion-ballista/pull/1232) (andygrove)
+- chore: remove unused executor configuration option [#1229](https://github.com/apache/datafusion-ballista/pull/1229) (milenkovicm)
+- chore: return `404` for api requests if path does not exist [#1224](https://github.com/apache/datafusion-ballista/pull/1224) (milenkovicm)
+- chore(ci): replace `actions-rs` which are deprecated [#1222](https://github.com/apache/datafusion-ballista/pull/1222) (milenkovicm)
+- minor: Decouple `ExecutionGraph` and `DistributedPlanner` [#1221](https://github.com/apache/datafusion-ballista/pull/1221) (milenkovicm)
+- chore: update datafusion to 46 [#1201](https://github.com/apache/datafusion-ballista/pull/1201) (milenkovicm)
+- chore(deps): bump crossbeam-channel from 0.5.14 to 0.5.15 [#1233](https://github.com/apache/datafusion-ballista/pull/1233) (dependabot[bot])
+- chore(deps): bump tokio from 1.44.1 to 1.44.2 [#1234](https://github.com/apache/datafusion-ballista/pull/1234) (dependabot[bot])
+- fix: executor can't read s3 config in push-staged mode [#1236](https://github.com/apache/datafusion-ballista/pull/1236) (mmooyyii)
+- chore: update python deps to 45 [#1240](https://github.com/apache/datafusion-ballista/pull/1240) (milenkovicm)
+- Add S3 object store support to executor and scheduler [#1230](https://github.com/apache/datafusion-ballista/pull/1230) (milenkovicm)
+- feat: make task distribution policies pluggable [#1243](https://github.com/apache/datafusion-ballista/pull/1243) (milenkovicm)
+- chore: reduce log levels for few log statements [#1237](https://github.com/apache/datafusion-ballista/pull/1237) (milenkovicm)
+- chore(deps): bump crossbeam-channel from 0.5.14 to 0.5.15 in /python [#1244](https://github.com/apache/datafusion-ballista/pull/1244) (dependabot[bot])
+- feat: remove flight-sql from scheduler [#1228](https://github.com/apache/datafusion-ballista/pull/1228) (milenkovicm)
+- minor: `executor_shutdown_while_running` test has race condition [#1248](https://github.com/apache/datafusion-ballista/pull/1248) (milenkovicm)
+- bug: build fails with `--no-default-features` [#1255](https://github.com/apache/datafusion-ballista/pull/1255) (milenkovicm)
+- doc: update architectural diagram [#1253](https://github.com/apache/datafusion-ballista/pull/1253) (milenkovicm)
+- feat: ballista client collects (few) metrics [#1251](https://github.com/apache/datafusion-ballista/pull/1251) (milenkovicm)
+- chore: add read/write roundtrip tests [#1249](https://github.com/apache/datafusion-ballista/pull/1249) (milenkovicm)
+- minor: change log level for object store creation [#1247](https://github.com/apache/datafusion-ballista/pull/1247) (milenkovicm)
+- feat: make execution_graph.stages() public [#1256](https://github.com/apache/datafusion-ballista/pull/1256) (milenkovicm)
diff --git a/_sources/changelog/47.0.0.md.txt b/_sources/changelog/47.0.0.md.txt
new file mode 100644
index 000000000..413b235d7
--- /dev/null
+++ b/_sources/changelog/47.0.0.md.txt
@@ -0,0 +1,48 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 47.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/46.0.0...47.0.0)
+
+**Implemented enhancements:**
+
+- feat: expose submit and cancel job methods as public in scheduler [#1260](https://github.com/apache/datafusion-ballista/pull/1260) (milenkovicm)
+- feat: split scheduler gprc creation [#1261](https://github.com/apache/datafusion-ballista/pull/1261) (milenkovicm)
+- feat: expose cluster state notifications [#1263](https://github.com/apache/datafusion-ballista/pull/1263) (milenkovicm)
+- feat: remove `ClusterStorageConfig` as it is redundant [#1265](https://github.com/apache/datafusion-ballista/pull/1265) (milenkovicm)
+- feat: disable task stage plan binary cache [#1266](https://github.com/apache/datafusion-ballista/pull/1266) (milenkovicm)
+- feat: `ClusterState` does not cache session contexts [#1226](https://github.com/apache/datafusion-ballista/pull/1226) (milenkovicm)
+
+**Fixed bugs:**
+
+- fix: clippy issue after rust update to 1.87 [#1262](https://github.com/apache/datafusion-ballista/pull/1262) (milenkovicm)
+- fix: fix tests failing on windows [#1273](https://github.com/apache/datafusion-ballista/pull/1273) (Huy1Ng)
+
+**Merged pull requests:**
+
+- fix: clippy issue after rust update to 1.87 [#1262](https://github.com/apache/datafusion-ballista/pull/1262) (milenkovicm)
+- feat: expose submit and cancel job methods as public in scheduler [#1260](https://github.com/apache/datafusion-ballista/pull/1260) (milenkovicm)
+- feat: split scheduler gprc creation [#1261](https://github.com/apache/datafusion-ballista/pull/1261) (milenkovicm)
+- feat: expose cluster state notifications [#1263](https://github.com/apache/datafusion-ballista/pull/1263) (milenkovicm)
+- minor: release docker on when release has been tagged [#1264](https://github.com/apache/datafusion-ballista/pull/1264) (milenkovicm)
+- feat: remove `ClusterStorageConfig` as it is redundant [#1265](https://github.com/apache/datafusion-ballista/pull/1265) (milenkovicm)
+- feat: disable task stage plan binary cache [#1266](https://github.com/apache/datafusion-ballista/pull/1266) (milenkovicm)
+- feat: `ClusterState` does not cache session contexts [#1226](https://github.com/apache/datafusion-ballista/pull/1226) (milenkovicm)
+- chore(deps): update to datafusion 47.0.0 [#1250](https://github.com/apache/datafusion-ballista/pull/1250) (milenkovicm)
diff --git a/_sources/changelog/48.0.0.md.txt b/_sources/changelog/48.0.0.md.txt
new file mode 100644
index 000000000..4e1e1ce6b
--- /dev/null
+++ b/_sources/changelog/48.0.0.md.txt
@@ -0,0 +1,44 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 48.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/47.0.0...48.0.0)
+
+**Fixed bugs:**
+
+- fix: devcontainer protoc:1 feature url [#1278](https://github.com/apache/datafusion-ballista/pull/1278) (Almaz-KG)
+- fix: change code to support rust 2024 [#1283](https://github.com/apache/datafusion-ballista/pull/1283) (milenkovicm)
+- fix: remove configure_me [#1282](https://github.com/apache/datafusion-ballista/pull/1282) (milenkovicm)
+
+**Documentation updates:**
+
+- chore: update datafusion to 48 [#1270](https://github.com/apache/datafusion-ballista/pull/1270) (milenkovicm)
+- docs: Apply method chaining in example [#1276](https://github.com/apache/datafusion-ballista/pull/1276) (0ne-stone)
+
+**Merged pull requests:**
+
+- chore: update datafusion to 48 [#1270](https://github.com/apache/datafusion-ballista/pull/1270) (milenkovicm)
+- docs: Apply method chaining in example [#1276](https://github.com/apache/datafusion-ballista/pull/1276) (0ne-stone)
+- fix: devcontainer protoc:1 feature url [#1278](https://github.com/apache/datafusion-ballista/pull/1278) (Almaz-KG)
+- improve rust workflows without cache [#1275](https://github.com/apache/datafusion-ballista/pull/1275) (Huy1Ng)
+- fix: change code to support rust 2024 [#1283](https://github.com/apache/datafusion-ballista/pull/1283) (milenkovicm)
+- fix: remove configure_me [#1282](https://github.com/apache/datafusion-ballista/pull/1282) (milenkovicm)
+- chore: update python module to latest ballista release (v.47) [#1279](https://github.com/apache/datafusion-ballista/pull/1279) (milenkovicm)
+- chore: update datafusion to 48.0.1 [#1284](https://github.com/apache/datafusion-ballista/pull/1284) (milenkovicm)
diff --git a/_sources/changelog/49.0.0.md.txt b/_sources/changelog/49.0.0.md.txt
new file mode 100644
index 000000000..770f5f9f6
--- /dev/null
+++ b/_sources/changelog/49.0.0.md.txt
@@ -0,0 +1,58 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 49.0.0 Changelog
+
+[Full Changelog](https://github.com/apache/datafusion-ballista/compare/48.0.0...49.0.0)
+
+**Implemented enhancements:**
+
+- feat: Feat force shuffle reader to read all files using arrow flight client [#1310](https://github.com/apache/datafusion-ballista/pull/1310) (milenkovicm)
+- feat: implement job data cleanup in pull-staged strategy #1219 [#1314](https://github.com/apache/datafusion-ballista/pull/1314) (KR-bluejay)
+
+**Fixed bugs:**
+
+- fix: fail job in case of serde error (pull-mode) [#1297](https://github.com/apache/datafusion-ballista/pull/1297) (milenkovicm)
+- fix: Ensure stage-level sort requirements are enforced in distributed planning [#1306](https://github.com/apache/datafusion-ballista/pull/1306) (metegenez)
+- fix: `UnresolvedShuffleExec` should support `with_new_children` [#1300](https://github.com/apache/datafusion-ballista/pull/1300) (milenkovicm)
+- fix: `ShuffleReader` should return statistics [#1302](https://github.com/apache/datafusion-ballista/pull/1302) (milenkovicm)
+- fix: Disable CollectLeft join as it is broken in ballista [#1301](https://github.com/apache/datafusion-ballista/pull/1301) (milenkovicm)
+- fix: Issue with JoinSelection and NestedLoopJoin::swap_inputs when stage is resolved [#1307](https://github.com/apache/datafusion-ballista/pull/1307) (milenkovicm)
+
+**Merged pull requests:**
+
+- chore: update datafusion to 49 [#1285](https://github.com/apache/datafusion-ballista/pull/1285) (milenkovicm)
+- chore: Improve GitHub actions/python workflows [#1289](https://github.com/apache/datafusion-ballista/pull/1289) (Huy1Ng)
+- chore: update datafusion to 49.0.2 [#1298](https://github.com/apache/datafusion-ballista/pull/1298) (milenkovicm)
+- minor: make shuffle exec display consistent [#1299](https://github.com/apache/datafusion-ballista/pull/1299) (milenkovicm)
+- fix: fail job in case of serde error (pull-mode) [#1297](https://github.com/apache/datafusion-ballista/pull/1297) (milenkovicm)
+- fix: Ensure stage-level sort requirements are enforced in distributed planning [#1306](https://github.com/apache/datafusion-ballista/pull/1306) (metegenez)
+- fix: `UnresolvedShuffleExec` should support `with_new_children` [#1300](https://github.com/apache/datafusion-ballista/pull/1300) (milenkovicm)
+- fix: `ShuffleReader` should return statistics [#1302](https://github.com/apache/datafusion-ballista/pull/1302) (milenkovicm)
+- fix: Disable CollectLeft join as it is broken in ballista [#1301](https://github.com/apache/datafusion-ballista/pull/1301) (milenkovicm)
+- chore: notice and cargo deps cleanup [#1295](https://github.com/apache/datafusion-ballista/pull/1295) (milenkovicm)
+- chore(deps): bump tracing-subscriber from 0.3.19 to 0.3.20 [#1303](https://github.com/apache/datafusion-ballista/pull/1303) (dependabot[bot])
+- chore(deps): bump tracing-subscriber from 0.3.19 to 0.3.20 in /python [#1308](https://github.com/apache/datafusion-ballista/pull/1308) (dependabot[bot])
+- refactor: expand ClusterEventSender visibility to public [#1312](https://github.com/apache/datafusion-ballista/pull/1312) (Th824)
+- fix: Issue with JoinSelection and NestedLoopJoin::swap_inputs when stage is resolved [#1307](https://github.com/apache/datafusion-ballista/pull/1307) (milenkovicm)
+- minor: enable json write test [#1311](https://github.com/apache/datafusion-ballista/pull/1311) (milenkovicm)
+- feat: Feat force shuffle reader to read all files using arrow flight client [#1310](https://github.com/apache/datafusion-ballista/pull/1310) (milenkovicm)
+- feat: implement job data cleanup in pull-staged strategy #1219 [#1314](https://github.com/apache/datafusion-ballista/pull/1314) (KR-bluejay)
+- feat: Improve Remote Shuffle Read Speed and Resource Utilisation [#1318](https://github.com/apache/datafusion-ballista/pull/1318) (milenkovicm)
+- fix: Issue with `JoinSelection` and `CrossJoinExec` when stages have been resoled [#1322](https://github.com/apache/datafusion-ballista/pull/1322) (ZihuanLing)
diff --git a/_sources/changelog/50.0.0.md.txt b/_sources/changelog/50.0.0.md.txt
new file mode 100644
index 000000000..cbae10092
--- /dev/null
+++ b/_sources/changelog/50.0.0.md.txt
@@ -0,0 +1,46 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 50.0.0 Changelog
+
+**Implemented enhancements:**
+
+- feat: make gRPC timeout configurations user-configurable [#1337](https://github.com/apache/datafusion-ballista/pull/1337) (CuteChuanChuan)
+
+**Fixed bugs:**
+
+- fix: update REST API route syntax for axum 0.8 compatibility [#1330](https://github.com/apache/datafusion-ballista/pull/1330) (tomsanbear)
+- fix: Executor does not panic if using unwritable work dir [#1332](https://github.com/apache/datafusion-ballista/pull/1332) (mach-kernel)
+- fix: failing documentation [#1339](https://github.com/apache/datafusion-ballista/pull/1339) (milenkovicm)
+
+**Merged pull requests:**
+
+- infra: macos-13 is deprecated [#1324](https://github.com/apache/datafusion-ballista/pull/1324) (kevinjqliu)
+- chore: update to datafusion v50 [#1320](https://github.com/apache/datafusion-ballista/pull/1320) (milenkovicm)
+- chore: Update datafusion to 50.2 [#1326](https://github.com/apache/datafusion-ballista/pull/1326) (milenkovicm)
+- document private items and update docs CI [#1327](https://github.com/apache/datafusion-ballista/pull/1327) (killzoner)
+- fix: update REST API route syntax for axum 0.8 compatibility [#1330](https://github.com/apache/datafusion-ballista/pull/1330) (tomsanbear)
+- add msrvcheck [#1328](https://github.com/apache/datafusion-ballista/pull/1328) (killzoner)
+- fix: Executor does not panic if using unwritable work dir [#1332](https://github.com/apache/datafusion-ballista/pull/1332) (mach-kernel)
+- chore: Pinning versions of external actions. [#1334](https://github.com/apache/datafusion-ballista/pull/1334) (samueleresca)
+- chore: update python deps to 49 [#1335](https://github.com/apache/datafusion-ballista/pull/1335) (milenkovicm)
+- chore: update datafusion to 50.3 [#1336](https://github.com/apache/datafusion-ballista/pull/1336) (milenkovicm)
+- fix: failing documentation [#1339](https://github.com/apache/datafusion-ballista/pull/1339) (milenkovicm)
+- feat: make gRPC timeout configurations user-configurable [#1337](https://github.com/apache/datafusion-ballista/pull/1337) (CuteChuanChuan)
+- minor: change log level [#1340](https://github.com/apache/datafusion-ballista/pull/1340) (milenkovicm)
diff --git a/_sources/changelog/51.0.0.md.txt b/_sources/changelog/51.0.0.md.txt
new file mode 100644
index 000000000..a6b125d48
--- /dev/null
+++ b/_sources/changelog/51.0.0.md.txt
@@ -0,0 +1,45 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 51.0.0 Changelog
+
+**Implemented enhancements:**
+
+- feat: Support distributed plan in `EXPLAIN` command [#1309](https://github.com/apache/datafusion-ballista/pull/1309) (danielhumanmod)
+- feat: update rust edition to 2024 [#1355](https://github.com/apache/datafusion-ballista/pull/1355) (killzoner)
+- feat: capture more metrics in distributed_query [#1353](https://github.com/apache/datafusion-ballista/pull/1353) (PhVHoang)
+- feat: Bump docker rust to `rust:1.92-trixie` [#1365](https://github.com/apache/datafusion-ballista/pull/1365) (mattcuento)
+- feat: Scheduler supports `substrait` logical plan and remove deprecated `sql` support [#1360](https://github.com/apache/datafusion-ballista/pull/1360) (mattcuento)
+
+**Merged pull requests:**
+
+- minor: minor changes to release script/docs [#1342](https://github.com/apache/datafusion-ballista/pull/1342) (andygrove)
+- feat: Support distributed plan in `EXPLAIN` command [#1309](https://github.com/apache/datafusion-ballista/pull/1309) (danielhumanmod)
+- chore: update datafusion to 51.0 [#1345](https://github.com/apache/datafusion-ballista/pull/1345) (danielhumanmod)
+- doc: Add a note that datafusion may need to be downgraded after installing it [#1348](https://github.com/apache/datafusion-ballista/pull/1348) (martin-g)
+- minor: Make `DisplayAs` consistent and more readable for ShuffleExec [#1347](https://github.com/apache/datafusion-ballista/pull/1347) (milenkovicm)
+- minor: remove unnecessary clone functions [#1352](https://github.com/apache/datafusion-ballista/pull/1352) (mmooyyii)
+- feat: update rust edition to 2024 [#1355](https://github.com/apache/datafusion-ballista/pull/1355) (killzoner)
+- chore(doc): Clean up deployment docs. [#1354](https://github.com/apache/datafusion-ballista/pull/1354) (LouisBurke)
+- feat: capture more metrics in distributed_query [#1353](https://github.com/apache/datafusion-ballista/pull/1353) (PhVHoang)
+- doc: Fix plan translation example to use correct aggregation and column [#1362](https://github.com/apache/datafusion-ballista/pull/1362) (mattcuento)
+- chore: update ballista version to 51.0.0 (from 50.0.0) [#1363](https://github.com/apache/datafusion-ballista/pull/1363) (milenkovicm)
+- feat: Bump docker rust to `rust:1.92-trixie` [#1365](https://github.com/apache/datafusion-ballista/pull/1365) (mattcuento)
+- chore: Add missing public API documentation/comments [#1364](https://github.com/apache/datafusion-ballista/pull/1364) (killzoner)
+- feat: Scheduler supports `substrait` logical plan and remove deprecated `sql` support [#1360](https://github.com/apache/datafusion-ballista/pull/1360) (mattcuento)
diff --git a/_sources/changelog/52.0.0.md.txt b/_sources/changelog/52.0.0.md.txt
new file mode 100644
index 000000000..eed5a1007
--- /dev/null
+++ b/_sources/changelog/52.0.0.md.txt
@@ -0,0 +1,92 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 52.0.0 Changelog
+
+**Performance related:**
+
+- perf: optimize shuffle writer with buffered I/O and fix file size bug [#1386](https://github.com/apache/datafusion-ballista/pull/1386) (andygrove)
+
+**Implemented enhancements:**
+
+- feat: add config option for skipping arrow ipc read validation [#1374](https://github.com/apache/datafusion-ballista/pull/1374) (killzoner)
+- feat: improve tpch benchmark CLI [#1391](https://github.com/apache/datafusion-ballista/pull/1391) (andygrove)
+- feat: Add sort-based shuffle implementation [#1389](https://github.com/apache/datafusion-ballista/pull/1389) (andygrove)
+- feat: New ballista python interface [#1338](https://github.com/apache/datafusion-ballista/pull/1338) (milenkovicm)
+- feat: Add batch coalescing ability to shuffle reader exec [#1380](https://github.com/apache/datafusion-ballista/pull/1380) (danielhumanmod)
+- feat: Add arrow flight proxy to scheduler [#1351](https://github.com/apache/datafusion-ballista/pull/1351) (sebbegg)
+- feat: Creating SubstraitSchedulerClient and standalone Substrait examples [#1376](https://github.com/apache/datafusion-ballista/pull/1376) (mattcuento)
+- feat: Cluster RPC customisations to support TLS and custom headers [#1400](https://github.com/apache/datafusion-ballista/pull/1400) (phillipleblanc)
+- feat: add -c config override flag to tpch benchmark [#1435](https://github.com/apache/datafusion-ballista/pull/1435) (andygrove)
+- feat: Extract `execution_graph` to a trait [#1361](https://github.com/apache/datafusion-ballista/pull/1361) (milenkovicm)
+- feat: Add spark-compat mode to integrate datafusion-spark features au… [#1416](https://github.com/apache/datafusion-ballista/pull/1416) (mattcuento)
+- feat: add `Dataframe.cache()` factory (no planner handling) [#1420](https://github.com/apache/datafusion-ballista/pull/1420) (killzoner)
+- feat: Adaptive query execution (AQE) planner fundamentals [#1372](https://github.com/apache/datafusion-ballista/pull/1372) (milenkovicm)
+- feat: Make push scheduling policy default as it has lower latency [#1461](https://github.com/apache/datafusion-ballista/pull/1461) (milenkovicm)
+- feat: job scheduling with push based job status updates [#1478](https://github.com/apache/datafusion-ballista/pull/1478) (milenkovicm)
+
+**Fixed bugs:**
+
+- fix: compile issue after unsuccessful merge [#1402](https://github.com/apache/datafusion-ballista/pull/1402) (milenkovicm)
+- fix: prost build keda and TLS RPC example [#1429](https://github.com/apache/datafusion-ballista/pull/1429) (killzoner)
+- fix: remove `scheduler_config_spec.toml` as it is unused [#1462](https://github.com/apache/datafusion-ballista/pull/1462) (milenkovicm)
+- fix: Don't use `maxrows` as a "fetched rows" but calculate it from the batches [#1480](https://github.com/apache/datafusion-ballista/pull/1480) (martin-g)
+
+**Documentation updates:**
+
+- docs: fix outdated content in documentation [#1385](https://github.com/apache/datafusion-ballista/pull/1385) (andygrove)
+- docs: use tpchgen-rs for TPC-H data generation [#1390](https://github.com/apache/datafusion-ballista/pull/1390) (andygrove)
+- docs: add Jupyter notebook support documentation [#1399](https://github.com/apache/datafusion-ballista/pull/1399) (andygrove)
+- chore: Document ballista features in README.md [#1418](https://github.com/apache/datafusion-ballista/pull/1418) (mattcuento)
+
+**Merged pull requests:**
+
+- feat: add config option for skipping arrow ipc read validation [#1374](https://github.com/apache/datafusion-ballista/pull/1374) (killzoner)
+- docs: fix outdated content in documentation [#1385](https://github.com/apache/datafusion-ballista/pull/1385) (andygrove)
+- restrict python CI to python directory [#1383](https://github.com/apache/datafusion-ballista/pull/1383) (Huy1Ng)
+- perf: optimize shuffle writer with buffered I/O and fix file size bug [#1386](https://github.com/apache/datafusion-ballista/pull/1386) (andygrove)
+- docs: use tpchgen-rs for TPC-H data generation [#1390](https://github.com/apache/datafusion-ballista/pull/1390) (andygrove)
+- feat: improve tpch benchmark CLI [#1391](https://github.com/apache/datafusion-ballista/pull/1391) (andygrove)
+- doc: Add Ballista extensions example to the docs. [#1382](https://github.com/apache/datafusion-ballista/pull/1382) (LouisBurke)
+- feat: Add sort-based shuffle implementation [#1389](https://github.com/apache/datafusion-ballista/pull/1389) (andygrove)
+- feat: New ballista python interface [#1338](https://github.com/apache/datafusion-ballista/pull/1338) (milenkovicm)
+- doc: add more details for protobuf extension [#1393](https://github.com/apache/datafusion-ballista/pull/1393) (LouisBurke)
+- feat: Add batch coalescing ability to shuffle reader exec [#1380](https://github.com/apache/datafusion-ballista/pull/1380) (danielhumanmod)
+- docs: add Jupyter notebook support documentation [#1399](https://github.com/apache/datafusion-ballista/pull/1399) (andygrove)
+- feat: Add arrow flight proxy to scheduler [#1351](https://github.com/apache/datafusion-ballista/pull/1351) (sebbegg)
+- chore: update datafusion to 52 [#1394](https://github.com/apache/datafusion-ballista/pull/1394) (killzoner)
+- feat: Creating SubstraitSchedulerClient and standalone Substrait examples [#1376](https://github.com/apache/datafusion-ballista/pull/1376) (mattcuento)
+- fix: compile issue after unsuccessful merge [#1402](https://github.com/apache/datafusion-ballista/pull/1402) (milenkovicm)
+- feat: Cluster RPC customisations to support TLS and custom headers [#1400](https://github.com/apache/datafusion-ballista/pull/1400) (phillipleblanc)
+- chore: Document ballista features in README.md [#1418](https://github.com/apache/datafusion-ballista/pull/1418) (mattcuento)
+- fix: prost build keda and TLS RPC example [#1429](https://github.com/apache/datafusion-ballista/pull/1429) (killzoner)
+- Improve sort-based shuffle: single spill file per partition and batch coalescing [#1431](https://github.com/apache/datafusion-ballista/pull/1431) (andygrove)
+- feat: add -c config override flag to tpch benchmark [#1435](https://github.com/apache/datafusion-ballista/pull/1435) (andygrove)
+- feat: Extract `execution_graph` to a trait [#1361](https://github.com/apache/datafusion-ballista/pull/1361) (milenkovicm)
+- chore: add confirmation before tarball is released [#1445](https://github.com/apache/datafusion-ballista/pull/1445) (milenkovicm)
+- minor: add test to cover IPC arrow file read [#1450](https://github.com/apache/datafusion-ballista/pull/1450) (milenkovicm)
+- feat: Add spark-compat mode to integrate datafusion-spark features au… [#1416](https://github.com/apache/datafusion-ballista/pull/1416) (mattcuento)
+- feat: add `Dataframe.cache()` factory (no planner handling) [#1420](https://github.com/apache/datafusion-ballista/pull/1420) (killzoner)
+- fix: remove `scheduler_config_spec.toml` as it is unused [#1462](https://github.com/apache/datafusion-ballista/pull/1462) (milenkovicm)
+- feat: Adaptive query execution (AQE) planner fundamentals [#1372](https://github.com/apache/datafusion-ballista/pull/1372) (milenkovicm)
+- feat: Make push scheduling policy default as it has lower latency [#1461](https://github.com/apache/datafusion-ballista/pull/1461) (milenkovicm)
+- minor: improve log statements [#1482](https://github.com/apache/datafusion-ballista/pull/1482) (milenkovicm)
+- chore: update datafusion to 52.2 and other deps to latest [#1483](https://github.com/apache/datafusion-ballista/pull/1483) (milenkovicm)
+- fix: Don't use `maxrows` as a "fetched rows" but calculate it from the batches [#1480](https://github.com/apache/datafusion-ballista/pull/1480) (martin-g)
+- feat: job scheduling with push based job status updates [#1478](https://github.com/apache/datafusion-ballista/pull/1478) (milenkovicm)
diff --git a/_sources/changelog/53.0.0.md.txt b/_sources/changelog/53.0.0.md.txt
new file mode 100644
index 000000000..94a5bd1c2
--- /dev/null
+++ b/_sources/changelog/53.0.0.md.txt
@@ -0,0 +1,233 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Apache DataFusion Ballista 53.0.0 Changelog
+
+This release consists of 174 commits from 16 contributors. See credits at the end of this changelog for more information.
+
+**Fixed bugs:**
+
+- fix: remove unwrap from executor and improve task error handling [#1540](https://github.com/apache/datafusion-ballista/pull/1540) (eachsaj)
+- fix: handle None task slot in update_task_info after executor lost [#1523](https://github.com/apache/datafusion-ballista/pull/1523) (milenkovicm)
+- fix: [Python] serialize optimized logical plan to fix subquery support [#1586](https://github.com/apache/datafusion-ballista/pull/1586) (andygrove)
+- fix: allow S3 access without explicit credentials [#1584](https://github.com/apache/datafusion-ballista/pull/1584) (andygrove)
+- fix: route collect/show/to_pandas through Ballista cluster [#1585](https://github.com/apache/datafusion-ballista/pull/1585) (andygrove)
+- fix: propagate session config from Python client to Ballista cluster [#1592](https://github.com/apache/datafusion-ballista/pull/1592) (andygrove)
+- fix(python): ignore ballista-namespaced cluster_config keys locally [#1613](https://github.com/apache/datafusion-ballista/pull/1613) (andygrove)
+- fix: `df.write_` fix as it was broken after update [#1625](https://github.com/apache/datafusion-ballista/pull/1625) (milenkovicm)
+- fix(rest): remove unwrap and return 404 if executor does not exist [#1628](https://github.com/apache/datafusion-ballista/pull/1628) (milenkovicm)
+- fix(metrics): avoid stage metrics inflation by tracking partition snapshots [#1652](https://github.com/apache/datafusion-ballista/pull/1652) (danielhumanmod)
+- fix: compilation issue after merge [#1658](https://github.com/apache/datafusion-ballista/pull/1658) (milenkovicm)
+- fix: rest api calculates stage running time correctly [#1675](https://github.com/apache/datafusion-ballista/pull/1675) (milenkovicm)
+- fix: REST API does not show running jobs [#1703](https://github.com/apache/datafusion-ballista/pull/1703) (gittihub-jpg)
+- fix: no executor warning, correct prometheus feature name in TUI [#1698](https://github.com/apache/datafusion-ballista/pull/1698) (killzoner)
+
+**Implemented enhancements:**
+
+- [REST]: Cancelling a completed/failed job should return "false" [#1494](https://github.com/apache/datafusion-ballista/pull/1494) (martin-g)
+- feat: Add plain "status" field to the JobResponse [#1497](https://github.com/apache/datafusion-ballista/pull/1497) (martin-g)
+- feat: Expose Logical and Physical plan details in the REST API [#1498](https://github.com/apache/datafusion-ballista/pull/1498) (milenkovicm)
+- feat: (remote) shuffle reader cleanup [#1503](https://github.com/apache/datafusion-ballista/pull/1503) (milenkovicm)
+- feat: enable scheduler rest api by default [#1506](https://github.com/apache/datafusion-ballista/pull/1506) (milenkovicm)
+- feat: [REST] Return the job's start and end times [#1511](https://github.com/apache/datafusion-ballista/pull/1511) (martin-g)
+- feat: remove hash policy task distribution as not used [#1526](https://github.com/apache/datafusion-ballista/pull/1526) (eachsaj)
+- feat: remove full path from partition locations [#1527](https://github.com/apache/datafusion-ballista/pull/1527) (milenkovicm)
+- feat: add config to ExecutorEngine::create_query_stage_exec [#1542](https://github.com/apache/datafusion-ballista/pull/1542) (milenkovicm)
+- feat: Improve REST API adding task related info to job stages [#1543](https://github.com/apache/datafusion-ballista/pull/1543) (milenkovicm)
+- feat: Ballista Text User Interface [#1436](https://github.com/apache/datafusion-ballista/pull/1436) (martin-g)
+- feat: jupyter notebook support [#1513](https://github.com/apache/datafusion-ballista/pull/1513) (sandugood)
+- feat: ExecutionEngine::create_query_stage_exec accepts partition_id [#1556](https://github.com/apache/datafusion-ballista/pull/1556) (milenkovicm)
+- feat: make ballista client retry policy configurable [#1577](https://github.com/apache/datafusion-ballista/pull/1577) (eachsaj)
+- feat: Executor system & process metrics reporting [#1547](https://github.com/apache/datafusion-ballista/pull/1547) (sandugood)
+- feat: Scheduler config update [#1597](https://github.com/apache/datafusion-ballista/pull/1597) (sandugood)
+- feat: Support `EXPLAIN ANALYZE` in Ballista [#1567](https://github.com/apache/datafusion-ballista/pull/1567) (danielhumanmod)
+- feat: Add standalone shuffle writer benchmark that shuffles real Parquet input [#1600](https://github.com/apache/datafusion-ballista/pull/1600) (andygrove)
+- feat: defer sort-shuffle materialization with interleave_record_batch [#1598](https://github.com/apache/datafusion-ballista/pull/1598) (andygrove)
+- feat(executor): bound executor memory via --memory-pool-size [#1624](https://github.com/apache/datafusion-ballista/pull/1624) (andygrove)
+- feat(bench): show TPC-H query timings in seconds and add total time [#1641](https://github.com/apache/datafusion-ballista/pull/1641) (andygrove)
+- feat(aqe): Support sort-based shuffle writer in AQE [#1640](https://github.com/apache/datafusion-ballista/pull/1640) (danielhumanmod)
+- feat: rest api supports plan tree rendering [#1650](https://github.com/apache/datafusion-ballista/pull/1650) (sandugood)
+- feat: Cache ballista clients on executor [#1578](https://github.com/apache/datafusion-ballista/pull/1578) (milenkovicm)
+- feat(aqe): Lazy stage evaluation in AQE [#1649](https://github.com/apache/datafusion-ballista/pull/1649) (milenkovicm)
+- feat: move shuffle writer disk I/O off tokio worker threads [#1537](https://github.com/apache/datafusion-ballista/pull/1537) (hcrosse)
+- feat(scheduler): broadcast-style hash join for small-side joins [#1647](https://github.com/apache/datafusion-ballista/pull/1647) (andygrove)
+- feat: default to sort-merge join [#1651](https://github.com/apache/datafusion-ballista/pull/1651) (andygrove)
+- feat: TUI shows running job information [#1717](https://github.com/apache/datafusion-ballista/pull/1717) (milenkovicm)
+- feat(aqe): CoalescePartitionsRule — shuffle-partition coalescing on resolved stats [#1684](https://github.com/apache/datafusion-ballista/pull/1684) (metegenez)
+- feat: TUI make task popup scrollable [#1725](https://github.com/apache/datafusion-ballista/pull/1725) (milenkovicm)
+- feat(tui): Use separate areas for the table and its associated scrollbar [#1729](https://github.com/apache/datafusion-ballista/pull/1729) (martin-g)
+
+**Documentation updates:**
+
+- docs: document hash-based and sort-based shuffle implementations [#1595](https://github.com/apache/datafusion-ballista/pull/1595) (andygrove)
+- docs: improve Python documentation structure [#1579](https://github.com/apache/datafusion-ballista/pull/1579) (andygrove)
+- docs: add Python client build-from-source section to contributor guide [#1620](https://github.com/apache/datafusion-ballista/pull/1620) (andygrove)
+- chore: remove NYC Taxi benchmark [#1644](https://github.com/apache/datafusion-ballista/pull/1644) (andygrove)
+- docs: document experimental Adaptive Query Execution in tuning guide [#1645](https://github.com/apache/datafusion-ballista/pull/1645) (andygrove)
+- build(bench): rework docker-compose TPC-H stack [#1646](https://github.com/apache/datafusion-ballista/pull/1646) (andygrove)
+- docs: add Ballista TUI documentation [#1593](https://github.com/apache/datafusion-ballista/pull/1593) (goingforstudying-ctrl)
+- [TUI] Show executor's details in a popup [#1670](https://github.com/apache/datafusion-ballista/pull/1670) (martin-g)
+- [TUI] Add a config setting for rendering job stage's plan as a tree [#1704](https://github.com/apache/datafusion-ballista/pull/1704) (martin-g)
+- [TUI] Add support for horizontal scrolling to the job/stage plan popups [#1711](https://github.com/apache/datafusion-ballista/pull/1711) (martin-g)
+- [TUI] Add screenshots of the TUI application in README/cli.md [#1714](https://github.com/apache/datafusion-ballista/pull/1714) (martin-g)
+
+**Other:**
+
+- CI: Add CodeQL workflow for GitHub Actions security scanning [#1484](https://github.com/apache/datafusion-ballista/pull/1484) (kevinjqliu)
+- ci: Harden labeler workflow, remove unnecessary checkout from pull_request_target job [#1487](https://github.com/apache/datafusion-ballista/pull/1487) (kevinjqliu)
+- chore(deps): bump tokio from 1.49.0 to 1.50.0 [#1490](https://github.com/apache/datafusion-ballista/pull/1490) (dependabot[bot])
+- chore(deps): bump actions/setup-node from 6.2.0 to 6.3.0 [#1489](https://github.com/apache/datafusion-ballista/pull/1489) (dependabot[bot])
+- ci: add take and stale [#1488](https://github.com/apache/datafusion-ballista/pull/1488) (kevinjqliu)
+- chore(deps): bump uuid from 1.21.0 to 1.22.0 [#1492](https://github.com/apache/datafusion-ballista/pull/1492) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.32.5 to 4.32.6 [#1491](https://github.com/apache/datafusion-ballista/pull/1491) (dependabot[bot])
+- chore(deps): bump libc from 0.2.182 to 0.2.183 [#1495](https://github.com/apache/datafusion-ballista/pull/1495) (dependabot[bot])
+- chore(deps): bump graphviz-rust from 0.9.6 to 0.9.7 [#1496](https://github.com/apache/datafusion-ballista/pull/1496) (dependabot[bot])
+- chore(deps): bump quinn-proto from 0.11.13 to 0.11.14 [#1499](https://github.com/apache/datafusion-ballista/pull/1499) (dependabot[bot])
+- chore(deps): bump quinn-proto from 0.11.13 to 0.11.14 in /python [#1500](https://github.com/apache/datafusion-ballista/pull/1500) (dependabot[bot])
+- chore(deps): bump tempfile from 3.26.0 to 3.27.0 [#1501](https://github.com/apache/datafusion-ballista/pull/1501) (dependabot[bot])
+- chore(deps): cargo update deps [#1502](https://github.com/apache/datafusion-ballista/pull/1502) (milenkovicm)
+- chore(deps): bump once_cell from 1.21.3 to 1.21.4 [#1505](https://github.com/apache/datafusion-ballista/pull/1505) (dependabot[bot])
+- chore(deps): bump clap from 4.5.60 to 4.6.0 [#1504](https://github.com/apache/datafusion-ballista/pull/1504) (dependabot[bot])
+- minor: task scheduling policy config cleanup [#1507](https://github.com/apache/datafusion-ballista/pull/1507) (milenkovicm)
+- minor: address task policy config comments [#1508](https://github.com/apache/datafusion-ballista/pull/1508) (milenkovicm)
+- chore(deps): bump tracing-subscriber from 0.3.22 to 0.3.23 [#1510](https://github.com/apache/datafusion-ballista/pull/1510) (dependabot[bot])
+- minor: [REST] add datafusion version info [#1512](https://github.com/apache/datafusion-ballista/pull/1512) (milenkovicm)
+- chore(deps): bump lz4_flex from 0.12.0 to 0.12.1 in /python [#1514](https://github.com/apache/datafusion-ballista/pull/1514) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.32.6 to 4.33.0 [#1515](https://github.com/apache/datafusion-ballista/pull/1515) (dependabot[bot])
+- chore(deps): bump rustls-webpki from 0.103.9 to 0.103.10 in /python [#1517](https://github.com/apache/datafusion-ballista/pull/1517) (dependabot[bot])
+- chore(deps): bump lz4_flex from 0.12.0 to 0.12.1 [#1518](https://github.com/apache/datafusion-ballista/pull/1518) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.33.0 to 4.34.1 [#1519](https://github.com/apache/datafusion-ballista/pull/1519) (dependabot[bot])
+- chore(deps): bump rustls-webpki from 0.103.9 to 0.103.10 [#1521](https://github.com/apache/datafusion-ballista/pull/1521) (dependabot[bot])
+- ci: pin third-party actions to Apache-approved SHAs [#1516](https://github.com/apache/datafusion-ballista/pull/1516) (kevinjqliu)
+- chore(deps): bump env_logger from 0.11.9 to 0.11.10 [#1522](https://github.com/apache/datafusion-ballista/pull/1522) (dependabot[bot])
+- chore(deps): update to datafusion v.53 [#1486](https://github.com/apache/datafusion-ballista/pull/1486) (milenkovicm)
+- chore(deps): bump insta from 1.46.3 to 1.47.0 [#1524](https://github.com/apache/datafusion-ballista/pull/1524) (dependabot[bot])
+- chore(deps): bump uuid from 1.22.0 to 1.23.0 [#1525](https://github.com/apache/datafusion-ballista/pull/1525) (dependabot[bot])
+- chore: update datafusion proto [#1528](https://github.com/apache/datafusion-ballista/pull/1528) (milenkovicm)
+- minor: cleanup scheduler clap configuration [#1529](https://github.com/apache/datafusion-ballista/pull/1529) (milenkovicm)
+- chore(deps): bump insta from 1.47.0 to 1.47.1 [#1532](https://github.com/apache/datafusion-ballista/pull/1532) (dependabot[bot])
+- chore(deps): bump ctor from 0.6.3 to 0.8.0 [#1534](https://github.com/apache/datafusion-ballista/pull/1534) (dependabot[bot])
+- chore(deps): bump md-5 from 0.10.6 to 0.11.0 [#1533](https://github.com/apache/datafusion-ballista/pull/1533) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.34.1 to 4.35.1 [#1530](https://github.com/apache/datafusion-ballista/pull/1530) (dependabot[bot])
+- chore(deps): bump insta from 1.47.1 to 1.47.2 [#1535](https://github.com/apache/datafusion-ballista/pull/1535) (dependabot[bot])
+- chore(deps): bump libc from 0.2.183 to 0.2.184 [#1538](https://github.com/apache/datafusion-ballista/pull/1538) (dependabot[bot])
+- chore(deps): bump tokio from 1.50.0 to 1.51.0 [#1544](https://github.com/apache/datafusion-ballista/pull/1544) (dependabot[bot])
+- chore(deps): bump tui-big-text from 0.8.3 to 0.8.4 [#1546](https://github.com/apache/datafusion-ballista/pull/1546) (dependabot[bot])
+- chore(deps): bump tokio from 1.51.0 to 1.51.1 [#1545](https://github.com/apache/datafusion-ballista/pull/1545) (dependabot[bot])
+- chore(deps): bump ctor from 0.8.0 to 0.9.1 [#1548](https://github.com/apache/datafusion-ballista/pull/1548) (dependabot[bot])
+- chore(deps): bump ctor from 0.9.1 to 0.10.0 [#1549](https://github.com/apache/datafusion-ballista/pull/1549) (dependabot[bot])
+- chore(deps): bump rustls from 0.23.37 to 0.23.38 [#1550](https://github.com/apache/datafusion-ballista/pull/1550) (dependabot[bot])
+- chore(deps): bump libc from 0.2.184 to 0.2.185 [#1553](https://github.com/apache/datafusion-ballista/pull/1553) (dependabot[bot])
+- chore(deps): bump rand from 0.9.2 to 0.9.4 in /python [#1552](https://github.com/apache/datafusion-ballista/pull/1552) (dependabot[bot])
+- chore(deps): bump tokio from 1.51.1 to 1.52.0 [#1555](https://github.com/apache/datafusion-ballista/pull/1555) (dependabot[bot])
+- chore(deps): bump axum from 0.8.8 to 0.8.9 [#1554](https://github.com/apache/datafusion-ballista/pull/1554) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.35.1 to 4.35.2 [#1557](https://github.com/apache/datafusion-ballista/pull/1557) (dependabot[bot])
+- chore: Fix Clippy issues with Rust 1.95.0 [#1558](https://github.com/apache/datafusion-ballista/pull/1558) (martin-g)
+- chore: update deps [#1561](https://github.com/apache/datafusion-ballista/pull/1561) (milenkovicm)
+- chore(deps): bump actions/setup-node from 6.3.0 to 6.4.0 [#1562](https://github.com/apache/datafusion-ballista/pull/1562) (dependabot[bot])
+- chore(deps): bump mimalloc from 0.1.48 to 0.1.49 [#1566](https://github.com/apache/datafusion-ballista/pull/1566) (dependabot[bot])
+- chore(deps): bump aws-config from 1.8.15 to 1.8.16 [#1564](https://github.com/apache/datafusion-ballista/pull/1564) (dependabot[bot])
+- chore(deps): bump rand from 0.9.4 to 0.10.1 [#1565](https://github.com/apache/datafusion-ballista/pull/1565) (dependabot[bot])
+- chore(deps): bump ctor from 0.10.0 to 0.10.1 [#1571](https://github.com/apache/datafusion-ballista/pull/1571) (dependabot[bot])
+- chore(deps): bump mimalloc from 0.1.49 to 0.1.50 [#1570](https://github.com/apache/datafusion-ballista/pull/1570) (dependabot[bot])
+- chore(deps): bump rustls from 0.23.38 to 0.23.39 [#1569](https://github.com/apache/datafusion-ballista/pull/1569) (dependabot[bot])
+- chore(deps): bump libc from 0.2.185 to 0.2.186 [#1572](https://github.com/apache/datafusion-ballista/pull/1572) (dependabot[bot])
+- [TUI] Change the key binding for job's plans [#1573](https://github.com/apache/datafusion-ballista/pull/1573) (martin-g)
+- chore(deps): bump rustls-webpki from 0.103.12 to 0.103.13 [#1576](https://github.com/apache/datafusion-ballista/pull/1576) (dependabot[bot])
+- chore(deps): bump rustls-webpki from 0.103.10 to 0.103.13 in /python [#1575](https://github.com/apache/datafusion-ballista/pull/1575) (dependabot[bot])
+- minor: make config naming convention consistent [#1580](https://github.com/apache/datafusion-ballista/pull/1580) (milenkovicm)
+- chore: Remove unnecessary optimizer rules due to datafusion upgrade to v53 [#1594](https://github.com/apache/datafusion-ballista/pull/1594) (sandugood)
+- chore(deps): bump reqwest from 0.13.2 to 0.13.3 [#1605](https://github.com/apache/datafusion-ballista/pull/1605) (dependabot[bot])
+- ci: drop Intel macOS Python wheel build [#1612](https://github.com/apache/datafusion-ballista/pull/1612) (andygrove)
+- chore(deps): bump ctor from 0.10.1 to 0.11.1 [#1618](https://github.com/apache/datafusion-ballista/pull/1618) (dependabot[bot])
+- chore(deps): bump rustls from 0.23.39 to 0.23.40 [#1619](https://github.com/apache/datafusion-ballista/pull/1619) (dependabot[bot])
+- chore: update python deps to ballista and datafusion 52 [#1590](https://github.com/apache/datafusion-ballista/pull/1590) (andygrove)
+- feat(sort-shuffle): byte-copy spill files and enable block-IO transport [#1615](https://github.com/apache/datafusion-ballista/pull/1615) (andygrove)
+- Use BallistaSessionContext instead of BallistaBuilder in tpch.py [#1621](https://github.com/apache/datafusion-ballista/pull/1621) (martin-g)
+- feat(sort-shuffle): enable sort-based shuffle by default [#1623](https://github.com/apache/datafusion-ballista/pull/1623) (andygrove)
+- perf(sort-shuffle): fix performance regression caused by datafusion upgrade [#1626](https://github.com/apache/datafusion-ballista/pull/1626) (andygrove)
+- chore(deps): bump ctor from 0.11.1 to 0.12.0 [#1639](https://github.com/apache/datafusion-ballista/pull/1639) (dependabot[bot])
+- fix(sort-shuffle): bound writer memory with per-task spill threshold [#1636](https://github.com/apache/datafusion-ballista/pull/1636) (andygrove)
+- chore(deps): bump graphviz-rust from 0.9.7 to 0.9.8 [#1655](https://github.com/apache/datafusion-ballista/pull/1655) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.35.2 to 4.35.3 [#1653](https://github.com/apache/datafusion-ballista/pull/1653) (dependabot[bot])
+- chore(deps): bump tokio from 1.52.1 to 1.52.2 [#1657](https://github.com/apache/datafusion-ballista/pull/1657) (dependabot[bot])
+- chore(deps): bump actions/labeler from 6.0.1 to 6.1.0 [#1659](https://github.com/apache/datafusion-ballista/pull/1659) (dependabot[bot])
+- [TUI] Show job's stages and their tasks [#1574](https://github.com/apache/datafusion-ballista/pull/1574) (martin-g)
+- chore(deps): bump tonic-build from 0.14.5 to 0.14.6 [#1662](https://github.com/apache/datafusion-ballista/pull/1662) (dependabot[bot])
+- chore(deps): bump tonic from 0.14.5 to 0.14.6 [#1661](https://github.com/apache/datafusion-ballista/pull/1661) (dependabot[bot])
+- chore(deps): bump astral-tokio-tar from 0.6.0 to 0.6.1 [#1664](https://github.com/apache/datafusion-ballista/pull/1664) (dependabot[bot])
+- chore(deps): bump ctor from 0.12.0 to 1.0.2 [#1663](https://github.com/apache/datafusion-ballista/pull/1663) (dependabot[bot])
+- chore(deps): bump github/codeql-action from 4.35.3 to 4.35.4 [#1665](https://github.com/apache/datafusion-ballista/pull/1665) (dependabot[bot])
+- chore(deps): bump ctor from 1.0.2 to 1.0.3 [#1668](https://github.com/apache/datafusion-ballista/pull/1668) (dependabot[bot])
+- chore(deps): bump tonic-prost from 0.14.5 to 0.14.6 [#1667](https://github.com/apache/datafusion-ballista/pull/1667) (dependabot[bot])
+- chore(deps): bump tonic-prost-build from 0.14.5 to 0.14.6 [#1666](https://github.com/apache/datafusion-ballista/pull/1666) (dependabot[bot])
+- [TUI] Configurable tick interval [#1669](https://github.com/apache/datafusion-ballista/pull/1669) (martin-g)
+- minor: add pending stage indicator for `AdaptiveDatafusionExec` [#1672](https://github.com/apache/datafusion-ballista/pull/1672) (milenkovicm)
+- chore(deps): bump ctor from 1.0.3 to 1.0.4 [#1680](https://github.com/apache/datafusion-ballista/pull/1680) (dependabot[bot])
+- chore(deps): bump tokio from 1.52.2 to 1.52.3 [#1678](https://github.com/apache/datafusion-ballista/pull/1678) (dependabot[bot])
+- minor: change parameter ordering in `AdaptivePlanner::try_new_with_optimizers` [#1687](https://github.com/apache/datafusion-ballista/pull/1687) (milenkovicm)
+- chore(deps): bump ctor from 1.0.4 to 1.0.5 [#1694](https://github.com/apache/datafusion-ballista/pull/1694) (dependabot[bot])
+- Fix REST API panic on job list/detail when end_time < start_time [#1693](https://github.com/apache/datafusion-ballista/pull/1693) (abhinavgautam01)
+- Right align all numeric columns in the TUI tables [#1695](https://github.com/apache/datafusion-ballista/pull/1695) (martin-g)
+- fix(join-selection): guard CollectLeft swap when right has multiple partitions [#1691](https://github.com/apache/datafusion-ballista/pull/1691) (andygrove)
+- Minor improvements for #1675 [#1686](https://github.com/apache/datafusion-ballista/pull/1686) (martin-g)
+- [CLI/TUI] Use only tracing crate for logging in CLI and TUI [#1697](https://github.com/apache/datafusion-ballista/pull/1697) (martin-g)
+- chore(deps): bump urllib3 from 2.6.3 to 2.7.0 in /python [#1699](https://github.com/apache/datafusion-ballista/pull/1699) (dependabot[bot])
+- chore(deps): bump pyjwt from 2.10.1 to 2.12.0 in /python [#1700](https://github.com/apache/datafusion-ballista/pull/1700) (dependabot[bot])
+- chore(deps): bump pytest from 9.0.2 to 9.0.3 in /python [#1702](https://github.com/apache/datafusion-ballista/pull/1702) (dependabot[bot])
+- minor: change log level for few statements [#1706](https://github.com/apache/datafusion-ballista/pull/1706) (milenkovicm)
+- chore(deps): bump config from 0.15.22 to 0.15.23 [#1709](https://github.com/apache/datafusion-ballista/pull/1709) (dependabot[bot])
+- Saturate scheduler job elapsed time [#1708](https://github.com/apache/datafusion-ballista/pull/1708) (MukundaKatta)
+- [TUI] Executor's id is not a numeric column. It should be center aligned [#1713](https://github.com/apache/datafusion-ballista/pull/1713) (martin-g)
+- Make use of Swatinem/rust-cache to make the CI workflows faster [#1705](https://github.com/apache/datafusion-ballista/pull/1705) (martin-g)
+- Merge Executor's brief and extended properties [#1716](https://github.com/apache/datafusion-ballista/pull/1716) (martin-g)
+- [INFRA] Set up default rulesets for default and release branches [#1715](https://github.com/apache/datafusion-ballista/pull/1715) (asf-gitbox-commits)
+- chore(deps): bump github/codeql-action from 4.35.4 to 4.35.5 [#1719](https://github.com/apache/datafusion-ballista/pull/1719) (dependabot[bot])
+- chore(deps): bump ctor from 1.0.5 to 1.0.6 [#1720](https://github.com/apache/datafusion-ballista/pull/1720) (dependabot[bot])
+- chore(deps): bump dashmap from 6.1.0 to 6.2.1 [#1721](https://github.com/apache/datafusion-ballista/pull/1721) (dependabot[bot])
+- ci: add TPC-H SF10 workflow [#1688](https://github.com/apache/datafusion-ballista/pull/1688) (andygrove)
+- minor: [TUI] Extract a helper method for the table/scrollbar area splitter [#1730](https://github.com/apache/datafusion-ballista/pull/1730) (martin-g)
+- minor: [TUI] Sort the metrics before rendering them [#1731](https://github.com/apache/datafusion-ballista/pull/1731) (martin-g)
+- chore: Do not run -cli tests twice [#1732](https://github.com/apache/datafusion-ballista/pull/1732) (martin-g)
+- chore: generate changelog for ballista 53 [#1735](https://github.com/apache/datafusion-ballista/pull/1735) (milenkovicm)
+
+## Credits
+
+Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
+
+```
+    74	dependabot[bot]
+    29	Marko Milenković
+    25	Andy Grove
+    23	Martin Grigorov
+     5	alexander domenti
+     4	Kevin Liu
+     3	Daniel Tu
+     3	Saj
+     1	Abhinav Gautam
+     1	Harrison Crosse
+     1	Mukunda Rao Katta
+     1	The Apache Software Foundation
+     1	gittihub-jpg
+     1	goingforstudying-ctrl
+     1	jgrim
+     1	mete
+```
+
+Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.
diff --git a/_sources/changelog/index.md.txt b/_sources/changelog/index.md.txt
new file mode 100644
index 000000000..653f00672
--- /dev/null
+++ b/_sources/changelog/index.md.txt
@@ -0,0 +1,46 @@
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Changelog
+
+Per-release change logs for Apache DataFusion Ballista.
+
+```{toctree}
+:maxdepth: 1
+
+53.0.0
+52.0.0
+51.0.0
+50.0.0
+49.0.0
+48.0.0
+47.0.0
+46.0.0
+45.0.0
+44.0.0
+43.0.0
+0.12.0
+0.11.0
+0.10.0
+0.9.0
+0.8.0
+0.7.0
+0.6.0
+0.5.0
+```
diff --git a/_sources/index.rst.txt b/_sources/index.rst.txt
index f1b3e3d59..b14743be6 100644
--- a/_sources/index.rst.txt
+++ b/_sources/index.rst.txt
@@ -58,6 +58,12 @@ Table of content
    user-guide/spark-compatible-functions
    user-guide/extensions-example
 
+.. toctree::
+   :maxdepth: 1
+   :caption: Changelog
+
+   changelog/index
+
 .. _toc.contributors:
 
 .. toctree::
diff --git a/changelog/0.10.0.html b/changelog/0.10.0.html
new file mode 100644
index 000000000..f490b991d
--- /dev/null
+++ b/changelog/0.10.0.html
@@ -0,0 +1,555 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.10.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.10.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.9.0 Changelog" href="0.9.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.11.0 Changelog" href="0.11.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.10.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-10-0-changelog">
+<h1>Apache DataFusion Ballista 0.10.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-10-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/0.9.0...0.10.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Add user guide section on prometheus metrics <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/507">#507</a></p></li>
+<li><p>Don’t throw error when job path not exist in remove_job_data <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/502">#502</a></p></li>
+<li><p>Fix clippy warning <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/494">#494</a></p></li>
+<li><p>Use job_data_clean_up_interval_seconds == 0 to indicate executor_cleanup_enable <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/488">#488</a></p></li>
+<li><p>Add a config for tracing log rolling policy for both scheduler and executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/486">#486</a></p></li>
+<li><p>Set up repo where we can push benchmark results <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/473">#473</a></p></li>
+<li><p>Make the delayed time interval for cleanup job data in both scheduler and executor configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/469">#469</a></p></li>
+<li><p>Add some validation for the remove_job_data grpc service <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/467">#467</a></p></li>
+<li><p>Add ability to build docker images using <code class="docutils literal notranslate"><span class="pre">release-lto</span></code> profile <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/463">#463</a></p></li>
+<li><p>Suggest users download (rather than build) the FlightSQL JDBC Driver <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/460">#460</a></p></li>
+<li><p>Clean up legacy job shuffle data <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/459">#459</a></p></li>
+<li><p>Add grpc service for the scheduler to make it able to be triggered by client explicitly <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/458">#458</a></p></li>
+<li><p>Replace Mutex&lt;HashMap&gt; by using DashMap <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/448">#448</a></p></li>
+<li><p>Refine log level <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/446">#446</a></p></li>
+<li><p>Upgrade to DataFusion 14.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/445">#445</a></p></li>
+<li><p>Add a feature for hdfs3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/419">#419</a></p></li>
+<li><p>Add optional flag which advertises host for Arrow Flight SQL <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/418">#418</a></p></li>
+<li><p>Partitioning reasoning in DataFusion and Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/284">#284</a></p></li>
+<li><p>Stop wasting time in CI on MIRI runs <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/283">#283</a></p></li>
+<li><p>Publish Docker images as part of each release <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/236">#236</a></p></li>
+<li><p>Cleanup job/stage status from TaskManager and clean up shuffle data after a period after JobFinished <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/185">#185</a></p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>build broken: configure_me_codegen retroactively reserved <code class="docutils literal notranslate"><span class="pre">bind_host</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/519">#519</a></p></li>
+<li><p>Return empty results for SQLs with order by <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/451">#451</a></p></li>
+<li><p>ballista scheduler is not taken inline parameters into account <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/443">#443</a></p></li>
+<li><p>[FlightSQL] Cannot connect with Tableau Desktop <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/428">#428</a></p></li>
+<li><p>Benchmark q15 fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/372">#372</a></p></li>
+<li><p>Incorrect documentation for building Ballista on Linux when using docker-compose <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/362">#362</a></p></li>
+<li><p>Scheduler silently replaces <code class="docutils literal notranslate"><span class="pre">ParquetExec</span></code> with <code class="docutils literal notranslate"><span class="pre">EmptyExec</span></code> if data path is not correctly mounted in container <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/353">#353</a></p></li>
+<li><p>SQL with order by limit returns nothing <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/334">#334</a></p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>README updates <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/433">#433</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>configure_me_codegen retroactively reserved on our <code class="docutils literal notranslate"><span class="pre">bind_host</span></code> parame… <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/520">#520</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Bump actions/cache from 2 to 3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/517">#517</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Update graphviz-rust requirement from 0.3.0 to 0.4.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/515">#515</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Add Prometheus metrics endpoint <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/511">#511</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Enable tests that work since upgrading to DataFusion 14 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/510">#510</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update hashbrown requirement from 0.12 to 0.13 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/506">#506</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Don’t throw error when job shuffle data path not exist in executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/503">#503</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Upgrade to DataFusion 14.0.0 and Arrow 26.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/499">#499</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Fix clippy warning <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/495">#495</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Stop wasting time in CI on MIRI runs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/491">#491</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Remove executor config executor_cleanup_enable and make the configuation name for executor cleanup more intuitive <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/489">#489</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add a config for tracing log rolling policy for both scheduler and executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/487">#487</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add grpc service of cleaning up job shuffle data for the scheduler to make it able to be triggered by client explicitly <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/485">#485</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>[Minor] Bump DataFusion <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/480">#480</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Remove benchmark results from README <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/478">#478</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update <code class="docutils literal notranslate"><span class="pre">flightsql.md</span></code> to provide correct instruction <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/476">#476</a> (<a class="reference external" href="https://github.com/iajoiner">iajoiner</a>)</p></li>
+<li><p>Add support for Tableau <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/475">#475</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Add SchedulerConfig for the scheduler configurations, like event_loop_buffer_size, finished_job_data_clean_up_interval_seconds, finished_job_state_clean_up_interval_seconds <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/472">#472</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Bump DataFusion <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/471">#471</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Add some validation for remove_job_data in the executor server <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/468">#468</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Update documentation to reflect the release of the FlightSQL JDBC Driver <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/461">#461</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Bump DataFusion version <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/453">#453</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add shuffle for SortPreservingMergeExec physical operator <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/452">#452</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Replace Mutex&lt;HashMap&gt; by using DashMap <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/449">#449</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Refine log level for trial info and periodically invoked places <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/447">#447</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>MINOR: Add <code class="docutils literal notranslate"><span class="pre">set</span> <span class="pre">-e</span></code> to scripts, fix a typo <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/444">#444</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add optional flag which advertises host for Arrow Flight SQL #418 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/442">#442</a> (<a class="reference external" href="https://github.com/DaltonModlin">DaltonModlin</a>)</p></li>
+<li><p>Reorder joins after resolving stage inputs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/441">#441</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Add a feature for hdfs3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/439">#439</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add Spark benchmarks <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/438">#438</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>scheduler now verifies that <code class="docutils literal notranslate"><span class="pre">file://</span></code> ListingTable URLs are accessible <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/414">#414</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="0.11.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.11.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.9.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.9.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.10.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.10.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/changelog/0.11.0.html b/changelog/0.11.0.html
new file mode 100644
index 000000000..27b7f6ee0
--- /dev/null
+++ b/changelog/0.11.0.html
@@ -0,0 +1,559 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.11.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.11.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.10.0 Changelog" href="0.10.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.12.0 Changelog" href="0.12.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.11.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-11-0-changelog">
+<h1>Apache DataFusion Ballista 0.11.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-11-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/0.10.0...0.11.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Remove <code class="docutils literal notranslate"><span class="pre">python</span></code> since it has been moved to its own repo, <code class="docutils literal notranslate"><span class="pre">datafusion-ballista-python</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/653">#653</a></p></li>
+<li><p>Add executor self-registration mechanism in the heartbeat service <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/648">#648</a></p></li>
+<li><p>Upgrade to DataFusion 17 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/638">#638</a></p></li>
+<li><p>Move Python bindings to separate repo? <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/635">#635</a></p></li>
+<li><p>Implement new release process <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/622">#622</a></p></li>
+<li><p>Change default branch name from master to main <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/618">#618</a></p></li>
+<li><p>Update latest datafusion dependency <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/610">#610</a></p></li>
+<li><p>Implement optimizer rule to remove redundant repartitioning <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/608">#608</a></p></li>
+<li><p>ballista-cli as (docker) images <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/600">#600</a></p></li>
+<li><p>Update contributor guide <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/598">#598</a></p></li>
+<li><p>Fix cargo clippy <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/570">#570</a></p></li>
+<li><p>Support Alibaba Cloud OSS with ObjectStore <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/566">#566</a></p></li>
+<li><p>Refactor <code class="docutils literal notranslate"><span class="pre">StateBackendClient</span></code> to be a higher-level interface <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/554">#554</a></p></li>
+<li><p>Make it concurrently to launch tasks to executors <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/544">#544</a></p></li>
+<li><p>Simplify docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/531">#531</a></p></li>
+<li><p>Provide an in-memory StateBackend <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/505">#505</a></p></li>
+<li><p>Add support for Azure blob storage <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/294">#294</a></p></li>
+<li><p>Add a workflow to build the image and publish it to the package <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/71">#71</a></p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>Rust / Check Cargo.toml formatting (amd64, stable) (pull_request) Failing <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/662">#662</a></p></li>
+<li><p>Protobuf parsing error <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/646">#646</a></p></li>
+<li><p>jobs from python client not showing up in Scheduler UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/625">#625</a></p></li>
+<li><p>ballista ui fails to build <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/594">#594</a></p></li>
+<li><p>cargo build –release fails for ballista-scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/590">#590</a></p></li>
+<li><p>docker build fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/589">#589</a></p></li>
+<li><p>Multi-scheduler Job Starvation <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/585">#585</a></p></li>
+<li><p>Cannot query file from S3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/559">#559</a></p></li>
+<li><p>Benchmark q16 fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/373">#373</a></p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>Check in benchmark image <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/647">#647</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>MINOR: Fix benchmark image link <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/596">#596</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>Upgrade to DataFusion 18 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/668">#668</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Enable physical plan round-trip tests <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/666">#666</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Upgrade to DataFusion 18.0.0-rc1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/664">#664</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>add test_util to make examples work well <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/661">#661</a> (<a class="reference external" href="https://github.com/jiangzhx">jiangzhx</a>)</p></li>
+<li><p>Minor refactor to reduce duplicate code <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/659">#659</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Cluster state refactor Part 2 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/658">#658</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Remove <code class="docutils literal notranslate"><span class="pre">python</span></code> dir &amp; python-related workflows <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/654">#654</a> (<a class="reference external" href="https://github.com/iajoiner">iajoiner</a>)</p></li>
+<li><p>Add executor self-registration mechanism in the heartbeat service <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/649">#649</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Upgrade to DataFusion 17 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/639">#639</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Upgrade to DataFusion 16 (again) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/636">#636</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Update release process documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/632">#632</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Implement new release process <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/623">#623</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update contributor guide <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/617">#617</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Fix Cargo.toml format issue <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/616">#616</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Refactor scheduler main <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/615">#615</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Refactor executor main <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/614">#614</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update datafusion dependency to the latest version <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/612">#612</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add support for Azure Blob Storage <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/599">#599</a> (<a class="reference external" href="https://github.com/aidankovacic-8451">aidankovacic-8451</a>)</p></li>
+<li><p>Python: add method to get explain output as a string <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/593">#593</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Handle job resubmission <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/586">#586</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>updated readme to contain correct versions of dependencies. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/580">#580</a> (<a class="reference external" href="https://github.com/saikrishna1-bidgely">saikrishna1-bidgely</a>)</p></li>
+<li><p>Update graphviz-rust requirement from 0.4.0 to 0.5.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/574">#574</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Super minor spelling error <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/573">#573</a> (<a class="reference external" href="https://github.com/jdye64">jdye64</a>)</p></li>
+<li><p>Fix cargo clippy <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/571">#571</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Support Alibaba Cloud OSS with ObjectStore <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/567">#567</a> (<a class="reference external" href="https://github.com/r4ntix">r4ntix</a>)</p></li>
+<li><p>fix(ui): fix last seen <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/562">#562</a> (<a class="reference external" href="https://github.com/duyet">duyet</a>)</p></li>
+<li><p>Cluster state refactor part 1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/560">#560</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Make it concurrently to launch tasks to executors <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/557">#557</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Update datafusion requirement from 14.0.0 to 15.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/552">#552</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>docs: fix style in the Helm readme <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/551">#551</a> (<a class="reference external" href="https://github.com/haoxins">haoxins</a>)</p></li>
+<li><p>Fix Helm chart’s image format <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/550">#550</a> (<a class="reference external" href="https://github.com/haoxins">haoxins</a>)</p></li>
+<li><p>Update env_logger requirement from 0.9 to 0.10 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/539">#539</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>only build docker images on rc tags <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/535">#535</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Remove <code class="docutils literal notranslate"><span class="pre">--locked</span></code> when building Python wheels <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/533">#533</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Bump actions/labeler from 4.0.2 to 4.1.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/525">#525</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Provide a memory StateBackendClient <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/523">#523</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+</ul>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="0.12.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.12.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.10.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.10.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.11.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.11.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/changelog/0.12.0.html b/changelog/0.12.0.html
new file mode 100644
index 000000000..a79cd867a
--- /dev/null
+++ b/changelog/0.12.0.html
@@ -0,0 +1,579 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.12.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.12.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.11.0 Changelog" href="0.11.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 43.0.0 Changelog" href="43.0.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.12.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-12-0-changelog">
+<h1>Apache DataFusion Ballista 0.12.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-12-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/0.11.0...0.12.0">Full Changelog</a></p>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>docs: fix link <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/799">#799</a> (haoxins)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>[minor] remove outdate todo <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/683">#683</a> (Ted-Jiang)</p></li>
+<li><p>Add executor terminating status for graceful shutdown <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/667">#667</a> (thinkharderdev)</p></li>
+<li><p>Allow <code class="docutils literal notranslate"><span class="pre">BallistaContext::read_*</span></code> methods to read multiple paths. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/679">#679</a> (luckylsk34)</p></li>
+<li><p>Update scheduler.md <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/657">#657</a> (psvri)</p></li>
+<li><p>Mark <code class="docutils literal notranslate"><span class="pre">SchedulerState</span></code> as pub <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/688">#688</a> (Dandandan)</p></li>
+<li><p>Update graphviz-rust requirement from 0.5.0 to 0.6.1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/651">#651</a> (dependabot[bot])</p></li>
+<li><p>Upgrade DataFusion to 19.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/691">#691</a> (r4ntix)</p></li>
+<li><p>Update release docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/692">#692</a> (andygrove)</p></li>
+<li><p>Mark <code class="docutils literal notranslate"><span class="pre">SchedulerServer::with_task_launcher</span></code> as pub <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/695">#695</a> (Dandandan)</p></li>
+<li><p>Make task_manager pub <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/698">#698</a> (Dandandan)</p></li>
+<li><p>Add ExecutionEngine abstraction <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/687">#687</a> (andygrove)</p></li>
+<li><p>Allow accessing s3 locations in client mode <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/700">#700</a> (luckylsk34)</p></li>
+<li><p>git clone branch incorrect <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/699">#699</a> (BubbaJoe)</p></li>
+<li><p>Fix for error message during testing <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/707">#707</a> (yahoNanJing)</p></li>
+<li><p>Upgrade datafusion to 20.0.0 &amp; sqlparser to to 0.32.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/711">#711</a> (r4ntix)</p></li>
+<li><p>Update README.md <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/729">#729</a> (jiangzhx)</p></li>
+<li><p>Update link to scheduler proto file in dev docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/713">#713</a> (JAicewizard)</p></li>
+<li><p>Fix <code class="docutils literal notranslate"><span class="pre">show</span> <span class="pre">tables</span></code> fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/715">#715</a> (r4ntix)</p></li>
+<li><p>Remove redundant fields in ExecutorManager <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/728">#728</a> (yahoNanJing)</p></li>
+<li><p>Fix parameter ‘–config-backend’ to ‘–cluster-backend’ <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/720">#720</a> (paolorechia)</p></li>
+<li><p>Upgrade DataFusion to 21.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/727">#727</a> (r4ntix)</p></li>
+<li><p>[minor] remove useless brackets <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/739">#739</a> (Ted-Jiang)</p></li>
+<li><p>Only decode plan in <code class="docutils literal notranslate"><span class="pre">LaunchMultiTaskParams</span></code> once <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/743">#743</a> (Dandandan)</p></li>
+<li><p>Upgrade DataFusion to 22.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/740">#740</a> (r4ntix)</p></li>
+<li><p>[feature] support shuffle read with retry when facing IO error. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/738">#738</a> (Ted-Jiang)</p></li>
+<li><p>[log] Print long running task status. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/750">#750</a> (Ted-Jiang)</p></li>
+<li><p>Upgrade DataFusion to 23.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/755">#755</a> (yahoNanJing)</p></li>
+<li><p>Fix plan metrics length and stage metrics length not match <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/764">#764</a> (yahoNanJing)</p></li>
+<li><p>added match arms to create ClusterStorageConfig <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/766">#766</a> (BokarevNik)</p></li>
+<li><p>[Improve] refactor the offer_reservation avoid wait result <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/760">#760</a> (Ted-Jiang)</p></li>
+<li><p>[fea] Avoid multithreaded write lock conflicts in event queue. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/754">#754</a> (Ted-Jiang)</p></li>
+<li><p>Upgrade DataFusion to 24.0.0, Object_Store to 0.5.6 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/769">#769</a> (r4ntix)</p></li>
+<li><p>Refine create_datafusion_context() <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/778">#778</a> (yahoNanJing)</p></li>
+<li><p>Remove output_partitioning for task definition <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/776">#776</a> (yahoNanJing)</p></li>
+<li><p>Upgrade DataFusion to 25.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/779">#779</a> (r4ntix)</p></li>
+<li><p>Disable the ansi feature of tracing-subscriber <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/784">#784</a> (yahoNanJing)</p></li>
+<li><p>Add config grpc_server_max_decoding_message_size to make the maximum size of a decoded message at the grpc server side configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/782">#782</a> (yahoNanJing)</p></li>
+<li><p>Fix nodejs issues in Docker build <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/731">#731</a> (jnaous)</p></li>
+<li><p>Upgrade node version to fix build in <code class="docutils literal notranslate"><span class="pre">main</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/794">#794</a> (avantgardnerio)</p></li>
+<li><p>Remove redundant mod session_registry <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/792">#792</a> (yahoNanJing)</p></li>
+<li><p>Make last_seen_ts_threshold for getting alive executor at the scheduler side larger than the heartbeat time interval <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/786">#786</a> (yahoNanJing)</p></li>
+<li><p>Remove the prometheus-metrics from the default feature <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/788">#788</a> (yahoNanJing)</p></li>
+<li><p>Refine the ExecuteQuery grpc interface <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/790">#790</a> (yahoNanJing)</p></li>
+<li><p>Add config to collect statistics, enable in TPC-H benchmark <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/796">#796</a> (Dandandan)</p></li>
+<li><p>Add support for GCS data sources <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/805">#805</a> (haoxins)</p></li>
+<li><p>Update DataFusion to 26 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/798">#798</a> (Dandandan)</p></li>
+<li><p>Issue 162 build docker image in ci <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/716">#716</a> (paolorechia)</p></li>
+<li><p>Fix index out of bounds panic <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/819">#819</a> (yahoNanJing)</p></li>
+<li><p>Refactor the TaskDefinition by changing encoding execution plan to the decoded one <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/817">#817</a> (yahoNanJing)</p></li>
+<li><p>Fix ballista-cli docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/800">#800</a> (jonahgao)</p></li>
+<li><p>docs: fix link <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/799">#799</a> (haoxins)</p></li>
+<li><p>Implement the with_new_children for ShuffleReaderExec <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/821">#821</a> (yahoNanJing)</p></li>
+<li><p>Update to point to the correct documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/838">#838</a> (dadepo)</p></li>
+<li><p>Remove ExecutorReservation and change the task assignment philosophy from executor first to task first <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/823">#823</a> (yahoNanJing)</p></li>
+<li><p>Upgrade DataFusion to 27.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/834">#834</a> (r4ntix)</p></li>
+<li><p>Reduce the number of calls to <code class="docutils literal notranslate"><span class="pre">create_logical_plan</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/842">#842</a> (jonahgao)</p></li>
+<li><p>Bump semver from 5.7.1 to 5.7.2 in /ballista/scheduler/ui <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/843">#843</a> (dependabot[bot])</p></li>
+<li><p>Bump actions/labeler from 4.1.0 to 4.3.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/841">#841</a> (dependabot[bot])</p></li>
+<li><p>Bump tough-cookie from 4.1.2 to 4.1.3 in /ballista/scheduler/ui <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/840">#840</a> (dependabot[bot])</p></li>
+<li><p>Update flatbuffers requirement from 22.9.29 to 23.5.26 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/801">#801</a> (dependabot[bot])</p></li>
+<li><p>Update dirs requirement from 4.0.0 to 5.0.1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/767">#767</a> (dependabot[bot])</p></li>
+<li><p>Update libloading requirement from 0.7.3 to 0.8.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/761">#761</a> (dependabot[bot])</p></li>
+<li><p>Introduce a cache crate supporting concurrent cache value loading <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/825">#825</a> (yahoNanJing)</p></li>
+<li><p>Fix cargo clippy for latest rust version <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/848">#848</a> (yahoNanJing)</p></li>
+<li><p>Introduce CachedBasedObjectStoreRegistry to use data source cache transparently <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/827">#827</a> (yahoNanJing)</p></li>
+<li><p>Add ConsistentHash for node topology management <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/830">#830</a> (yahoNanJing)</p></li>
+<li><p>Implement 3-phase consistent hash based task assignment policy <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/833">#833</a> (yahoNanJing)</p></li>
+<li><p>Update tonic requirement from 0.8 to 0.9 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/733">#733</a> (dependabot[bot])</p></li>
+<li><p>Update itertools requirement from 0.10 to 0.11 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/844">#844</a> (dependabot[bot])</p></li>
+<li><p>Update etcd-client requirement from 0.10 to 0.11 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/845">#845</a> (dependabot[bot])</p></li>
+<li><p>Update hashbrown requirement from 0.13 to 0.14 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/846">#846</a> (dependabot[bot])</p></li>
+<li><p>Bump word-wrap from 1.2.3 to 1.2.4 in /ballista/scheduler/ui <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/849">#849</a> (dependabot[bot])</p></li>
+<li><p>Update hdfs requirement from 0.1.1 to 0.1.4 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/856">#856</a> (yahoNanJing)</p></li>
+<li><p>Update to DataFusion 28 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/858">#858</a> (Dandandan)</p></li>
+<li><p>Upgrade datafusion to 30.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/866">#866</a> (r4ntix)</p></li>
+<li><p>refactor: port get_scan_files to Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/877">#877</a> (alamb)</p></li>
+<li><p>Upgrade datafusion to 31.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/878">#878</a> (r4ntix)</p></li>
+<li><p>Upgrade datafusion to 32.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/899">#899</a> (r4ntix)</p></li>
+<li><p>Update to DataFusion 33 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/900">#900</a> (Dandandan)</p></li>
+<li><p>Refactor lru mod, remove linked_hash_map <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/918">#918</a> (PsiACE)</p></li>
+<li><p>Dynamically optimize aggregate (count) based on shuffle stats <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/919">#919</a> (Dandandan)</p></li>
+<li><p>Use lz4 compression for shuffle files &amp; flight stream, refactoring / improvements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/920">#920</a> (Dandandan)</p></li>
+<li><p>Make max encoding message size configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/928">#928</a> (andygrove)</p></li>
+<li><p>Set max message size to 16MB in gRPC clients <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/931">#931</a> (andygrove)</p></li>
+<li><p>Upgrade to DataFusion 34.0.0-rc1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/927">#927</a> (andygrove)</p></li>
+<li><p>Use official DF 34 release <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/939">#939</a> (andygrove)</p></li>
+<li><p>Use StreamWriter instead of FileWriter <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/943">#943</a> (avantgardnerio)</p></li>
+<li><p>Remove some TODO comments related to context fetching schemas from scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/946">#946</a> (andygrove)</p></li>
+<li><p>Fix Docker build <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/947">#947</a> (andygrove)</p></li>
+<li><p>Fix regression in DataFrame.write_xxx <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/945">#945</a> (andygrove)</p></li>
+</ul>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="43.0.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 43.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.11.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.11.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.12.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.12.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/changelog/0.5.0.html b/changelog/0.5.0.html
new file mode 100644
index 000000000..63d656f16
--- /dev/null
+++ b/changelog/0.5.0.html
@@ -0,0 +1,633 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.5.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.5.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Ballista Architecture" href="../contributors-guide/architecture.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.6.0 Changelog" href="0.6.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.5.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-5-0-changelog">
+<h1>Apache DataFusion Ballista 0.5.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-5-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/arrow-datafusion/compare/4.0.0...ballista-0.5.0">Full Changelog</a></p>
+<p><strong>Breaking changes:</strong></p>
+<ul class="simple">
+<li><p>[ballista] support date_part and date_turnc ser/de, pass tpch 7 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/840">#840</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>Box ScalarValue:Lists, reduce size by half size <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/788">#788</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Support DataFrame.collect for Ballista DataFrames <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/785">#785</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>JOIN conditions are order dependent <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/778">#778</a> (<a class="reference external" href="https://github.com/seddonm1">seddonm1</a>)</p></li>
+<li><p>UnresolvedShuffleExec should represent a single shuffle <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/727">#727</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Ballista: Make shuffle partitions configurable in benchmarks <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/702">#702</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Rename MergeExec to CoalescePartitionsExec <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/635">#635</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Ballista: Rename QueryStageExec to ShuffleWriterExec <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/633">#633</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>fix 593, reduce cloning by taking ownership in logical planner’s <code class="docutils literal notranslate"><span class="pre">from</span></code> fn <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/610">#610</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>fix join column handling logic for <code class="docutils literal notranslate"><span class="pre">On</span></code> and <code class="docutils literal notranslate"><span class="pre">Using</span></code> constraints <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/605">#605</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>Move ballista standalone mode to client <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/589">#589</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>Ballista: Implement map-side shuffle <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/543">#543</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>ShuffleReaderExec now supports multiple locations per partition <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/541">#541</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Make external hostname in executor optional <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/232">#232</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>Remove namespace from executors <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/75">#75</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>Support qualified columns in queries <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/55">#55</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>Read CSV format text from stdin or memory <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/54">#54</a> (<a class="reference external" href="https://github.com/heymind">heymind</a>)</p></li>
+<li><p>Remove Ballista DataFrame <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/48">#48</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Use atomics for SQLMetric implementation, remove unused name field <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/25">#25</a> (<a class="reference external" href="https://github.com/returnString">returnString</a>)</p></li>
+</ul>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Add crate documentation for Ballista crates <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/830">#830</a></p></li>
+<li><p>Support DataFrame.collect for Ballista DataFrames <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/787">#787</a></p></li>
+<li><p>Ballista: Prep for supporting shuffle correctly, part one <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/736">#736</a></p></li>
+<li><p>Ballista: Implement physical plan serde for ShuffleWriterExec <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/710">#710</a></p></li>
+<li><p>Ballista: Finish implementing shuffle mechanism <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/707">#707</a></p></li>
+<li><p>Rename QueryStageExec to ShuffleWriterExec <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/542">#542</a></p></li>
+<li><p>Ballista ShuffleReaderExec should be able to read from multiple locations per partition <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/540">#540</a></p></li>
+<li><p>[Ballista] Use deployments in k8s user guide <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/473">#473</a></p></li>
+<li><p>Ballista refactor QueryStageExec in preparation for map-side shuffle <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/458">#458</a></p></li>
+<li><p>Ballista: Implement map-side of shuffle <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/456">#456</a></p></li>
+<li><p>Refactor Ballista to separate Flight logic from execution logic <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/449">#449</a></p></li>
+<li><p>Use published versions of arrow rather than github shas <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/393">#393</a></p></li>
+<li><p>BallistaContext::collect() logging is too noisy <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/352">#352</a></p></li>
+<li><p>Update Ballista to use new physical plan formatter utility <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/343">#343</a></p></li>
+<li><p>Add Ballista Getting Started documentation <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/329">#329</a></p></li>
+<li><p>Remove references to ballistacompute Docker Hub repo <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/325">#325</a></p></li>
+<li><p>Implement scalable distributed joins <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/63">#63</a></p></li>
+<li><p>Remove hard-coded Ballista version from scripts <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/32">#32</a></p></li>
+<li><p>Implement streaming versions of Dataframe.collect methods <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/789">#789</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Ballista shuffle is finally working as intended, providing scalable distributed joins <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/750">#750</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update to use arrow 5.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/721">#721</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Implement serde for ShuffleWriterExec <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/712">#712</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>dedup using join column in wildcard expansion <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/678">#678</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>Implement metrics for shuffle read and write <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/676">#676</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Remove hard-coded PartitionMode from Ballista serde <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/637">#637</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Ballista: Implement scalable distributed joins <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/634">#634</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add Keda autoscaling for ballista in k8s <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/586">#586</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>Add some resiliency to lost executors <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/568">#568</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>Add <code class="docutils literal notranslate"><span class="pre">partition</span> <span class="pre">by</span></code> constructs in window functions and modify logical planning <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/501">#501</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Support anti join <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/482">#482</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>add <code class="docutils literal notranslate"><span class="pre">order</span> <span class="pre">by</span></code> construct in window function and logical plans <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/463">#463</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Refactor Ballista executor so that FlightService delegates to an Executor struct <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/450">#450</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>implement lead and lag built-in window function <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/429">#429</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Implement fmt_as for ShuffleReaderExec <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/400">#400</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add window expression part 1 - logical and physical planning, structure, to/from proto, and explain, for empty over clause only <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/334">#334</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>[breaking change] fix 265, log should be log10, and add ln <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/271">#271</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Allow table providers to indicate their type for catalog metadata <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/205">#205</a> (<a class="reference external" href="https://github.com/returnString">returnString</a>)</p></li>
+<li><p>Add query 19 to TPC-H regression tests <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/59">#59</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Use arrow eq kernels in CaseWhen expression evaluation <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/52">#52</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Add option param for standalone mode <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/42">#42</a> (<a class="reference external" href="https://github.com/djKooks">djKooks</a>)</p></li>
+<li><p>[DataFusion] Optimize hash join inner workings, null handling fix <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/24">#24</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>[Ballista] Docker files for ui <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/22">#22</a> (<a class="reference external" href="https://github.com/msathis">msathis</a>)</p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>Ballista: TPC-H q3 &#64; SF=1000 never completes <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/835">#835</a></p></li>
+<li><p>Ballista does not support MIN/MAX aggregate functions <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/832">#832</a></p></li>
+<li><p>Ballista docker images fail to build <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/828">#828</a></p></li>
+<li><p>Ballista: UnresolvedShuffleExec should only have a single stage_id <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/726">#726</a></p></li>
+<li><p>Ballista integration tests are failing <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/623">#623</a></p></li>
+<li><p>Integration test build failure due to arrow-rs using unstable feature <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/596">#596</a></p></li>
+<li><p><code class="docutils literal notranslate"><span class="pre">cargo</span> <span class="pre">build</span></code> cannot build the project <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/531">#531</a></p></li>
+<li><p>ShuffleReaderExec does not get formatted correctly in displayable physical plan <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/399">#399</a></p></li>
+<li><p>Implement serde for MIN and MAX <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/833">#833</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Ballista: Prep for fixing shuffle mechansim, part 1 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/738">#738</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Ballista: Shuffle write bug fix <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/714">#714</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>honor table name for csv/parquet scan in ballista plan serde <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/629">#629</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>MINOR: Fix integration tests by adding datafusion-cli module to docker image <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/322">#322</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>Add minimal crate documentation for Ballista crates <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/831">#831</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add Ballista examples <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/775">#775</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update ballista.proto link in architecture doc <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/502">#502</a> (<a class="reference external" href="https://github.com/terrycorley">terrycorley</a>)</p></li>
+<li><p>Update k8s user guide to use deployments <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/474">#474</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>use prettier to format md files <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/367">#367</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Make it easier for developers to find Ballista documentation <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/330">#330</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Instructions for cross-compiling Ballista to the Raspberry Pi <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/263">#263</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add install guide in README <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/236">#236</a> (<a class="reference external" href="https://github.com/djKooks">djKooks</a>)</p></li>
+</ul>
+<p><strong>Performance improvements:</strong></p>
+<ul class="simple">
+<li><p>Ballista: Avoid sleeping between polling for tasks <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/698">#698</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Make BallistaContext::collect streaming <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/535">#535</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+</ul>
+<p><strong>Closed issues:</strong></p>
+<ul class="simple">
+<li><p>Confirm git tagging strategy for releases <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/770">#770</a></p></li>
+<li><p>arrow::util::pretty::pretty_format_batches missing <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/769">#769</a></p></li>
+<li><p>move the <code class="docutils literal notranslate"><span class="pre">assert_batches_eq!</span></code> macros to a non part of datafusion <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/745">#745</a></p></li>
+<li><p>fix an issue where aliases are not respected in generating downstream schemas in window expr <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/592">#592</a></p></li>
+<li><p>make the planner to print more succinct and useful information in window function explain clause <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/526">#526</a></p></li>
+<li><p>move window frame module to be in <code class="docutils literal notranslate"><span class="pre">logical_plan</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/517">#517</a></p></li>
+<li><p>use a more rust idiomatic way of handling nth_value <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/448">#448</a></p></li>
+<li><p>Make Ballista not depend on arrow directly <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/446">#446</a></p></li>
+<li><p>create a test with more than one partition for window functions <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/435">#435</a></p></li>
+<li><p>Implement hash-partitioned hash aggregate <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/27">#27</a></p></li>
+<li><p>Consider using GitHub pages for DataFusion/Ballista documentation <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/18">#18</a></p></li>
+<li><p>Add Ballista to default cargo workspace <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/17">#17</a></p></li>
+<li><p>Update “repository” in Cargo.toml <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/16">#16</a></p></li>
+<li><p>Consolidate TPC-H benchmarks <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/6">#6</a></p></li>
+<li><p>[Ballista] Fix integration test script <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/4">#4</a></p></li>
+<li><p>Ballista should not have separate DataFrame implementation <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2">#2</a></p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>Change datatype of tpch keys from Int32 to UInt64 to support sf=1000 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/836">#836</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add ballista-examples to docker build <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/829">#829</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update dependencies: prost to 0.8 and tonic to 0.5 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/818">#818</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Move <code class="docutils literal notranslate"><span class="pre">hash_array</span></code> into hash_utils.rs <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/807">#807</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Fix: Update clippy lints for Rust 1.54 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/794">#794</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>MINOR: Remove unused Ballista query execution code path <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/732">#732</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>[fix] benchmark run with compose <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/666">#666</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>bring back dev scripts for ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/648">#648</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Remove unnecessary mutex <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/639">#639</a> (<a class="reference external" href="https://github.com/edrevo">edrevo</a>)</p></li>
+<li><p>round trip TPCH queries in tests <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/630">#630</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>Fix build <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/627">#627</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>in ballista also check for UI prettier changes <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/578">#578</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>turn on clippy rule for needless borrow <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/545">#545</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>reuse datafusion physical planner in ballista building from protobuf <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/532">#532</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>update cargo.toml in python crate and fix unit test due to hash joins <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/483">#483</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>make <code class="docutils literal notranslate"><span class="pre">VOLUME</span></code> declaration in tpch datagen docker absolute <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/466">#466</a> (<a class="reference external" href="https://github.com/crepererum">crepererum</a>)</p></li>
+<li><p>Refactor QueryStageExec in preparation for implementing map-side shuffle <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/459">#459</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Simplified usage of <code class="docutils literal notranslate"><span class="pre">use</span> <span class="pre">arrow</span></code> in ballista. <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/447">#447</a> (<a class="reference external" href="https://github.com/jorgecarleitao">jorgecarleitao</a>)</p></li>
+<li><p>Benchmark subcommand to distinguish between DataFusion and Ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/402">#402</a> (<a class="reference external" href="https://github.com/jgoday">jgoday</a>)</p></li>
+<li><p>#352: BallistaContext::collect() logging is too noisy <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/394">#394</a> (<a class="reference external" href="https://github.com/jgoday">jgoday</a>)</p></li>
+<li><p>cleanup function return type fn <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/350">#350</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Update Ballista to use new physical plan formatter utility <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/344">#344</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update arrow dependencies again <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/341">#341</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Remove references to Ballista Docker images published to ballistacompute Docker Hub repo <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/326">#326</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update arrow-rs deps <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/317">#317</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Update arrow deps <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/269">#269</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Enable redundant_field_names clippy lint <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/261">#261</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Update arrow-rs deps (to fix build due to flatbuffers update) <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/224">#224</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>update arrow-rs deps to latest master <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/216">#216</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+</ul>
+<p>* <em>This Changelog was automatically generated by <a class="reference external" href="https://github.com/github-changelog-generator/github-changelog-generator">github_changelog_generator</a></em></p>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="0.6.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.6.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="../contributors-guide/architecture.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Ballista Architecture</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.5.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.5.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/changelog/0.6.0.html b/changelog/0.6.0.html
new file mode 100644
index 000000000..c3c78c013
--- /dev/null
+++ b/changelog/0.6.0.html
@@ -0,0 +1,564 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.6.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.6.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.5.0 Changelog" href="0.5.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.7.0 Changelog" href="0.7.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.6.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-6-0-changelog">
+<h1>Apache DataFusion Ballista 0.6.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-6-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/arrow-datafusion/compare/ballista-0.5.0...ballista-0.6.0">Full Changelog</a></p>
+<p><strong>Breaking changes:</strong></p>
+<ul class="simple">
+<li><p>File partitioning for ListingTable <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1141">#1141</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Register tables in BallistaContext using TableProviders instead of Dataframe <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1028">#1028</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Make TableProvider.scan() and PhysicalPlanner::create_physical_plan() async <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1013">#1013</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Reorganize table providers by table format <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1010">#1010</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Move CBOs and Statistics to physical plan <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/965">#965</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Update to sqlparser v 0.10.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/934">#934</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>FilePartition and PartitionedFile for scanning flexibility <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/932">#932</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>Improve SQLMetric APIs, port existing metrics <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/908">#908</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Add support for EXPLAIN ANALYZE <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/858">#858</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Rename concurrency to target_partitions <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/706">#706</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Update datafusion-cli to support Ballista, or implement new ballista-cli <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/886">#886</a></p></li>
+<li><p>Prepare Ballista crates for publishing <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/509">#509</a></p></li>
+<li><p>Add drop table support <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1266">#1266</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/viirya">viirya</a>)</p></li>
+<li><p>use arrow 6.1.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1255">#1255</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Add support for <code class="docutils literal notranslate"><span class="pre">create</span> <span class="pre">table</span> <span class="pre">as</span></code> via MemTable <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1243">#1243</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>add values list expression <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1165">#1165</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Multiple files per partitions for CSV Avro Json <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1138">#1138</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Implement INTERSECT &amp; INTERSECT DISTINCT <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1135">#1135</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/xudong963">xudong963</a>)</p></li>
+<li><p>Simplify file struct abstractions <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1120">#1120</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>Implement <code class="docutils literal notranslate"><span class="pre">is</span> <span class="pre">[not]</span> <span class="pre">distinct</span> <span class="pre">from</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1117">#1117</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>add digest(utf8, method) function and refactor all current hash digest functions <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1090">#1090</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>[crypto] add <code class="docutils literal notranslate"><span class="pre">blake3</span></code> algorithm to <code class="docutils literal notranslate"><span class="pre">digest</span></code> function <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1086">#1086</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>[crypto] add blake2b and blake2s functions <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1081">#1081</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Update sqlparser-rs to 0.11 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1052">#1052</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>remove hard coded partition count in ballista logicalplan deserialization <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1044">#1044</a> (<a class="reference external" href="https://github.com/xudong963">xudong963</a>)</p></li>
+<li><p>Indexed field access for List <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1006">#1006</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/Igosuki">Igosuki</a>)</p></li>
+<li><p>Update DataFusion to arrow 6.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/984">#984</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Implement Display for Expr, improve operator display <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/971">#971</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>ObjectStore API to read from remote storage systems <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/950">#950</a> (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>fixes #933 replace placeholder fmt_as fr ExecutionPlan impls <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/939">#939</a> (<a class="reference external" href="https://github.com/tiphaineruy">tiphaineruy</a>)</p></li>
+<li><p>Support <code class="docutils literal notranslate"><span class="pre">NotLike</span></code> in Ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/916">#916</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Avro Table Provider <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/910">#910</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/Igosuki">Igosuki</a>)</p></li>
+<li><p>Add BaselineMetrics, Timestamp metrics, add for <code class="docutils literal notranslate"><span class="pre">CoalescePartitionsExec</span></code>, rename output_time -&gt; elapsed_compute <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/909">#909</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>[Ballista] Add executor last seen info to the ui <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/895">#895</a> (<a class="reference external" href="https://github.com/msathis">msathis</a>)</p></li>
+<li><p>add cross join support to ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/891">#891</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+<li><p>Add Ballista support to DataFusion CLI <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/889">#889</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add support for PostgreSQL regex match <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/870">#870</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/b41sh">b41sh</a>)</p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>Test execution_plans::shuffle_writer::tests::test Fail <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/1040">#1040</a></p></li>
+<li><p>Integration test fails to build docker images <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/918">#918</a></p></li>
+<li><p>Ballista: Remove hard-coded concurrency from logical plan serde code <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/708">#708</a></p></li>
+<li><p>How can I make ballista distributed compute work? <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/327">#327</a></p></li>
+<li><p>fix subquery alias <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1067">#1067</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/xudong963">xudong963</a>)</p></li>
+<li><p>Fix compilation for ballista in stand-alone mode <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1008">#1008</a> (<a class="reference external" href="https://github.com/Igosuki">Igosuki</a>)</p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>Add Ballista roadmap <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1166">#1166</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Adds note on compatible rust version <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1097">#1097</a> (<a class="reference external" href="https://github.com/1nF0rmed">1nF0rmed</a>)</p></li>
+<li><p>implement <code class="docutils literal notranslate"><span class="pre">approx_distinct</span></code> function using HyperLogLog <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1087">#1087</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Improve User Guide <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/954">#954</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update plan_query_stages doc <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/951">#951</a> (<a class="reference external" href="https://github.com/rdettai">rdettai</a>)</p></li>
+<li><p>[DataFusion] - Add show and show_limit function for DataFrame <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/923">#923</a> (<a class="reference external" href="https://github.com/francis-du">francis-du</a>)</p></li>
+<li><p>update docs related to protoc and optional syntax <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/902">#902</a> (<a class="reference external" href="https://github.com/Jimexist">Jimexist</a>)</p></li>
+<li><p>Improve Ballista crate README content <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/878">#878</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Performance improvements:</strong></p>
+<ul class="simple">
+<li><p>optimize build profile for datafusion python binding, cli and ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1137">#1137</a> (<a class="reference external" href="https://github.com/houqp">houqp</a>)</p></li>
+</ul>
+<p><strong>Closed issues:</strong></p>
+<ul class="simple">
+<li><p>InList expr with NULL literals do not work <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/1190">#1190</a></p></li>
+<li><p>update the homepage README to include values, <code class="docutils literal notranslate"><span class="pre">approx_distinct</span></code>, etc. <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/1171">#1171</a></p></li>
+<li><p>[Python]: Inconsistencies with Python package name <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/1011">#1011</a></p></li>
+<li><p>Wanting to contribute to project where to start? <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/983">#983</a></p></li>
+<li><p>delete redundant code <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/973">#973</a></p></li>
+<li><p>How to build DataFusion python wheel <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/853">#853</a></p></li>
+<li><p>Produce a design for a metrics framework <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/21">#21</a></p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>[nit] simplify ballista executor <code class="docutils literal notranslate"><span class="pre">CollectExec</span></code> impl codes <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1140">#1140</a> (<a class="reference external" href="https://github.com/panarch">panarch</a>)</p></li>
+</ul>
+<p>For older versions, see <a class="reference external" href="https://github.com/apache/arrow/blob/master/CHANGELOG.md">apache/arrow/CHANGELOG.md</a></p>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="0.7.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.7.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.5.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.5.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.6.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.6.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/changelog/0.7.0.html b/changelog/0.7.0.html
new file mode 100644
index 000000000..f9e15a539
--- /dev/null
+++ b/changelog/0.7.0.html
@@ -0,0 +1,625 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.7.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.7.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.6.0 Changelog" href="0.6.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.8.0 Changelog" href="0.8.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.7.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-7-0-changelog">
+<h1>Apache DataFusion Ballista 0.7.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-7-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/arrow-datafusion/compare/7.1.0-rc1...ballista-0.7.0">Full Changelog</a></p>
+<p><strong>Breaking changes:</strong></p>
+<ul class="simple">
+<li><p>Make <code class="docutils literal notranslate"><span class="pre">ExecutionPlan::execute</span></code> Sync <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2434">#2434</a> (<a class="reference external" href="https://github.com/tustvold">tustvold</a>)</p></li>
+<li><p>Add <code class="docutils literal notranslate"><span class="pre">Expr::Exists</span></code> to represent EXISTS subquery expression <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2339">#2339</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Remove dependency from <code class="docutils literal notranslate"><span class="pre">LogicalPlan::TableScan</span></code> to <code class="docutils literal notranslate"><span class="pre">ExecutionPlan</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2284">#2284</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Move logical expression type-coercion code from <code class="docutils literal notranslate"><span class="pre">physical-expr</span></code> crate to <code class="docutils literal notranslate"><span class="pre">expr</span></code> crate <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2257">#2257</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>feat: 2061 create external table ddl table partition cols <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2099">#2099</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/jychen7">jychen7</a>)</p></li>
+<li><p>Reorganize the project folders <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2081">#2081</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Support more ScalarFunction in Ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2008">#2008</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Merge dataframe and dataframe imp <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1998">#1998</a> (<a class="reference external" href="https://github.com/vchag">vchag</a>)</p></li>
+<li><p>Rename <code class="docutils literal notranslate"><span class="pre">ExecutionContext</span></code> to <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code>, <code class="docutils literal notranslate"><span class="pre">ExecutionContextState</span></code> to <code class="docutils literal notranslate"><span class="pre">SessionState</span></code>, add <code class="docutils literal notranslate"><span class="pre">TaskContext</span></code> to support m [...]
+<li><p>Add Coalesce function <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1969">#1969</a> (<a class="reference external" href="https://github.com/msathis">msathis</a>)</p></li>
+<li><p>Add Create Schema functionality in SQL <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1959">#1959</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>remove sync constraint of SendableRecordBatchStream <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1884">#1884</a> (<a class="reference external" href="https://github.com/doki23">doki23</a>)</p></li>
+</ul>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Add <code class="docutils literal notranslate"><span class="pre">CREATE</span> <span class="pre">VIEW</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2279">#2279</a> (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>[Ballista] Support Union in ballista. <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2098">#2098</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Add missing aggr_expr to PhysicalExprNode for Ballista. <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1989">#1989</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>Ballista integration tests no longer work <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2440">#2440</a></p></li>
+<li><p>Ballista crates cannot be released from DafaFusion 7.0.0 source release <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/1980">#1980</a></p></li>
+<li><p>protobuf OctetLength should be deserialized as octet_length, not length <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1834">#1834</a> (<a class="reference external" href="https://github.com/carols10cents">carols10cents</a>)</p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>MINOR: Make crate READMEs consistent <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2437">#2437</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>docs: Update the Ballista dev env instructions <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2419">#2419</a> (<a class="reference external" href="https://github.com/haoxins">haoxins</a>)</p></li>
+<li><p>Revise document of installing ballista pinned to specified version <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2034">#2034</a> (<a class="reference external" href="https://github.com/WinkerDu">WinkerDu</a>)</p></li>
+<li><p>Fix typos (Datafusion -&gt; DataFusion) <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1993">#1993</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Performance improvements:</strong></p>
+<ul class="simple">
+<li><p>Introduce StageManager for managing tasks stage by stage <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1983">#1983</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+</ul>
+<p><strong>Closed issues:</strong></p>
+<ul class="simple">
+<li><p>Make expected result string in unit tests more readable <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2412">#2412</a></p></li>
+<li><p>remove duplicated <code class="docutils literal notranslate"><span class="pre">fn</span> <span class="pre">aggregate()</span></code> in aggregate expression tests <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2399">#2399</a></p></li>
+<li><p>split <code class="docutils literal notranslate"><span class="pre">distinct_expression.rs</span></code> into <code class="docutils literal notranslate"><span class="pre">count_distinct.rs</span></code> and <code class="docutils literal notranslate"><span class="pre">array_agg_distinct.rs</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2385">#2385</a></p></li>
+<li><p>move sql tests in <code class="docutils literal notranslate"><span class="pre">context.rs</span></code> to corresponding test files in <code class="docutils literal notranslate"><span class="pre">datafustion/core/tests/sql</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2328">#2328</a></p></li>
+<li><p>Date32/Date64 as join keys for merge join <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2314">#2314</a></p></li>
+<li><p>Error precision and scale for decimal coercion in logic comparison <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2232">#2232</a></p></li>
+<li><p>Support Multiple row layout <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/2188">#2188</a></p></li>
+<li><p>Discussion: Is Ballista a standalone system or framework <a class="reference external" href="https://github.com/apache/arrow-datafusion/issues/1916">#1916</a></p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>MINOR: Enable multi-statement benchmark queries <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2507">#2507</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Persist session configs in scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2501">#2501</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Update to <code class="docutils literal notranslate"><span class="pre">sqlparser</span></code> <code class="docutils literal notranslate"><span class="pre">0.17.0</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2500">#2500</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Limit cpu cores used when generating changelog <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2494">#2494</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>MINOR: Parameterize changelog script <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2484">#2484</a> (<a class="reference external" href="https://github.com/jychen7">jychen7</a>)</p></li>
+<li><p>Fix stage key extraction <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2472">#2472</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Add support for list_dir() on local fs <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2467">#2467</a> (<a class="reference external" href="https://github.com/wjones127">wjones127</a>)</p></li>
+<li><p>minor: update versions and paths in changelog scripts <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2429">#2429</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Fix Ballista executing during plan <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2428">#2428</a> (<a class="reference external" href="https://github.com/tustvold">tustvold</a>)</p></li>
+<li><p>Re-organize and rename aggregates physical plan <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2388">#2388</a> (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>Upgrade to arrow 13 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2382">#2382</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Grouped Aggregate in row format <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2375">#2375</a> (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>Stop optimizing queries twice <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2369">#2369</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Bump follow-redirects from 1.13.2 to 1.14.9 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2325">#2325</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Move FileType enum from sql module to logical_plan module <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2290">#2290</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add BatchPartitioner (#2285) <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2287">#2287</a> (<a class="reference external" href="https://github.com/tustvold">tustvold</a>)</p></li>
+<li><p>Update uuid requirement from 0.8 to 1.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2280">#2280</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump async from 2.6.3 to 2.6.4 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2277">#2277</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump minimist from 1.2.5 to 1.2.6 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2276">#2276</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump url-parse from 1.5.1 to 1.5.10 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2275">#2275</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump nanoid from 3.1.20 to 3.3.3 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2274">#2274</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Update to Arrow 12.0.0, update tonic and prost <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2253">#2253</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Add ExecutorMetricsCollector interface <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2234">#2234</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>minor: add editor config file <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2224">#2224</a> (<a class="reference external" href="https://github.com/jackwener">jackwener</a>)</p></li>
+<li><p>[Ballista] Enable ApproxPercentileWithWeight in Ballista and fill UT <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2192">#2192</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>make nightly clippy happy <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2186">#2186</a> (<a class="reference external" href="https://github.com/xudong963">xudong963</a>)</p></li>
+<li><p>[Ballista]Make PhysicalAggregateExprNode has repeated PhysicalExprNode <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2184">#2184</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Add LogicalPlan::SubqueryAlias <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2172">#2172</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Implement fast path of with_new_children() in ExecutionPlan <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2168">#2168</a> (<a class="reference external" href="https://github.com/mingmwang">mingmwang</a>)</p></li>
+<li><p>[MINOR] ignore suspicious slow test in Ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2167">#2167</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>enable explain for ballista <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2163">#2163</a> (<a class="reference external" href="https://github.com/doki23">doki23</a>)</p></li>
+<li><p>Add delimiter for create external table <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2162">#2162</a> (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>Update sqlparser requirement from 0.15 to 0.16 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2152">#2152</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Add IF NOT EXISTS to <code class="docutils literal notranslate"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> and <code class="docutils literal notranslate"><span class="pre">CREATE</span> <span class="pre">EXTERNAL</span> <span class="pre">TABLE</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2143">#2143</a> (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>Update quarterly roadmap for Q2 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2133">#2133</a> (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>[Ballista] Add ballista plugin manager and UDF plugin <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2131">#2131</a> (<a class="reference external" href="https://github.com/gaojun2048">gaojun2048</a>)</p></li>
+<li><p>Serialize scalar UDFs in physical plan <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2130">#2130</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>doc: update release schedule <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2110">#2110</a> (<a class="reference external" href="https://github.com/jychen7">jychen7</a>)</p></li>
+<li><p>Reduce repetition in Decimal binary kernels, upgrade to arrow 11.1 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2107">#2107</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>update zlib version to 1.2.12 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2106">#2106</a> (<a class="reference external" href="https://github.com/waitingkuo">waitingkuo</a>)</p></li>
+<li><p>Add CREATE DATABASE command to SQL <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2094">#2094</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>Refactor SessionContext, BallistaContext to support multi-tenancy configurations - Part 3 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2091">#2091</a> (<a class="reference external" href="https://github.com/mingmwang">mingmwang</a>)</p></li>
+<li><p>Remove dependency of common for the storage crate <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2076">#2076</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>[MINOR] fix doc in `EXTRACT(field FROM source) <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2074">#2074</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>[Bug][Datafusion] fix TaskContext session_config bug <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2070">#2070</a> (<a class="reference external" href="https://github.com/gaojun2048">gaojun2048</a>)</p></li>
+<li><p>Short-circuit evaluation for <code class="docutils literal notranslate"><span class="pre">CaseWhen</span></code> <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2068">#2068</a> (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>split datafusion-object-store module <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2065">#2065</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Change log level for noisy logs <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2060">#2060</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Update to arrow/parquet 11.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2048">#2048</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>minor: format comments (<code class="docutils literal notranslate"><span class="pre">//</span></code> to <code class="docutils literal notranslate"><span class="pre">//</span></code>) <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2047">#2047</a> (<a class="reference external" href="https://github.com/jackwener">jackwener</a>)</p></li>
+<li><p>use cargo-tomlfmt to check Cargo.toml formatting in CI <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2033">#2033</a> (<a class="reference external" href="https://github.com/WinkerDu">WinkerDu</a>)</p></li>
+<li><p>Refactor SessionContext, SessionState and SessionConfig to support multi-tenancy configurations - Part 2 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2029">#2029</a> (<a class="reference external" href="https://github.com/mingmwang">mingmwang</a>)</p></li>
+<li><p>Simplify prerequisites for running examples <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2028">#2028</a> (<a class="reference external" href="https://github.com/doki23">doki23</a>)</p></li>
+<li><p>Use SessionContext to parse Expr protobuf <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2024">#2024</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Fix stuck issue for the load testing of Push-based task scheduling <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/2006">#2006</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Fixing a typo in documentation <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1997">#1997</a> (<a class="reference external" href="https://github.com/psvri">psvri</a>)</p></li>
+<li><p>Fix minor clippy issue <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1995">#1995</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Make it possible to only scan part of a parquet file in a partition <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1990">#1990</a> (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>Update Dockerfile to fix integration tests <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1982">#1982</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Update sqlparser requirement from 0.14 to 0.15 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1966">#1966</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>fix logical conflict with protobuf <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1958">#1958</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Update to arrow 10.0.0, pyo3 0.16 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1957">#1957</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>update jit-related dependencies <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1953">#1953</a> (<a class="reference external" href="https://github.com/xudong963">xudong963</a>)</p></li>
+<li><p>Allow different types of query variables (<code class="docutils literal notranslate"><span class="pre">&#64;&#64;var</span></code>) rather than just string <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1943">#1943</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/maxburke">maxburke</a>)</p></li>
+<li><p>Pruning serialization <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1941">#1941</a> (<a class="reference external" href="https://github.com/thinkharderdev">thinkharderdev</a>)</p></li>
+<li><p>Fix select from EmptyExec always return 0 row after optimizer passes <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1938">#1938</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Introduce Ballista query stage scheduler <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1935">#1935</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add db benchmark script <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1928">#1928</a> (<a class="reference external" href="https://github.com/matthewmturner">matthewmturner</a>)</p></li>
+<li><p>fix a typo <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1919">#1919</a> (<a class="reference external" href="https://github.com/vchag">vchag</a>)</p></li>
+<li><p>[MINOR] Update copyright year in Docs <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1918">#1918</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>add metadata to DFSchema, close #1806. <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1914">#1914</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/jiacai2050">jiacai2050</a>)</p></li>
+<li><p>Refactor scheduler state mod <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1913">#1913</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Refactor the event channel <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1912">#1912</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Refactor scheduler server <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1911">#1911</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Clippy fix on nightly <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1907">#1907</a> (<a class="reference external" href="https://github.com/yjshen">yjshen</a>)</p></li>
+<li><p>Updated Rust version to 1.59 in all the files <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1903">#1903</a> (<a class="reference external" href="https://github.com/NaincyKumariKnoldus">NaincyKumariKnoldus</a>)</p></li>
+<li><p>Remove uneeded Mutex in Ballista Client <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1898">#1898</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Create a <code class="docutils literal notranslate"><span class="pre">datafusion-proto</span></code> crate for datafusion protobuf serialization <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1887">#1887</a> (<a class="reference external" href="https://github.com/carols10cents">carols10cents</a>)</p></li>
+<li><p>Fix clippy lints <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1885">#1885</a> (<a class="reference external" href="https://github.com/HaoYang670">HaoYang670</a>)</p></li>
+<li><p>Separate cpu-bound (query-execution) and IO-bound(heartbeat) to … <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1883">#1883</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>[Minor] Clean up DecimalArray API Usage <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1869">#1869</a> [<a class="reference external" href="https://github.com/apache/arrow-datafusion/labels/sql">sql</a>] (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Changes after went through “Datafusion as a library section” <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1868">#1868</a> (<a class="reference external" href="https://github.com/nonontb">nonontb</a>)</p></li>
+<li><p>Remove allow unused imports from ballista-core, then fix all warnings <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1853">#1853</a> (<a class="reference external" href="https://github.com/carols10cents">carols10cents</a>)</p></li>
+<li><p>Update to arrow 9.1.0 <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1851">#1851</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>move some tests out of context and into sql <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1846">#1846</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Fix compiling ballista in standalone mode, add build to CI <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1839">#1839</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Update documentation example for change in API <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1812">#1812</a> (<a class="reference external" href="https://github.com/alamb">alamb</a>)</p></li>
+<li><p>Refactor scheduler state with different management policy for volatile and stable states <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1810">#1810</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>DataFusion + Conbench Integration <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1791">#1791</a> (<a class="reference external" href="https://github.com/dianaclarke">dianaclarke</a>)</p></li>
+<li><p>Enable periodic cleanup of work_dir directories in ballista executor <a class="reference external" href="https://github.com/apache/arrow-datafusion/pull/1783">#1783</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Use<code class="docutils literal notranslate"><span class="pre">eq_dyn</span></code>, <code class="docutils literal notranslate"><span class="pre">neq_dyn</span></code>, <code class="docutils literal notranslate"><span class="pre">lt_dyn</span></code>, <code class="docutils literal notranslate"><span class="pre">lt_eq_dyn</span></code>, <code class="docutils literal notranslate"><span class="pre">gt_dyn</span></code>, <code class="docutils literal notranslate"><span class="pre">gt [...]
+</ul>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="0.8.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.8.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.6.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.6.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.7.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.7.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/community/communication.html b/changelog/0.8.0.html
similarity index 59%
copy from community/communication.html
copy to changelog/0.8.0.html
index d8f348d0e..09d6f96e6 100644
--- a/community/communication.html
+++ b/changelog/0.8.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Communication &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 0.8.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,11 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.8.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.7.0 Changelog" href="0.7.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.9.0 Changelog" href="0.9.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -263,6 +264,31 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
 <ul class="nav bd-sidenav">
 <li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -271,8 +297,8 @@
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
 </ul>
@@ -317,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.8.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -334,44 +363,69 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+<section id="apache-datafusion-ballista-0-8-0-changelog">
+<h1>Apache DataFusion Ballista 0.8.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-8-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/0.7.0...0.8.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Executor should use all available cores by default <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/218">#218</a></p></li>
+<li><p>Update task status to the task job curator scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/179">#179</a></p></li>
+<li><p>update datafusion and arrow to 20.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/176">#176</a></p></li>
+<li><p>No scheduler logs when deployed to k8s <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/165">#165</a></p></li>
+<li><p>Upgrade to DataFusion 11.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/163">#163</a></p></li>
+<li><p>Better encapsulation for ExecutionGraph <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/149">#149</a></p></li>
+<li><p>A stage may act as the input of multiple stages <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/144">#144</a></p></li>
+<li><p>Executor Lost handling <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/143">#143</a></p></li>
+<li><p>Cancel a running query. <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/139">#139</a></p></li>
+<li><p>Ignore the previous job_id inside fill_reservations() <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/138">#138</a></p></li>
+<li><p>Normalize the serialization and deserialization places of protobuf structs <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/137">#137</a></p></li>
+<li><p>Remove revive offer event loop <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/136">#136</a></p></li>
+<li><p>Remove Keyspace::QueuedJobs <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/133">#133</a></p></li>
+<li><p>Spawn a thread for execution plan generation <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/131">#131</a></p></li>
+<li><p>Introduce CuratorTaskManager for make an active job be curated by only one scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/130">#130</a></p></li>
+<li><p>Using tokio tracing for log file <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/122">#122</a></p></li>
+<li><p>Ballista Executor report plan/operators metrics to Ballista Scheduler when task finish <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/116">#116</a></p></li>
+<li><p>Add timeout settings for Grpc Client <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/114">#114</a></p></li>
+<li><p>Add log level config in ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/102">#102</a></p></li>
+<li><p>Use another channel to update the status of a task set for executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/96">#96</a></p></li>
+<li><p>Add config for concurrent_task in executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/94">#94</a></p></li>
+<li><p>Ballista should support Arrow FlightSQL <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/92">#92</a></p></li>
+<li><p>Why not include the <code class="docutils literal notranslate"><span class="pre">ballista-cli</span></code> in the member of workspace <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/88">#88</a></p></li>
+<li><p>Upgrade dependency of arrow-datafusion to commit d0d5564b8f689a01e542b8c1df829d74d0fab2b0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/84">#84</a></p></li>
+<li><p>Support sled path in config file. <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/79">#79</a></p></li>
+<li><p>Support for multi-scheduler deployments <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/39">#39</a></p></li>
+<li><p>Ballista 0.7.0 Release <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/126">#126</a></p></li>
+<li><p>Improvements to Ballista extensibility <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/8">#8</a></p></li>
+<li><p>Implement Python bindings for BallistaContext <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/15">#15</a></p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>Run example fails via PushStaged mode <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/214">#214</a></p></li>
+<li><p>Config settings in BallistaContext do not get passed to DataFusion context <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/213">#213</a></p></li>
+<li><p>Start scheduler fails with arguments “-s PushStaged” <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/207">#207</a></p></li>
+<li><p>FlightSQL is broken and CI isn’t catching it <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/190">#190</a></p></li>
+<li><p>Query fails with “NULL is invalid as a DataFusion scalar value” <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/180">#180</a></p></li>
+<li><p>Executor doesn’t compile, missing <code class="docutils literal notranslate"><span class="pre">tokio::signal</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/171">#171</a></p></li>
+<li><p>Unable to build master <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/76">#76</a></p></li>
+</ul>
 </section>
 
 
@@ -385,13 +439,22 @@ quick and small design discussions. For major design change proposals, we encour
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="../contributors-guide/development.html"
+       href="0.9.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.9.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.7.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.7.0 Changelog</p>
       </div>
+      <i class="fa-solid fa-angle-right"></i>
     </a>
 </div>
                 </footer>
@@ -405,22 +468,10 @@ quick and small design discussions. For major design change proposals, we encour
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.8.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -435,7 +486,7 @@ quick and small design discussions. For major design change proposals, we encour
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/community/communication.md.txt">
+    <a href="../_sources/changelog/0.8.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/changelog/0.9.0.html b/changelog/0.9.0.html
new file mode 100644
index 000000000..5adc1f4a7
--- /dev/null
+++ b/changelog/0.9.0.html
@@ -0,0 +1,644 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 0.9.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/0.9.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.8.0 Changelog" href="0.8.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 0.10.0 Changelog" href="0.10.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 0.9.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-0-9-0-changelog">
+<h1>Apache DataFusion Ballista 0.9.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-0-9-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/0.8.0...0.9.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>Support count distinct aggregation function <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/411">#411</a></p></li>
+<li><p>Use multi-task definition in pull-based execution loop <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/400">#400</a></p></li>
+<li><p>Make the scheduler event loop buffer size configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/397">#397</a></p></li>
+<li><p>Remove active execution graph when the related job is successful or failed. <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/391">#391</a></p></li>
+<li><p>Improve launch task efficiency by calling LaunchMultiTask <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/389">#389</a></p></li>
+<li><p>Use <code class="docutils literal notranslate"><span class="pre">tokio::sync::Semaphore</span></code> to wait for available task slots <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/388">#388</a></p></li>
+<li><p>stdout and file log level settings are inconsistent <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/385">#385</a></p></li>
+<li><p>Use dedicated executor in pull based loop <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/383">#383</a></p></li>
+<li><p>Avoid calling scheduler when the executor cannot accept new tasks <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/377">#377</a></p></li>
+<li><p>Add round robin executor slots reservation policy for the scheduler to evenly assign tasks to executors <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/371">#371</a></p></li>
+<li><p>Switch to mimalloc and enable by default <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/369">#369</a></p></li>
+<li><p>Integration test script should use docker-compose <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/364">#364</a></p></li>
+<li><p>Use local shuffle reader in containerized environments <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/356">#356</a></p></li>
+<li><p>Add <code class="docutils literal notranslate"><span class="pre">--ext</span></code> option to benchmark <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/352">#352</a></p></li>
+<li><p>Add job cancel in the UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/350">#350</a></p></li>
+<li><p>Using local shuffle reader avoid flight rpc call. <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/346">#346</a></p></li>
+<li><p>Add a Helm Chart <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/321">#321</a></p></li>
+<li><p>[UI] Show list of query stages with metrics <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/306">#306</a></p></li>
+<li><p>[UI] Add ability to specify job name and have it show in the job listing page in the UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/277">#277</a></p></li>
+<li><p>[UI] Add ability to download query plans in dot format <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/276">#276</a></p></li>
+<li><p>[UI] Add ability to render query plans <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/275">#275</a></p></li>
+<li><p>Add REST API documentation to User Guide <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/272">#272</a></p></li>
+<li><p>Graceful shutdown: Handle <code class="docutils literal notranslate"><span class="pre">SIGTERM</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/266">#266</a></p></li>
+<li><p>[EPIC] Scheduler UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/265">#265</a></p></li>
+<li><p>Introduce the datafusion-objectstore-hdfs in datafusion-contrib as an object store feature <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/259">#259</a></p></li>
+<li><p>Add a feature based object store provider <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/257">#257</a></p></li>
+<li><p>Add docker build files <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/248">#248</a></p></li>
+<li><p>Allow IDEs to recognize generated code <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/246">#246</a></p></li>
+<li><p>Add user guide section on Flight SQL support <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/230">#230</a></p></li>
+<li><p><code class="docutils literal notranslate"><span class="pre">dev/release/README.md</span></code> is outdated <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/228">#228</a></p></li>
+<li><p>Make ShuffleReaderExec output less verbose <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/211">#211</a></p></li>
+<li><p>Add LaunchMultiTask rpc interface for executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/209">#209</a></p></li>
+<li><p>Make executor fetch shuffle partition data in parallel <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/208">#208</a></p></li>
+<li><p>Concurrency control and rate limit during shuffle reader <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/195">#195</a></p></li>
+<li><p>Update User Guide <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/160">#160</a></p></li>
+<li><p>Ballista 0.8.0 Release <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/159">#159</a></p></li>
+<li><p>Save encoded execution plan in the ExecutionStage to reduce cost of task serialization and deserialization <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/142">#142</a></p></li>
+<li><p>Failed task retry <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/140">#140</a></p></li>
+<li><p>Redefine the executor task slots <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/132">#132</a></p></li>
+<li><p>Use ArrowFlight bearer token auth to create a session key for FlightSql clients <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/112">#112</a></p></li>
+<li><p>Leverage Atomic for the in-memory states in Scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/101">#101</a></p></li>
+<li><p>Introduce the object stores in datafusion-contrib as optional features <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/87">#87</a></p></li>
+<li><p>Support multiple paths for ListingTableScanNode <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/75">#75</a></p></li>
+<li><p>Need clean up intermediate data in Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/9">#9</a></p></li>
+<li><p>Ballista does not support external file systems <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/10">#10</a></p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>Build errors in ./dev/build-ballista-rust.sh <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/407">#407</a></p></li>
+<li><p>The Ballista Scheduler Dockerfile copies a file that no longer exists <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/402">#402</a></p></li>
+<li><p>Benchmark q20 fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/374">#374</a></p></li>
+<li><p>Integration tests fail <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/360">#360</a></p></li>
+<li><p>Helm deploy fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/344">#344</a></p></li>
+<li><p>Executor get stopped unexpected <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/333">#333</a></p></li>
+<li><p>Executor poll work loop failure <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/311">#311</a></p></li>
+<li><p>Queries with <code class="docutils literal notranslate"><span class="pre">LIMIT</span></code> are failing with “PhysicalExtensionCodec is not provided” <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/300">#300</a></p></li>
+<li><p>Schema inference does not work in Ballista-cli with a remote context <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/287">#287</a></p></li>
+<li><p>There are bugs in the yarn build github misses but break our internal build <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/270">#270</a></p></li>
+<li><p>Race condition running docker-compose <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/267">#267</a></p></li>
+<li><p>Scheduler UI not working in Docker image <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/250">#250</a></p></li>
+<li><p>Use bind host rather than the external host for starting a local executor service <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/244">#244</a></p></li>
+<li><p>Initial query stages read parquet files and repartition them needlessly <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/243">#243</a></p></li>
+<li><p>Cannot build Docker images on macOS 12.5.1 with M1 chip <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/234">#234</a></p></li>
+<li><p>CLI uses DataFusion context if no host or port are provided <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/219">#219</a></p></li>
+<li><p>Unsupported binary operator <code class="docutils literal notranslate"><span class="pre">StringConcat</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/201">#201</a></p></li>
+<li><p>Ballista assumes all aggregate expressions are not DISTINCT <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/5">#5</a></p></li>
+<li><p>Start ballista ui with docker, but it can not found ballista scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/11">#11</a></p></li>
+<li><p>Cannot build Ballista docker images on Apple silicon <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/17">#17</a></p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>Fixup links in README.md <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/366">#366</a> (<a class="reference external" href="https://github.com/romanz">romanz</a>)</p></li>
+<li><p>Update README in preparation for 0.9.0 release <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/318">#318</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>User Guide improvements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/274">#274</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+</ul>
+<p><strong>Closed issues:</strong></p>
+<ul class="simple">
+<li><p>Automatic version updates for github actions with dependabot <a class="reference external" href="https://github.com/apache/datafusion-ballista/issues/127">#127</a></p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>Return multiple tasks in poll_work based on free slots <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/429">#429</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Run integration tests as part of release verification script <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/426">#426</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Bump actions/setup-node from 2 to 3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/424">#424</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump actions/setup-python from 2 to 4 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/423">#423</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump actions/checkout from 2 to 3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/422">#422</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump actions/download-artifact from 2 to 3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/421">#421</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump actions/upload-artifact from 2 to 3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/420">#420</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>MINOR: Fix yarn warnings <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/415">#415</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Fix q20 sql typo in benchmarks <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/409">#409</a> (<a class="reference external" href="https://github.com/r4ntix">r4ntix</a>)</p></li>
+<li><p>MINOR: Add notes on Apache Reporter <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/401">#401</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Use local shuffle reader in containerized environments and some impro… <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/399">#399</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Make the scheduler event loop buffer size configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/398">#398</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add RoundRobinLocal slots policy for caching executor data to avoid seld persistency <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/396">#396</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add round robin executor slots reservation policy for the scheduler to evenly assign tasks to executors <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/395">#395</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Improve launch task efficiency by calling LaunchMultiTask <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/394">#394</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Cache encoded stage plan <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/393">#393</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Remove active execution graph when the related job is successful or failed <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/392">#392</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Update flatbuffers requirement from 2.1.2 to 22.9.29 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/390">#390</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Unified the log level configuration behavior <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/386">#386</a> (<a class="reference external" href="https://github.com/r4ntix">r4ntix</a>)</p></li>
+<li><p>Add DistinctCount support <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/384">#384</a> (<a class="reference external" href="https://github.com/r4ntix">r4ntix</a>)</p></li>
+<li><p>Pull-based execution loop improvements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/380">#380</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Fix latest commit <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/379">#379</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Avoid calling scheduler when the executor cannot accept new tasks <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/378">#378</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Switch to mimalloc and enable by default in executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/370">#370</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Benchmark looks for path with and without extension <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/354">#354</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Implement job cancellation in UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/349">#349</a> (<a class="reference external" href="https://github.com/Dandandan">Dandandan</a>)</p></li>
+<li><p>Using local shuffle reader avoid flight rpc call. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/347">#347</a> (<a class="reference external" href="https://github.com/Ted-Jiang">Ted-Jiang</a>)</p></li>
+<li><p>Make helm deployable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/345">#345</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Benchmark &amp; UI improvements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/343">#343</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add <code class="docutils literal notranslate"><span class="pre">cancel_job</span></code> REST API <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/340">#340</a> (<a class="reference external" href="https://github.com/tfeda">tfeda</a>)</p></li>
+<li><p>Fix labeler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/337">#337</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Upgrade to DataFusion 13.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/336">#336</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Check executor id consistency when receive stop executor request <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/335">#335</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Enable more benchmark serde tests <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/331">#331</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Downgrade <code class="docutils literal notranslate"><span class="pre">docker-compose.yaml</span></code> to version 3.3 so that we can support Ubuntu 20.04.4 LTS <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/329">#329</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>update labeler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/326">#326</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Upgrade to DataFusion 13.0.0-rc1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/325">#325</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Dependabot stop suggesting arrow and datafusion updates <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/324">#324</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Show job stages metrics <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/323">#323</a> (<a class="reference external" href="https://github.com/onthebridgetonowhere">onthebridgetonowhere</a>)</p></li>
+<li><p>Add helm chart <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/322">#322</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Atomic support for enhancement <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/319">#319</a> (<a class="reference external" href="https://github.com/metesynnada">metesynnada</a>)</p></li>
+<li><p>Allow automatic schema inference when registering csv <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/313">#313</a> (<a class="reference external" href="https://github.com/r4ntix">r4ntix</a>)</p></li>
+<li><p>Add ability to specify job name and have it show in the job listing page in the UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/312">#312</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add REST API to generate DOT graph for individual query stage <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/310">#310</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>[UI] Use tabbed pane with Queries and Executors tabs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/309">#309</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>REST API to get query stages <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/305">#305</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add support for SortPreservingMergeExec; fix LIMIT bug <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/304">#304</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add Python script to run benchmarks <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/302">#302</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>[UI] Add ability to view query plans directly in the UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/301">#301</a> (<a class="reference external" href="https://github.com/onthebridgetonowhere">onthebridgetonowhere</a>)</p></li>
+<li><p>Update datafusion.proto <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/299">#299</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Replace function <code class="docutils literal notranslate"><span class="pre">from_proto_binary_op</span></code> from upstream <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/298">#298</a> (<a class="reference external" href="https://github.com/askoa">askoa</a>)</p></li>
+<li><p>Fix dead link in contribution guideline readme file <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/297">#297</a> (<a class="reference external" href="https://github.com/onthebridgetonowhere">onthebridgetonowhere</a>)</p></li>
+<li><p>UI code cleanup <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/291">#291</a> (<a class="reference external" href="https://github.com/KenSuenobu">KenSuenobu</a>)</p></li>
+<li><p>Add support for S3 data sources <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/290">#290</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Use latest datafusion <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/289">#289</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Fix documentation example <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/288">#288</a> (<a class="reference external" href="https://github.com/onthebridgetonowhere">onthebridgetonowhere</a>)</p></li>
+<li><p>Improve formatting of job status in UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/286">#286</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Enabled download of dot files from Download icon <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/279">#279</a> (<a class="reference external" href="https://github.com/KenSuenobu">KenSuenobu</a>)</p></li>
+<li><p>Executor graceful shutdown: Handle SIGTERM <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/278">#278</a> (<a class="reference external" href="https://github.com/mingmwang">mingmwang</a>)</p></li>
+<li><p>Also run yarn build to catch JavaScript errors in CI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/271">#271</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Store sessions so users can register tables and query them through flight <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/269">#269</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Fix compose for Ian <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/268">#268</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Task level retry and Stage level retry <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/261">#261</a> (<a class="reference external" href="https://github.com/mingmwang">mingmwang</a>)</p></li>
+<li><p>Introduce the datafusion-objectstore-hdfs in datafusion-contrib as an object store feature <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/260">#260</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add a feature based object store provider <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/258">#258</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Make fetch shuffle partition data in parallel <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/256">#256</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add LaunchMultiTask rpc interface for executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/255">#255</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>CLI uses ballista context instead of datafusion context in local mode <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/252">#252</a> (<a class="reference external" href="https://github.com/r4ntix">r4ntix</a>)</p></li>
+<li><p>Fix Scheduler UI in Docker image <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/251">#251</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Generate into source folder to make IDEs happy <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/247">#247</a> (<a class="reference external" href="https://github.com/avantgardnerio">avantgardnerio</a>)</p></li>
+<li><p>Use bind host rather than the external host for starting a local executor service <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/245">#245</a> (<a class="reference external" href="https://github.com/yahoNanJing">yahoNanJing</a>)</p></li>
+<li><p>Add REST endpoint to get DOT graph of a job <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/242">#242</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Add list of jobs to scheduler UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/241">#241</a> (<a class="reference external" href="https://github.com/andygrove">andygrove</a>)</p></li>
+<li><p>Clean up job data on both Scheduler and Executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/188">#188</a> (<a class="reference external" href="https://github.com/mingmwang">mingmwang</a>)</p></li>
+<li><p>Update etcd-client requirement from 0.9 to 0.10 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/111">#111</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump terser from 4.8.0 to 4.8.1 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/91">#91</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump jsdom from 16.4.0 to 16.7.0 in /ballista/ui/scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/74">#74</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+<li><p>Bump numpy from 1.21.3 to 1.22.0 in /python <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/72">#72</a> (<a class="reference external" href="https://github.com/apps/dependabot">dependabot[bot]</a>)</p></li>
+</ul>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="0.10.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.10.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.8.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.8.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/0.9.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/0.9.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/changelog/43.0.0.html b/changelog/43.0.0.html
new file mode 100644
index 000000000..e79d13c92
--- /dev/null
+++ b/changelog/43.0.0.html
@@ -0,0 +1,606 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 43.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/43.0.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 0.12.0 Changelog" href="0.12.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 44.0.0 Changelog" href="44.0.0.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 43.0.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-43-0-0-changelog">
+<h1>Apache DataFusion Ballista 43.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-43-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/0.12.0...43.0.0-rc2">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>feat: make max message size configurable for gRPC clients <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/983">#983</a> (etolbakov)</p></li>
+<li><p>feat: Upgrade to DataFusion 38 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1048">#1048</a> (andygrove)</p></li>
+<li><p>feat: Upgrade to DataFusion 39.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1052">#1052</a> (andygrove)</p></li>
+<li><p>feat: default instance for executor configuration <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1147">#1147</a> (milenkovicm)</p></li>
+<li><p>feat: Expose Ballista Scheduler and Executor in Python <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1148">#1148</a> (milenkovicm)</p></li>
+<li><p>feat: add test to check for <code class="docutils literal notranslate"><span class="pre">ctx.enable_url_table()</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1155">#1155</a> (milenkovicm)</p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>docs: Add ASF attribution <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/973">#973</a> (simicd)</p></li>
+<li><p>Architecture guide <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/977">#977</a> (andygrove)</p></li>
+<li><p>docs: enhance the ballista-cli docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/979">#979</a> (haoxins)</p></li>
+<li><p>docs: update user guide with docker image information <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/980">#980</a> (etolbakov)</p></li>
+<li><p>docs: enhance the docs of Ballista client <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/985">#985</a> (haoxins)</p></li>
+<li><p>docs: list protoc dependency <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/989">#989</a> (davidwilemski)</p></li>
+<li><p>update asf yaml <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1007">#1007</a> (andygrove)</p></li>
+<li><p>docs: Add workflow to publish documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1040">#1040</a> (andygrove)</p></li>
+<li><p>docs: Replace Arrow Ballista with DataFusion Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1041">#1041</a> (andygrove)</p></li>
+<li><p>Add maintenance status note <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1043">#1043</a> (andygrove)</p></li>
+<li><p>Remove helm from supported code <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1071">#1071</a> (milenkovicm)</p></li>
+<li><p>Remove UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1072">#1072</a> (milenkovicm)</p></li>
+<li><p>Remove HDFS support … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1073">#1073</a> (milenkovicm)</p></li>
+<li><p>Removed Maintenance Notice <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1094">#1094</a> (tbar4)</p></li>
+<li><p>Update root <code class="docutils literal notranslate"><span class="pre">README.md</span></code> and other documentation with latest changes <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1113">#1113</a> (milenkovicm)</p></li>
+<li><p>docs: Update benchmarks <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1121">#1121</a> (andygrove)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>PyBallista - Python SQL client for Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/970">#970</a> (andygrove)</p></li>
+<li><p>docs: Add ASF attribution <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/973">#973</a> (simicd)</p></li>
+<li><p>[Python] Add <code class="docutils literal notranslate"><span class="pre">read_csv</span></code> and <code class="docutils literal notranslate"><span class="pre">read_parquet</span></code> methods <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/976">#976</a> (andygrove)</p></li>
+<li><p>Architecture guide <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/977">#977</a> (andygrove)</p></li>
+<li><p>[Python] Add more methods to SessionContext <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/978">#978</a> (andygrove)</p></li>
+<li><p>[Python] Add <code class="docutils literal notranslate"><span class="pre">execute_logical_plan</span></code> to context <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/972">#972</a> (andygrove)</p></li>
+<li><p>Use correct product name in docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/975">#975</a> (andygrove)</p></li>
+<li><p>docs: enhance the ballista-cli docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/979">#979</a> (haoxins)</p></li>
+<li><p>docs: update user guide with docker image information <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/980">#980</a> (etolbakov)</p></li>
+<li><p>Upgrade Rust version to 1.72 to keep the same as DataFusion v35 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/982">#982</a> (haoxins)</p></li>
+<li><p>build: Fix the ballista-cli Dockerfile <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/981">#981</a> (haoxins)</p></li>
+<li><p>feat: make max message size configurable for gRPC clients <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/983">#983</a> (etolbakov)</p></li>
+<li><p>Remove some hard-coded gRPC max message sizes <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/984">#984</a> (andygrove)</p></li>
+<li><p>docs: enhance the docs of Ballista client <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/985">#985</a> (haoxins)</p></li>
+<li><p>docs: list protoc dependency <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/989">#989</a> (davidwilemski)</p></li>
+<li><p>Fix ExecutorLost event debug info <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/988">#988</a> (lewiszlw)</p></li>
+<li><p>Fix shuffle writer test <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/998">#998</a> (Jefffrey)</p></li>
+<li><p>Bump graphviz-rust from 0.6.1 to 0.8.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/999">#999</a> (Jefffrey)</p></li>
+<li><p>Add rust-toolchain.toml for clarity <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1014">#1014</a> (scnerd)</p></li>
+<li><p>Fix executor metadata decode bug <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1004">#1004</a> (lewiszlw)</p></li>
+<li><p>update asf yaml <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1007">#1007</a> (andygrove)</p></li>
+<li><p>Fix Ballista rust.yml github workflow <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1026">#1026</a> (RaphaelMarinier)</p></li>
+<li><p>Bump datafusion to 36.0.0 and make ballista compatible with it. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1027">#1027</a> (RaphaelMarinier)</p></li>
+<li><p>Make Ballista compatible with Datafusion 37.0.0 (from 36.0.0) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1031">#1031</a> (RaphaelMarinier)</p></li>
+<li><p>Fixes Setting Job Name Not Reflected in Ballista UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1039">#1039</a> (athultr1997)</p></li>
+<li><p>docs: Add workflow to publish documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1040">#1040</a> (andygrove)</p></li>
+<li><p>[Docs] fix good_first_issue link in the contribution md doc <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1022">#1022</a> (Almaz-KG)</p></li>
+<li><p>docs: Replace Arrow Ballista with DataFusion Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1041">#1041</a> (andygrove)</p></li>
+<li><p>Fix job hangs when partition count of plan is zero <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1024">#1024</a> (lewiszlw)</p></li>
+<li><p>Add maintenance status note <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1043">#1043</a> (andygrove)</p></li>
+<li><p>Fix cargo build <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1045">#1045</a> (andygrove)</p></li>
+<li><p>fix docker build in CI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1046">#1046</a> (andygrove)</p></li>
+<li><p>feat: Upgrade to DataFusion 38 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1048">#1048</a> (andygrove)</p></li>
+<li><p>Bump actions/setup-node from 3 to 4 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/909">#909</a> (dependabot[bot])</p></li>
+<li><p>Bump actions/cache from 3 to 4 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/958">#958</a> (dependabot[bot])</p></li>
+<li><p>feat: Upgrade to DataFusion 39.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1052">#1052</a> (andygrove)</p></li>
+<li><p>Update datafusion protobuf definitions <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1057">#1057</a> (palaska)</p></li>
+<li><p>Fix regression with TPC-H benchmark <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1060">#1060</a> (andygrove)</p></li>
+<li><p>Upgrade to Datafusion 41 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1062">#1062</a> (palaska)</p></li>
+<li><p>Remove helm from supported code <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1071">#1071</a> (milenkovicm)</p></li>
+<li><p>Remove plugin subsystem <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1070">#1070</a> (milenkovicm)</p></li>
+<li><p>Remove CI folder <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1074">#1074</a> (milenkovicm)</p></li>
+<li><p>Code cleanup, move examples, remove unused files <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1075">#1075</a> (milenkovicm)</p></li>
+<li><p>Remove UI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1072">#1072</a> (milenkovicm)</p></li>
+<li><p>Remove key-value stores for scheduler persistence <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1077">#1077</a> (milenkovicm)</p></li>
+<li><p>Remove cache functionality <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1076">#1076</a> (milenkovicm)</p></li>
+<li><p>Remove HDFS support … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1073">#1073</a> (milenkovicm)</p></li>
+<li><p>Reorganise and remove dependencies <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1078">#1078</a> (milenkovicm)</p></li>
+<li><p>Promote keda and flight-sql to optional features <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1079">#1079</a> (milenkovicm)</p></li>
+<li><p>Update to datafusion 42 … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1080">#1080</a> (milenkovicm)</p></li>
+<li><p>#1086 solve examples errors <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1087">#1087</a> (tbar4)</p></li>
+<li><p>fix issue with not building python package … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1085">#1085</a> (milenkovicm)</p></li>
+<li><p>another round of code cleanup … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1089">#1089</a> (milenkovicm)</p></li>
+<li><p>Make rest-api optional feature … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1084">#1084</a> (milenkovicm)</p></li>
+<li><p>fix clippy issues after updating to rust 1.82 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1090">#1090</a> (milenkovicm)</p></li>
+<li><p>Replace BallistaContext with SessionContext <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1088">#1088</a> (milenkovicm)</p></li>
+<li><p>Removed Maintenance Notice <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1094">#1094</a> (tbar4)</p></li>
+<li><p>Ergonomic way to setup/configure <code class="docutils literal notranslate"><span class="pre">SessionContextExt</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1096">#1096</a> (milenkovicm)</p></li>
+<li><p>Executor configuration extended .. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1099">#1099</a> (milenkovicm)</p></li>
+<li><p>fix issue with executor registration … <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1101">#1101</a> (milenkovicm)</p></li>
+<li><p>Deprecate <code class="docutils literal notranslate"><span class="pre">BallistaContext</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1103">#1103</a> (milenkovicm)</p></li>
+<li><p>fix imports after un-rebased PR <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1106">#1106</a> (milenkovicm)</p></li>
+<li><p>Ballista proto cleanup <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1110">#1110</a> (milenkovicm)</p></li>
+<li><p>Update and move deps to workspace <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1109">#1109</a> (milenkovicm)</p></li>
+<li><p>Trim down <code class="docutils literal notranslate"><span class="pre">BallistaConfig</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1108">#1108</a> (milenkovicm)</p></li>
+<li><p>Remove build-in object store registry <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1114">#1114</a> (milenkovicm)</p></li>
+<li><p>Update root <code class="docutils literal notranslate"><span class="pre">README.md</span></code> and other documentation with latest changes <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1113">#1113</a> (milenkovicm)</p></li>
+<li><p>support window functions <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1112">#1112</a> (onursatici)</p></li>
+<li><p>added a BallistaContext to ballista to allow for Remote or standalone <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1100">#1100</a> (tbar4)</p></li>
+<li><p>Decommission <code class="docutils literal notranslate"><span class="pre">BallistaContext</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1119">#1119</a> (milenkovicm)</p></li>
+<li><p>docs: Update benchmarks <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1121">#1121</a> (andygrove)</p></li>
+<li><p>Make easier to create custom schedulers and executors <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1118">#1118</a> (milenkovicm)</p></li>
+<li><p>refactor: Move BallistaRegistry to better location <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1126">#1126</a> (milenkovicm)</p></li>
+<li><p>refactor: BallistaLogicalExtensionCodec refactoring and improvements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1127">#1127</a> (milenkovicm)</p></li>
+<li><p>refactor: consolidate ballista tests <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1129">#1129</a> (milenkovicm)</p></li>
+<li><p>refactor: SessionStateExt and SessionConfigExt <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1130">#1130</a> (milenkovicm)</p></li>
+<li><p>chore: dependancy updates <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1131">#1131</a> (milenkovicm)</p></li>
+<li><p>chore: fix warning mimaloc warning when building <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1137">#1137</a> (milenkovicm)</p></li>
+<li><p>refactor: SessionBuilder to return Result&lt;_&gt; <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1138">#1138</a> (milenkovicm)</p></li>
+<li><p>chore: remove unused cache_ options from executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1140">#1140</a> (milenkovicm)</p></li>
+<li><p>updated maturin version and ccargo build to build yml <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1136">#1136</a> (tbar4)</p></li>
+<li><p>chore: Fix clippy issues after rust update (1.83.0) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1143">#1143</a> (milenkovicm)</p></li>
+<li><p>Fix documentation example which still uses BallistaContext <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1145">#1145</a> (milenkovicm)</p></li>
+<li><p>Ballista proto cleanup <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1146">#1146</a> (milenkovicm)</p></li>
+<li><p>feat: default instance for executor configuration <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1147">#1147</a> (milenkovicm)</p></li>
+<li><p>feat: Expose Ballista Scheduler and Executor in Python <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1148">#1148</a> (milenkovicm)</p></li>
+<li><p>chore: dependency cleanup <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1150">#1150</a> (milenkovicm)</p></li>
+<li><p>Update DataFusion to 43 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1125">#1125</a> (Dandandan)</p></li>
+<li><p>Reinstantiate join order optimization <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1122">#1122</a> (Dandandan)</p></li>
+<li><p>add partitioning scheme for unresolved shuffle and shuffle reader exec <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1144">#1144</a> (onursatici)</p></li>
+<li><p>chore: update py-df to 43.1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1152">#1152</a> (milenkovicm)</p></li>
+<li><p>chore: no need to run python test in rust <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1154">#1154</a> (milenkovicm)</p></li>
+<li><p>feat: add test to check for <code class="docutils literal notranslate"><span class="pre">ctx.enable_url_table()</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1155">#1155</a> (milenkovicm)</p></li>
+</ul>
+</section>
+
+
+                </article>
+              
+              
+              
+              
+              
+                <footer class="prev-next-footer d-print-none">
+                  
+<div class="prev-next-area">
+    <a class="left-prev"
+       href="44.0.0.html"
+       title="previous page">
+      <i class="fa-solid fa-angle-left"></i>
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">previous</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 44.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="0.12.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 0.12.0 Changelog</p>
+      </div>
+      <i class="fa-solid fa-angle-right"></i>
+    </a>
+</div>
+                </footer>
+              
+            </div>
+            
+            
+              
+                <dialog id="pst-secondary-sidebar-modal"></dialog>
+                <div id="pst-secondary-sidebar" class="bd-sidebar-secondary bd-toc"><div class="sidebar-secondary-items sidebar-secondary__inner">
+
+
+  <div class="sidebar-secondary-item">
+
+  
+  <div class="tocsection editthispage">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/43.0.0.md">
+      <i class="fa-solid fa-pencil"></i>
+      
+      
+        
+          Edit on GitHub
+        
+      
+    </a>
+  </div>
+</div>
+
+  <div class="sidebar-secondary-item">
+
+  <div class="tocsection sourcelink">
+    <a href="../_sources/changelog/43.0.0.md.txt">
+      <i class="fa-solid fa-file-lines"></i> Show Source
+    </a>
+  </div>
+</div>
+
+</div></div>
+              
+            
+          </div>
+          <footer class="bd-footer-content">
+            
+          </footer>
+        
+      </main>
+    </div>
+  </div>
+  
+  <!-- Scripts loaded after <body> so the DOM is not blocked -->
+  <script defer src="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5"></script>
+<script defer src="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5"></script>
+
+<!-- Based on pydata_sphinx_theme/footer.html -->
+<footer class="footer mt-5 mt-md-0">
+  <div class="container">
+    
+    <div class="footer-item">
+      <p>Apache DataFusion Ballista, Arrow Ballista, Apache, the Apache feather logo, and the Apache DataFusion Ballista project logo</p>
+      <p>are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p>
+    </div>
+  </div>
+</footer>
+
+
+  </body>
+</html>
\ No newline at end of file
diff --git a/contributors-guide/code-organization.html b/changelog/44.0.0.html
similarity index 62%
copy from contributors-guide/code-organization.html
copy to changelog/44.0.0.html
index 1d7908b3b..57bcd042b 100644
--- a/contributors-guide/code-organization.html
+++ b/changelog/44.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Ballista Code Organization &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 44.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,12 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'contributors-guide/code-organization';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/44.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="next" title="Ballista Development" href="development.html" />
-    <link rel="prev" title="Ballista Architecture" href="architecture.html" />
+    <link rel="next" title="Apache DataFusion Ballista 43.0.0 Changelog" href="43.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 45.0.0 Changelog" href="45.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -264,11 +264,36 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
-<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
 <ul class="current nav bd-sidenav">
-<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Ballista Code Organization</a></li>
-<li class="toctree-l1"><a class="reference internal" href="development.html">Ballista Development</a></li>
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
@@ -318,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Ballista Code Organization</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 44.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -335,69 +363,61 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="ballista-code-organization">
-<h1>Ballista Code Organization<a class="headerlink" href="#ballista-code-organization" title="Link to this heading">#</a></h1>
-<p>This section provides links to the source code for major areas of functionality.</p>
-<section id="ballista-core-crate">
-<h2>ballista-core crate<a class="headerlink" href="#ballista-core-crate" title="Link to this heading">#</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core/proto/ballista.proto">Protocol Buffer Definition</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/core/src/execution_plans">Execution Plans</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core/src/client.rs">Ballista Client</a></p></li>
-</ul>
-</section>
-<section id="ballista-scheduler-crate">
-<h2>ballista-scheduler crate<a class="headerlink" href="#ballista-scheduler-crate" title="Link to this heading">#</a></h2>
+<section id="apache-datafusion-ballista-44-0-0-changelog">
+<h1>Apache DataFusion Ballista 44.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-44-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/43.0.0...44.0.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/planner.rs">Distributed Query Planner</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/scheduler_server/grpc.rs">gRPC Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/flight_sql.rs">Flight SQL Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler/src/api">REST API</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/metrics/prometheus.rs">Prometheus Integration</a></p></li>
+<li><p>feat: Job notification should emit job status for successful and failed jobs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1165">#1165</a> (milenkovicm)</p></li>
+<li><p>feat: executor supports pluggable arrow flight server <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1170">#1170</a> (milenkovicm)</p></li>
+<li><p>feat: notify scheduler when a task fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1181">#1181</a> (milenkovicm)</p></li>
+<li><p>feat: configure max grpc message size and disable view types in ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1185">#1185</a> (milenkovicm)</p></li>
 </ul>
-</section>
-<section id="ballista-executor-crate">
-<h2>ballista-executor crate<a class="headerlink" href="#ballista-executor-crate" title="Link to this heading">#</a></h2>
+<p><strong>Fixed bugs:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/executor">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/executor/src/flight_service.rs">Flight Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/executor/src/executor_server.rs">Executor Server</a></p></li>
+<li><p>fix: do not compile <code class="docutils literal notranslate"><span class="pre">keda.proto</span></code> if feature not used. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1168">#1168</a> (milenkovicm)</p></li>
+<li><p>fix: rest api <code class="docutils literal notranslate"><span class="pre">/api/executors</span></code> does not show executors if <code class="docutils literal notranslate"><span class="pre">TaskSchedulingPolicy::PullStaged</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1175">#1175</a> (milenkovicm)</p></li>
 </ul>
-</section>
-<section id="ballista-crate">
-<h2>ballista crate<a class="headerlink" href="#ballista-crate" title="Link to this heading">#</a></h2>
+<p><strong>Documentation updates:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/client">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/client/src/context.rs">Context</a></p></li>
+<li><p>doc: update ballista client front page <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1171">#1171</a> (milenkovicm)</p></li>
 </ul>
-</section>
-<section id="pyballista">
-<h2>PyBallista<a class="headerlink" href="#pyballista" title="Link to this heading">#</a></h2>
+<p><strong>Merged pull requests:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/python">Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/python/src/context.rs">Context</a></p></li>
+<li><p>chore: planner cleanup and refactor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1160">#1160</a> (milenkovicm)</p></li>
+<li><p>feat: Job notification should emit job status for successful and failed jobs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1165">#1165</a> (milenkovicm)</p></li>
+<li><p>chore: fix executor build issue on release <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1167">#1167</a> (milenkovicm)</p></li>
+<li><p>fix: do not compile <code class="docutils literal notranslate"><span class="pre">keda.proto</span></code> if feature not used. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1168">#1168</a> (milenkovicm)</p></li>
+<li><p>chore: update to DF.44 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1153">#1153</a> (milenkovicm)</p></li>
+<li><p>chore: publicly expose datafusion in ballista client <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1169">#1169</a> (milenkovicm)</p></li>
+<li><p>feat: executor supports pluggable arrow flight server <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1170">#1170</a> (milenkovicm)</p></li>
+<li><p>doc: update ballista client front page <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1171">#1171</a> (milenkovicm)</p></li>
+<li><p>fix: rest api <code class="docutils literal notranslate"><span class="pre">/api/executors</span></code> does not show executors if <code class="docutils literal notranslate"><span class="pre">TaskSchedulingPolicy::PullStaged</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1175">#1175</a> (milenkovicm)</p></li>
+<li><p>chore: generate change log for 44.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1173">#1173</a> (milenkovicm)</p></li>
+<li><p>feat: notify scheduler when a task fails <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1181">#1181</a> (milenkovicm)</p></li>
+<li><p>feat: configure max grpc message size and disable view types in ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1185">#1185</a> (milenkovicm)</p></li>
+<li><p>chore: fix tpch data generator <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1186">#1186</a> (milenkovicm)</p></li>
+<li><p>chore: fix clippy after rust 1.85 update <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1188">#1188</a> (milenkovicm)</p></li>
+<li><p>chore: commit <code class="docutils literal notranslate"><span class="pre">Cargo.lock</span></code> file to make builds more predictable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1190">#1190</a> (milenkovicm)</p></li>
 </ul>
-</section>
 </section>
 
 
@@ -411,20 +431,20 @@
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="architecture.html"
+       href="45.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Architecture</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 45.0.0 Changelog</p>
       </div>
     </a>
     <a class="right-next"
-       href="development.html"
+       href="43.0.0.html"
        title="next page">
       <div class="prev-next-info">
         <p class="prev-next-subtitle">next</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 43.0.0 Changelog</p>
       </div>
       <i class="fa-solid fa-angle-right"></i>
     </a>
@@ -440,26 +460,10 @@
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-core-crate">ballista-core crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-scheduler-crate">ballista-scheduler crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-executor-crate">ballista-executor crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-crate">ballista crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#pyballista">PyBallista</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/contributors-guide/code-organization.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/44.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -474,7 +478,7 @@
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/contributors-guide/code-organization.md.txt">
+    <a href="../_sources/changelog/44.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/community/communication.html b/changelog/45.0.0.html
similarity index 66%
copy from community/communication.html
copy to changelog/45.0.0.html
index d8f348d0e..816ce3571 100644
--- a/community/communication.html
+++ b/changelog/45.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Communication &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 45.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,11 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/45.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+    <link rel="next" title="Apache DataFusion Ballista 44.0.0 Changelog" href="44.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 46.0.0 Changelog" href="46.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -263,6 +264,31 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
 <ul class="nav bd-sidenav">
 <li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -271,8 +297,8 @@
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
 </ul>
@@ -317,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 45.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -334,44 +363,50 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+<section id="apache-datafusion-ballista-45-0-0-changelog">
+<h1>Apache DataFusion Ballista 45.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-45-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/44.0.0...45.0.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>feat: improve executor logs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1187">#1187</a> (milenkovicm)</p></li>
+<li><p>feat: publish docker containers for executor and scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1200">#1200</a> (milenkovicm)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>chore: minor release script fix <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1192">#1192</a> (andygrove)</p></li>
+<li><p>feat: improve executor logs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1187">#1187</a> (milenkovicm)</p></li>
+<li><p>chore: update datafusion to v45 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1176">#1176</a> (milenkovicm)</p></li>
+<li><p>chore: Update changelog for 44.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1191">#1191</a> (andygrove)</p></li>
+<li><p>minor: fix repo and homepage url in <code class="docutils literal notranslate"><span class="pre">cargo.toml</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1196">#1196</a> (milenkovicm)</p></li>
+<li><p>chore(deps): bump ring from 0.17.11 to 0.17.13 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1199">#1199</a> (dependabot[bot])</p></li>
+<li><p>feat: publish docker containers for executor and scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1200">#1200</a> (milenkovicm)</p></li>
+<li><p>minor: make <code class="docutils literal notranslate"><span class="pre">graphviz-rust</span></code> dependency optional <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1203">#1203</a> (milenkovicm)</p></li>
+<li><p>doc: update docker related documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1204">#1204</a> (milenkovicm)</p></li>
+<li><p>chore: update python dependencies <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1197">#1197</a> (milenkovicm)</p></li>
+<li><p>chore(deps): bump ring from 0.17.8 to 0.17.14 in /python <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1206">#1206</a> (dependabot[bot])</p></li>
+<li><p>doc: remove arrow from doc title <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1207">#1207</a> (milenkovicm)</p></li>
+<li><p>Fix unit tests in tpch.rs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1195">#1195</a> (vmingchen)</p></li>
+<li><p>documentation :: quick-start.md sample source code correction <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1213">#1213</a> (nj7)</p></li>
+<li><p>doc: fix quick-start executor command <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1217">#1217</a> (westhide)</p></li>
+</ul>
 </section>
 
 
@@ -385,13 +420,22 @@ quick and small design discussions. For major design change proposals, we encour
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="../contributors-guide/development.html"
+       href="46.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 46.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="44.0.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 44.0.0 Changelog</p>
       </div>
+      <i class="fa-solid fa-angle-right"></i>
     </a>
 </div>
                 </footer>
@@ -405,22 +449,10 @@ quick and small design discussions. For major design change proposals, we encour
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/45.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -435,7 +467,7 @@ quick and small design discussions. For major design change proposals, we encour
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/community/communication.md.txt">
+    <a href="../_sources/changelog/45.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/community/communication.html b/changelog/46.0.0.html
similarity index 60%
copy from community/communication.html
copy to changelog/46.0.0.html
index d8f348d0e..b191c9669 100644
--- a/community/communication.html
+++ b/changelog/46.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Communication &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 46.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,11 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/46.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+    <link rel="next" title="Apache DataFusion Ballista 45.0.0 Changelog" href="45.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 47.0.0 Changelog" href="47.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -263,6 +264,31 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
 <ul class="nav bd-sidenav">
 <li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -271,8 +297,8 @@
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
 </ul>
@@ -317,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 46.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -334,44 +363,63 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+<section id="apache-datafusion-ballista-46-0-0-changelog">
+<h1>Apache DataFusion Ballista 46.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-46-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/45.0.0...46.0.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>feat: make task distribution policies pluggable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1243">#1243</a> (milenkovicm)</p></li>
+<li><p>feat: remove flight-sql from scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1228">#1228</a> (milenkovicm)</p></li>
+<li><p>feat: ballista client collects (few) metrics <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1251">#1251</a> (milenkovicm)</p></li>
+<li><p>feat: make execution_graph.stages() public <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1256">#1256</a> (milenkovicm)</p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>fix: executor can’t read s3 config in push-staged mode <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1236">#1236</a> (mmooyyii)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>chore: Remove some arrow references <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1232">#1232</a> (andygrove)</p></li>
+<li><p>chore: remove unused executor configuration option <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1229">#1229</a> (milenkovicm)</p></li>
+<li><p>chore: return <code class="docutils literal notranslate"><span class="pre">404</span></code> for api requests if path does not exist <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1224">#1224</a> (milenkovicm)</p></li>
+<li><p>chore(ci): replace <code class="docutils literal notranslate"><span class="pre">actions-rs</span></code> which are deprecated <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1222">#1222</a> (milenkovicm)</p></li>
+<li><p>minor: Decouple <code class="docutils literal notranslate"><span class="pre">ExecutionGraph</span></code> and <code class="docutils literal notranslate"><span class="pre">DistributedPlanner</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1221">#1221</a> (milenkovicm)</p></li>
+<li><p>chore: update datafusion to 46 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1201">#1201</a> (milenkovicm)</p></li>
+<li><p>chore(deps): bump crossbeam-channel from 0.5.14 to 0.5.15 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1233">#1233</a> (dependabot[bot])</p></li>
+<li><p>chore(deps): bump tokio from 1.44.1 to 1.44.2 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1234">#1234</a> (dependabot[bot])</p></li>
+<li><p>fix: executor can’t read s3 config in push-staged mode <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1236">#1236</a> (mmooyyii)</p></li>
+<li><p>chore: update python deps to 45 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1240">#1240</a> (milenkovicm)</p></li>
+<li><p>Add S3 object store support to executor and scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1230">#1230</a> (milenkovicm)</p></li>
+<li><p>feat: make task distribution policies pluggable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1243">#1243</a> (milenkovicm)</p></li>
+<li><p>chore: reduce log levels for few log statements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1237">#1237</a> (milenkovicm)</p></li>
+<li><p>chore(deps): bump crossbeam-channel from 0.5.14 to 0.5.15 in /python <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1244">#1244</a> (dependabot[bot])</p></li>
+<li><p>feat: remove flight-sql from scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1228">#1228</a> (milenkovicm)</p></li>
+<li><p>minor: <code class="docutils literal notranslate"><span class="pre">executor_shutdown_while_running</span></code> test has race condition <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1248">#1248</a> (milenkovicm)</p></li>
+<li><p>bug: build fails with <code class="docutils literal notranslate"><span class="pre">--no-default-features</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1255">#1255</a> (milenkovicm)</p></li>
+<li><p>doc: update architectural diagram <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1253">#1253</a> (milenkovicm)</p></li>
+<li><p>feat: ballista client collects (few) metrics <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1251">#1251</a> (milenkovicm)</p></li>
+<li><p>chore: add read/write roundtrip tests <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1249">#1249</a> (milenkovicm)</p></li>
+<li><p>minor: change log level for object store creation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1247">#1247</a> (milenkovicm)</p></li>
+<li><p>feat: make execution_graph.stages() public <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1256">#1256</a> (milenkovicm)</p></li>
+</ul>
 </section>
 
 
@@ -385,13 +433,22 @@ quick and small design discussions. For major design change proposals, we encour
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="../contributors-guide/development.html"
+       href="47.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 47.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="45.0.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 45.0.0 Changelog</p>
       </div>
+      <i class="fa-solid fa-angle-right"></i>
     </a>
 </div>
                 </footer>
@@ -405,22 +462,10 @@ quick and small design discussions. For major design change proposals, we encour
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/46.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -435,7 +480,7 @@ quick and small design discussions. For major design change proposals, we encour
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/community/communication.md.txt">
+    <a href="../_sources/changelog/46.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/contributors-guide/code-organization.html b/changelog/47.0.0.html
similarity index 65%
copy from contributors-guide/code-organization.html
copy to changelog/47.0.0.html
index 1d7908b3b..67da1fa02 100644
--- a/contributors-guide/code-organization.html
+++ b/changelog/47.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Ballista Code Organization &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 47.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,12 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'contributors-guide/code-organization';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/47.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="next" title="Ballista Development" href="development.html" />
-    <link rel="prev" title="Ballista Architecture" href="architecture.html" />
+    <link rel="next" title="Apache DataFusion Ballista 46.0.0 Changelog" href="46.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 48.0.0 Changelog" href="48.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -264,11 +264,36 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
-<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
 <ul class="current nav bd-sidenav">
-<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Ballista Code Organization</a></li>
-<li class="toctree-l1"><a class="reference internal" href="development.html">Ballista Development</a></li>
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
@@ -318,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Ballista Code Organization</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 47.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -335,69 +363,53 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="ballista-code-organization">
-<h1>Ballista Code Organization<a class="headerlink" href="#ballista-code-organization" title="Link to this heading">#</a></h1>
-<p>This section provides links to the source code for major areas of functionality.</p>
-<section id="ballista-core-crate">
-<h2>ballista-core crate<a class="headerlink" href="#ballista-core-crate" title="Link to this heading">#</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core/proto/ballista.proto">Protocol Buffer Definition</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/core/src/execution_plans">Execution Plans</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core/src/client.rs">Ballista Client</a></p></li>
-</ul>
-</section>
-<section id="ballista-scheduler-crate">
-<h2>ballista-scheduler crate<a class="headerlink" href="#ballista-scheduler-crate" title="Link to this heading">#</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/planner.rs">Distributed Query Planner</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/scheduler_server/grpc.rs">gRPC Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/flight_sql.rs">Flight SQL Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler/src/api">REST API</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/metrics/prometheus.rs">Prometheus Integration</a></p></li>
-</ul>
-</section>
-<section id="ballista-executor-crate">
-<h2>ballista-executor crate<a class="headerlink" href="#ballista-executor-crate" title="Link to this heading">#</a></h2>
+<section id="apache-datafusion-ballista-47-0-0-changelog">
+<h1>Apache DataFusion Ballista 47.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-47-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/46.0.0...47.0.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/executor">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/executor/src/flight_service.rs">Flight Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/executor/src/executor_server.rs">Executor Server</a></p></li>
+<li><p>feat: expose submit and cancel job methods as public in scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1260">#1260</a> (milenkovicm)</p></li>
+<li><p>feat: split scheduler gprc creation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1261">#1261</a> (milenkovicm)</p></li>
+<li><p>feat: expose cluster state notifications <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1263">#1263</a> (milenkovicm)</p></li>
+<li><p>feat: remove <code class="docutils literal notranslate"><span class="pre">ClusterStorageConfig</span></code> as it is redundant <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1265">#1265</a> (milenkovicm)</p></li>
+<li><p>feat: disable task stage plan binary cache <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1266">#1266</a> (milenkovicm)</p></li>
+<li><p>feat: <code class="docutils literal notranslate"><span class="pre">ClusterState</span></code> does not cache session contexts <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1226">#1226</a> (milenkovicm)</p></li>
 </ul>
-</section>
-<section id="ballista-crate">
-<h2>ballista crate<a class="headerlink" href="#ballista-crate" title="Link to this heading">#</a></h2>
+<p><strong>Fixed bugs:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/client">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/client/src/context.rs">Context</a></p></li>
+<li><p>fix: clippy issue after rust update to 1.87 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1262">#1262</a> (milenkovicm)</p></li>
+<li><p>fix: fix tests failing on windows <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1273">#1273</a> (Huy1Ng)</p></li>
 </ul>
-</section>
-<section id="pyballista">
-<h2>PyBallista<a class="headerlink" href="#pyballista" title="Link to this heading">#</a></h2>
+<p><strong>Merged pull requests:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/python">Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/python/src/context.rs">Context</a></p></li>
+<li><p>fix: clippy issue after rust update to 1.87 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1262">#1262</a> (milenkovicm)</p></li>
+<li><p>feat: expose submit and cancel job methods as public in scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1260">#1260</a> (milenkovicm)</p></li>
+<li><p>feat: split scheduler gprc creation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1261">#1261</a> (milenkovicm)</p></li>
+<li><p>feat: expose cluster state notifications <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1263">#1263</a> (milenkovicm)</p></li>
+<li><p>minor: release docker on when release has been tagged <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1264">#1264</a> (milenkovicm)</p></li>
+<li><p>feat: remove <code class="docutils literal notranslate"><span class="pre">ClusterStorageConfig</span></code> as it is redundant <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1265">#1265</a> (milenkovicm)</p></li>
+<li><p>feat: disable task stage plan binary cache <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1266">#1266</a> (milenkovicm)</p></li>
+<li><p>feat: <code class="docutils literal notranslate"><span class="pre">ClusterState</span></code> does not cache session contexts <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1226">#1226</a> (milenkovicm)</p></li>
+<li><p>chore(deps): update to datafusion 47.0.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1250">#1250</a> (milenkovicm)</p></li>
 </ul>
-</section>
 </section>
 
 
@@ -411,20 +423,20 @@
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="architecture.html"
+       href="48.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Architecture</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 48.0.0 Changelog</p>
       </div>
     </a>
     <a class="right-next"
-       href="development.html"
+       href="46.0.0.html"
        title="next page">
       <div class="prev-next-info">
         <p class="prev-next-subtitle">next</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 46.0.0 Changelog</p>
       </div>
       <i class="fa-solid fa-angle-right"></i>
     </a>
@@ -440,26 +452,10 @@
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-core-crate">ballista-core crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-scheduler-crate">ballista-scheduler crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-executor-crate">ballista-executor crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-crate">ballista crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#pyballista">PyBallista</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/contributors-guide/code-organization.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/47.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -474,7 +470,7 @@
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/contributors-guide/code-organization.md.txt">
+    <a href="../_sources/changelog/47.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/contributors-guide/code-organization.html b/changelog/48.0.0.html
similarity index 68%
copy from contributors-guide/code-organization.html
copy to changelog/48.0.0.html
index 1d7908b3b..139097269 100644
--- a/contributors-guide/code-organization.html
+++ b/changelog/48.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Ballista Code Organization &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 48.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,12 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'contributors-guide/code-organization';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/48.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="next" title="Ballista Development" href="development.html" />
-    <link rel="prev" title="Ballista Architecture" href="architecture.html" />
+    <link rel="next" title="Apache DataFusion Ballista 47.0.0 Changelog" href="47.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 49.0.0 Changelog" href="49.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -264,11 +264,36 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
-<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
 <ul class="current nav bd-sidenav">
-<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Ballista Code Organization</a></li>
-<li class="toctree-l1"><a class="reference internal" href="development.html">Ballista Development</a></li>
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
@@ -318,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Ballista Code Organization</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 48.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -335,69 +363,49 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="ballista-code-organization">
-<h1>Ballista Code Organization<a class="headerlink" href="#ballista-code-organization" title="Link to this heading">#</a></h1>
-<p>This section provides links to the source code for major areas of functionality.</p>
-<section id="ballista-core-crate">
-<h2>ballista-core crate<a class="headerlink" href="#ballista-core-crate" title="Link to this heading">#</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core/proto/ballista.proto">Protocol Buffer Definition</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/core/src/execution_plans">Execution Plans</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/core/src/client.rs">Ballista Client</a></p></li>
-</ul>
-</section>
-<section id="ballista-scheduler-crate">
-<h2>ballista-scheduler crate<a class="headerlink" href="#ballista-scheduler-crate" title="Link to this heading">#</a></h2>
-<ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/planner.rs">Distributed Query Planner</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/scheduler_server/grpc.rs">gRPC Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/flight_sql.rs">Flight SQL Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler/src/api">REST API</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/metrics/prometheus.rs">Prometheus Integration</a></p></li>
-</ul>
-</section>
-<section id="ballista-executor-crate">
-<h2>ballista-executor crate<a class="headerlink" href="#ballista-executor-crate" title="Link to this heading">#</a></h2>
+<section id="apache-datafusion-ballista-48-0-0-changelog">
+<h1>Apache DataFusion Ballista 48.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-48-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/47.0.0...48.0.0">Full Changelog</a></p>
+<p><strong>Fixed bugs:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/executor">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/executor/src/flight_service.rs">Flight Service</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/executor/src/executor_server.rs">Executor Server</a></p></li>
+<li><p>fix: devcontainer protoc:1 feature url <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1278">#1278</a> (Almaz-KG)</p></li>
+<li><p>fix: change code to support rust 2024 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1283">#1283</a> (milenkovicm)</p></li>
+<li><p>fix: remove configure_me <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1282">#1282</a> (milenkovicm)</p></li>
 </ul>
-</section>
-<section id="ballista-crate">
-<h2>ballista crate<a class="headerlink" href="#ballista-crate" title="Link to this heading">#</a></h2>
+<p><strong>Documentation updates:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/ballista/client">Crate Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/ballista/client/src/context.rs">Context</a></p></li>
+<li><p>chore: update datafusion to 48 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1270">#1270</a> (milenkovicm)</p></li>
+<li><p>docs: Apply method chaining in example <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1276">#1276</a> (0ne-stone)</p></li>
 </ul>
-</section>
-<section id="pyballista">
-<h2>PyBallista<a class="headerlink" href="#pyballista" title="Link to this heading">#</a></h2>
+<p><strong>Merged pull requests:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/tree/main/python">Source</a></p></li>
-<li><p><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/python/src/context.rs">Context</a></p></li>
+<li><p>chore: update datafusion to 48 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1270">#1270</a> (milenkovicm)</p></li>
+<li><p>docs: Apply method chaining in example <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1276">#1276</a> (0ne-stone)</p></li>
+<li><p>fix: devcontainer protoc:1 feature url <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1278">#1278</a> (Almaz-KG)</p></li>
+<li><p>improve rust workflows without cache <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1275">#1275</a> (Huy1Ng)</p></li>
+<li><p>fix: change code to support rust 2024 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1283">#1283</a> (milenkovicm)</p></li>
+<li><p>fix: remove configure_me <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1282">#1282</a> (milenkovicm)</p></li>
+<li><p>chore: update python module to latest ballista release (v.47) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1279">#1279</a> (milenkovicm)</p></li>
+<li><p>chore: update datafusion to 48.0.1 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1284">#1284</a> (milenkovicm)</p></li>
 </ul>
-</section>
 </section>
 
 
@@ -411,20 +419,20 @@
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="architecture.html"
+       href="49.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Architecture</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 49.0.0 Changelog</p>
       </div>
     </a>
     <a class="right-next"
-       href="development.html"
+       href="47.0.0.html"
        title="next page">
       <div class="prev-next-info">
         <p class="prev-next-subtitle">next</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 47.0.0 Changelog</p>
       </div>
       <i class="fa-solid fa-angle-right"></i>
     </a>
@@ -440,26 +448,10 @@
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-core-crate">ballista-core crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-scheduler-crate">ballista-scheduler crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-executor-crate">ballista-executor crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#ballista-crate">ballista crate</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#pyballista">PyBallista</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/contributors-guide/code-organization.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/48.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -474,7 +466,7 @@
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/contributors-guide/code-organization.md.txt">
+    <a href="../_sources/changelog/48.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/community/communication.html b/changelog/49.0.0.html
similarity index 59%
copy from community/communication.html
copy to changelog/49.0.0.html
index d8f348d0e..4e7c98b00 100644
--- a/community/communication.html
+++ b/changelog/49.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Communication &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 49.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,11 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/49.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+    <link rel="next" title="Apache DataFusion Ballista 48.0.0 Changelog" href="48.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 50.0.0 Changelog" href="50.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -263,6 +264,31 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
 <ul class="nav bd-sidenav">
 <li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -271,8 +297,8 @@
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
 </ul>
@@ -317,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 49.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -334,44 +363,63 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+<section id="apache-datafusion-ballista-49-0-0-changelog">
+<h1>Apache DataFusion Ballista 49.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-49-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><a class="reference external" href="https://github.com/apache/datafusion-ballista/compare/48.0.0...49.0.0">Full Changelog</a></p>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>feat: Feat force shuffle reader to read all files using arrow flight client <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1310">#1310</a> (milenkovicm)</p></li>
+<li><p>feat: implement job data cleanup in pull-staged strategy #1219 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1314">#1314</a> (KR-bluejay)</p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>fix: fail job in case of serde error (pull-mode) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1297">#1297</a> (milenkovicm)</p></li>
+<li><p>fix: Ensure stage-level sort requirements are enforced in distributed planning <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1306">#1306</a> (metegenez)</p></li>
+<li><p>fix: <code class="docutils literal notranslate"><span class="pre">UnresolvedShuffleExec</span></code> should support <code class="docutils literal notranslate"><span class="pre">with_new_children</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1300">#1300</a> (milenkovicm)</p></li>
+<li><p>fix: <code class="docutils literal notranslate"><span class="pre">ShuffleReader</span></code> should return statistics <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1302">#1302</a> (milenkovicm)</p></li>
+<li><p>fix: Disable CollectLeft join as it is broken in ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1301">#1301</a> (milenkovicm)</p></li>
+<li><p>fix: Issue with JoinSelection and NestedLoopJoin::swap_inputs when stage is resolved <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1307">#1307</a> (milenkovicm)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>chore: update datafusion to 49 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1285">#1285</a> (milenkovicm)</p></li>
+<li><p>chore: Improve GitHub actions/python workflows <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1289">#1289</a> (Huy1Ng)</p></li>
+<li><p>chore: update datafusion to 49.0.2 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1298">#1298</a> (milenkovicm)</p></li>
+<li><p>minor: make shuffle exec display consistent <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1299">#1299</a> (milenkovicm)</p></li>
+<li><p>fix: fail job in case of serde error (pull-mode) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1297">#1297</a> (milenkovicm)</p></li>
+<li><p>fix: Ensure stage-level sort requirements are enforced in distributed planning <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1306">#1306</a> (metegenez)</p></li>
+<li><p>fix: <code class="docutils literal notranslate"><span class="pre">UnresolvedShuffleExec</span></code> should support <code class="docutils literal notranslate"><span class="pre">with_new_children</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1300">#1300</a> (milenkovicm)</p></li>
+<li><p>fix: <code class="docutils literal notranslate"><span class="pre">ShuffleReader</span></code> should return statistics <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1302">#1302</a> (milenkovicm)</p></li>
+<li><p>fix: Disable CollectLeft join as it is broken in ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1301">#1301</a> (milenkovicm)</p></li>
+<li><p>chore: notice and cargo deps cleanup <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1295">#1295</a> (milenkovicm)</p></li>
+<li><p>chore(deps): bump tracing-subscriber from 0.3.19 to 0.3.20 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1303">#1303</a> (dependabot[bot])</p></li>
+<li><p>chore(deps): bump tracing-subscriber from 0.3.19 to 0.3.20 in /python <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1308">#1308</a> (dependabot[bot])</p></li>
+<li><p>refactor: expand ClusterEventSender visibility to public <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1312">#1312</a> (Th824)</p></li>
+<li><p>fix: Issue with JoinSelection and NestedLoopJoin::swap_inputs when stage is resolved <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1307">#1307</a> (milenkovicm)</p></li>
+<li><p>minor: enable json write test <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1311">#1311</a> (milenkovicm)</p></li>
+<li><p>feat: Feat force shuffle reader to read all files using arrow flight client <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1310">#1310</a> (milenkovicm)</p></li>
+<li><p>feat: implement job data cleanup in pull-staged strategy #1219 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1314">#1314</a> (KR-bluejay)</p></li>
+<li><p>feat: Improve Remote Shuffle Read Speed and Resource Utilisation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1318">#1318</a> (milenkovicm)</p></li>
+<li><p>fix: Issue with <code class="docutils literal notranslate"><span class="pre">JoinSelection</span></code> and <code class="docutils literal notranslate"><span class="pre">CrossJoinExec</span></code> when stages have been resoled <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1322">#1322</a> (ZihuanLing)</p></li>
+</ul>
 </section>
 
 
@@ -385,13 +433,22 @@ quick and small design discussions. For major design change proposals, we encour
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="../contributors-guide/development.html"
+       href="50.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 50.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="48.0.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 48.0.0 Changelog</p>
       </div>
+      <i class="fa-solid fa-angle-right"></i>
     </a>
 </div>
                 </footer>
@@ -405,22 +462,10 @@ quick and small design discussions. For major design change proposals, we encour
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/49.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -435,7 +480,7 @@ quick and small design discussions. For major design change proposals, we encour
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/community/communication.md.txt">
+    <a href="../_sources/changelog/49.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/community/communication.html b/changelog/50.0.0.html
similarity index 67%
copy from community/communication.html
copy to changelog/50.0.0.html
index d8f348d0e..4bde22cfc 100644
--- a/community/communication.html
+++ b/changelog/50.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Communication &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 50.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,11 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/50.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+    <link rel="next" title="Apache DataFusion Ballista 49.0.0 Changelog" href="49.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 51.0.0 Changelog" href="51.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -263,6 +264,31 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
 <ul class="nav bd-sidenav">
 <li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -271,8 +297,8 @@
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
 </ul>
@@ -317,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 50.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -334,44 +363,52 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+<section id="apache-datafusion-ballista-50-0-0-changelog">
+<h1>Apache DataFusion Ballista 50.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-50-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>feat: make gRPC timeout configurations user-configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1337">#1337</a> (CuteChuanChuan)</p></li>
+</ul>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>fix: update REST API route syntax for axum 0.8 compatibility <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1330">#1330</a> (tomsanbear)</p></li>
+<li><p>fix: Executor does not panic if using unwritable work dir <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1332">#1332</a> (mach-kernel)</p></li>
+<li><p>fix: failing documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1339">#1339</a> (milenkovicm)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>infra: macos-13 is deprecated <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1324">#1324</a> (kevinjqliu)</p></li>
+<li><p>chore: update to datafusion v50 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1320">#1320</a> (milenkovicm)</p></li>
+<li><p>chore: Update datafusion to 50.2 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1326">#1326</a> (milenkovicm)</p></li>
+<li><p>document private items and update docs CI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1327">#1327</a> (killzoner)</p></li>
+<li><p>fix: update REST API route syntax for axum 0.8 compatibility <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1330">#1330</a> (tomsanbear)</p></li>
+<li><p>add msrvcheck <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1328">#1328</a> (killzoner)</p></li>
+<li><p>fix: Executor does not panic if using unwritable work dir <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1332">#1332</a> (mach-kernel)</p></li>
+<li><p>chore: Pinning versions of external actions. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1334">#1334</a> (samueleresca)</p></li>
+<li><p>chore: update python deps to 49 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1335">#1335</a> (milenkovicm)</p></li>
+<li><p>chore: update datafusion to 50.3 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1336">#1336</a> (milenkovicm)</p></li>
+<li><p>fix: failing documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1339">#1339</a> (milenkovicm)</p></li>
+<li><p>feat: make gRPC timeout configurations user-configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1337">#1337</a> (CuteChuanChuan)</p></li>
+<li><p>minor: change log level <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1340">#1340</a> (milenkovicm)</p></li>
+</ul>
 </section>
 
 
@@ -385,13 +422,22 @@ quick and small design discussions. For major design change proposals, we encour
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="../contributors-guide/development.html"
+       href="51.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 51.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="49.0.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 49.0.0 Changelog</p>
       </div>
+      <i class="fa-solid fa-angle-right"></i>
     </a>
 </div>
                 </footer>
@@ -405,22 +451,10 @@ quick and small design discussions. For major design change proposals, we encour
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/50.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -435,7 +469,7 @@ quick and small design discussions. For major design change proposals, we encour
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/community/communication.md.txt">
+    <a href="../_sources/changelog/50.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/community/communication.html b/changelog/51.0.0.html
similarity index 63%
copy from community/communication.html
copy to changelog/51.0.0.html
index d8f348d0e..b8d3d06dd 100644
--- a/community/communication.html
+++ b/changelog/51.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Communication &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 51.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,11 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'community/communication';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/51.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="prev" title="Ballista Development" href="../contributors-guide/development.html" />
+    <link rel="next" title="Apache DataFusion Ballista 50.0.0 Changelog" href="50.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 52.0.0 Changelog" href="52.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -263,6 +264,31 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
 <ul class="nav bd-sidenav">
 <li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
@@ -271,8 +297,8 @@
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
-<ul class="current nav bd-sidenav">
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Communication</a></li>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
 </ul>
@@ -317,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Communication</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 51.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -334,44 +363,51 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="communication">
-<h1>Communication<a class="headerlink" href="#communication" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<p>We use the same communication channels as the main DataFusion project:</p>
-<p><a class="reference external" href="https://datafusion.apache.org/contributor-guide/communication.html">https://datafusion.apache.org/contributor-guide/communication.html</a></p>
-<section id="contributing">
-<h2>Contributing<a class="headerlink" href="#contributing" title="Link to this heading">#</a></h2>
-<p>Our source code is hosted on
-<a class="reference external" href="https://github.com/apache/datafusion-ballista">GitHub</a>. More information on contributing is in
-the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CONTRIBUTING.md">Contribution Guide</a>
-, and we have curated a <a class="reference external" href="https://github.com/apache/datafusion-ballista/contribute">good-first-issue</a>
-list to help you get started. You can find datafusion’s major designs in docs/source/specification.</p>
-<p>We use GitHub issues for maintaining a queue of development work and as the
-public record. We often use Google docs, Github issues and pull requests for
-quick and small design discussions. For major design change proposals, we encourage you to write a rfc.</p>
-</section>
+<section id="apache-datafusion-ballista-51-0-0-changelog">
+<h1>Apache DataFusion Ballista 51.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-51-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>feat: Support distributed plan in <code class="docutils literal notranslate"><span class="pre">EXPLAIN</span></code> command <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1309">#1309</a> (danielhumanmod)</p></li>
+<li><p>feat: update rust edition to 2024 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1355">#1355</a> (killzoner)</p></li>
+<li><p>feat: capture more metrics in distributed_query <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1353">#1353</a> (PhVHoang)</p></li>
+<li><p>feat: Bump docker rust to <code class="docutils literal notranslate"><span class="pre">rust:1.92-trixie</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1365">#1365</a> (mattcuento)</p></li>
+<li><p>feat: Scheduler supports <code class="docutils literal notranslate"><span class="pre">substrait</span></code> logical plan and remove deprecated <code class="docutils literal notranslate"><span class="pre">sql</span></code> support <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1360">#1360</a> (mattcuento)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>minor: minor changes to release script/docs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1342">#1342</a> (andygrove)</p></li>
+<li><p>feat: Support distributed plan in <code class="docutils literal notranslate"><span class="pre">EXPLAIN</span></code> command <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1309">#1309</a> (danielhumanmod)</p></li>
+<li><p>chore: update datafusion to 51.0 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1345">#1345</a> (danielhumanmod)</p></li>
+<li><p>doc: Add a note that datafusion may need to be downgraded after installing it <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1348">#1348</a> (martin-g)</p></li>
+<li><p>minor: Make <code class="docutils literal notranslate"><span class="pre">DisplayAs</span></code> consistent and more readable for ShuffleExec <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1347">#1347</a> (milenkovicm)</p></li>
+<li><p>minor: remove unnecessary clone functions <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1352">#1352</a> (mmooyyii)</p></li>
+<li><p>feat: update rust edition to 2024 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1355">#1355</a> (killzoner)</p></li>
+<li><p>chore(doc): Clean up deployment docs. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1354">#1354</a> (LouisBurke)</p></li>
+<li><p>feat: capture more metrics in distributed_query <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1353">#1353</a> (PhVHoang)</p></li>
+<li><p>doc: Fix plan translation example to use correct aggregation and column <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1362">#1362</a> (mattcuento)</p></li>
+<li><p>chore: update ballista version to 51.0.0 (from 50.0.0) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1363">#1363</a> (milenkovicm)</p></li>
+<li><p>feat: Bump docker rust to <code class="docutils literal notranslate"><span class="pre">rust:1.92-trixie</span></code> <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1365">#1365</a> (mattcuento)</p></li>
+<li><p>chore: Add missing public API documentation/comments <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1364">#1364</a> (killzoner)</p></li>
+<li><p>feat: Scheduler supports <code class="docutils literal notranslate"><span class="pre">substrait</span></code> logical plan and remove deprecated <code class="docutils literal notranslate"><span class="pre">sql</span></code> support <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1360">#1360</a> (mattcuento)</p></li>
+</ul>
 </section>
 
 
@@ -385,13 +421,22 @@ quick and small design discussions. For major design change proposals, we encour
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="../contributors-guide/development.html"
+       href="52.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Development</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 52.0.0 Changelog</p>
+      </div>
+    </a>
+    <a class="right-next"
+       href="50.0.0.html"
+       title="next page">
+      <div class="prev-next-info">
+        <p class="prev-next-subtitle">next</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 50.0.0 Changelog</p>
       </div>
+      <i class="fa-solid fa-angle-right"></i>
     </a>
 </div>
                 </footer>
@@ -405,22 +450,10 @@ quick and small design discussions. For major design change proposals, we encour
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#contributing">Contributing</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/community/communication.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/51.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -435,7 +468,7 @@ quick and small design discussions. For major design change proposals, we encour
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/community/communication.md.txt">
+    <a href="../_sources/changelog/51.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/contributors-guide/development.html b/changelog/52.0.0.html
similarity index 50%
copy from contributors-guide/development.html
copy to changelog/52.0.0.html
index 9ebaa4be2..1c41d8f1f 100644
--- a/contributors-guide/development.html
+++ b/changelog/52.0.0.html
@@ -8,7 +8,7 @@
     <meta charset="utf-8" />
     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
 
-    <title>Ballista Development &#8212; Apache DataFusion Ballista  documentation</title>
+    <title>Apache DataFusion Ballista 52.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
   
   
   
@@ -42,12 +42,12 @@
     <script src="../_static/documentation_options.js?v=5929fcd5"></script>
     <script src="../_static/doctools.js?v=fd6eb6e6"></script>
     <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
-    <script>DOCUMENTATION_OPTIONS.pagename = 'contributors-guide/development';</script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/52.0.0';</script>
     <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
     <link rel="index" title="Index" href="../genindex.html" />
     <link rel="search" title="Search" href="../search.html" />
-    <link rel="next" title="Communication" href="../community/communication.html" />
-    <link rel="prev" title="Ballista Code Organization" href="code-organization.html" />
+    <link rel="next" title="Apache DataFusion Ballista 51.0.0 Changelog" href="51.0.0.html" />
+    <link rel="prev" title="Apache DataFusion Ballista 53.0.0 Changelog" href="53.0.0.html" />
   <meta name="viewport" content="width=device-width, initial-scale=1"/>
   <meta name="docsearch:language" content="en"/>
   <meta name="docsearch:version" content="" />
@@ -264,11 +264,36 @@
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
 <li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
 </ul>
-<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
 <ul class="current nav bd-sidenav">
-<li class="toctree-l1"><a class="reference internal" href="architecture.html">Ballista Architecture</a></li>
-<li class="toctree-l1"><a class="reference internal" href="code-organization.html">Ballista Code Organization</a></li>
-<li class="toctree-l1 current active"><a class="current reference internal" href="#">Ballista Development</a></li>
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2"><a class="reference internal" href="53.0.0.html">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
 <li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
 </ul>
 <p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
@@ -318,7 +343,10 @@
         <i class="fa-solid fa-home"></i>
       </a>
     </li>
-    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Ballista Development</span></li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 52.0.0 Changelog</span></li>
   </ul>
 </nav>
 </div>
@@ -335,146 +363,98 @@
 <div id="searchbox"></div>
                 <article class="bd-article">
                   
-  <!---
-  Licensed to the Apache Software Foundation (ASF) under one
-  or more contributor license agreements.  See the NOTICE file
-  distributed with this work for additional information
-  regarding copyright ownership.  The ASF licenses this file
-  to you under the Apache License, Version 2.0 (the
-  "License"); you may not use this file except in compliance
-  with the License.  You may obtain a copy of the License at
-
-    http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing,
-  software distributed under the License is distributed on an
-  "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-  KIND, either express or implied.  See the License for the
-  specific language governing permissions and limitations
-  under the License.
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
 -->
-<section id="ballista-development">
-<h1>Ballista Development<a class="headerlink" href="#ballista-development" title="Link to this heading">#</a></h1>
-<p>We welcome participation from everyone and encourage you to join us, ask
-questions, and get involved.</p>
-<p>All participation in the Apache DataFusion Ballista project is governed by the
-Apache Software Foundation’s <a class="reference external" href="https://www.apache.org/foundation/policies/conduct.html">code of
-conduct</a>.</p>
-<section id="development-environment">
-<h2>Development Environment<a class="headerlink" href="#development-environment" title="Link to this heading">#</a></h2>
-<p>The easiest way to get started if you are using VSCode or IntelliJ IDEA is to open the provided <a class="reference external" href="https://containers.dev/overview">Dev Container</a>
-which will install all the required dependencies including Rust, Docker, Node.js and Yarn. A Dev Container is a
-development environment that runs in a Docker container. It is configured with all the required dependencies to
-build and test the project. It also includes VS Code and the Rust and Node.js extensions. Other supporting tools
-that use Dev Containers can be seen <a class="reference external" href="https://containers.dev/supporting">here</a></p>
-<p>To use the Dev Container, open the project in VS Code and then click the “Reopen in Container” button in the
-bottom right corner of the IDE.</p>
-<p>If you are not using the Dev Container or VScode, you will need to install these dependencies yourself.</p>
+<section id="apache-datafusion-ballista-52-0-0-changelog">
+<h1>Apache DataFusion Ballista 52.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-52-0-0-changelog" title="Link to this heading">#</a></h1>
+<p><strong>Performance related:</strong></p>
 <ul class="simple">
-<li><p><a class="reference external" href="https://www.rust-lang.org/tools/install">Rust</a></p></li>
-<li><p><a class="reference external" href="https://protobuf.dev/downloads/">Protobuf Compiler</a> is required to build the project.</p></li>
-<li><p><a class="reference external" href="https://nodejs.org/en/download/">Node.js</a> is required to build the project.</p></li>
-<li><p><a class="reference external" href="https://classic.yarnpkg.com/en/docs/install">Yarn</a> is required to build the UI.</p></li>
-<li><p><a class="reference external" href="https://docs.docker.com/get-docker/">Docker</a> is required to run the integration tests.</p></li>
+<li><p>perf: optimize shuffle writer with buffered I/O and fix file size bug <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1386">#1386</a> (andygrove)</p></li>
 </ul>
-</section>
-<section id="build-the-project">
-<h2>Build the project<a class="headerlink" href="#build-the-project" title="Link to this heading">#</a></h2>
-<p>From the root of the project, build release binaries.</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>cargo<span class="w"> </span>build<span class="w"> </span>--release
-</pre></div>
-</div>
-</section>
-<section id="testing-the-project">
-<h2>Testing the project<a class="headerlink" href="#testing-the-project" title="Link to this heading">#</a></h2>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>cargo<span class="w"> </span><span class="nb">test</span>
-</pre></div>
-</div>
-</section>
-<section id="running-the-examples">
-<h2>Running the examples<a class="headerlink" href="#running-the-examples" title="Link to this heading">#</a></h2>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>examples
-cargo<span class="w"> </span>run<span class="w"> </span>--example<span class="w"> </span>standalone_sql<span class="w"> </span>--features<span class="o">=</span>ballista/standalone
-</pre></div>
-</div>
-</section>
-<section id="building-the-python-client-from-source">
-<h2>Building the Python Client from Source<a class="headerlink" href="#building-the-python-client-from-source" title="Link to this heading">#</a></h2>
-<p>The Python client (<code class="docutils literal notranslate"><span class="pre">ballista</span></code> on PyPI) lives in the <code class="docutils literal notranslate"><span class="pre">python/</span></code> directory and is versioned and released
-independently from the main Ballista project, so it is intentionally not part of the default Cargo
-workspace. Building it from source uses <a class="reference external" href="https://www.maturin.rs/">maturin</a> to compile the Rust
-extension module and install it into a Python virtual environment.</p>
-<section id="prerequisites">
-<h3>Prerequisites<a class="headerlink" href="#prerequisites" title="Link to this heading">#</a></h3>
+<p><strong>Implemented enhancements:</strong></p>
 <ul class="simple">
-<li><p>Python 3.10 or newer</p></li>
-<li><p>The Rust toolchain (see <a class="reference internal" href="#development-environment"><span class="xref myst">Development Environment</span></a>)</p></li>
-<li><p><a class="reference external" href="https://protobuf.dev/downloads/"><code class="docutils literal notranslate"><span class="pre">protoc</span></code></a> on your <code class="docutils literal notranslate"><span class="pre">PATH</span></code></p></li>
+<li><p>feat: add config option for skipping arrow ipc read validation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1374">#1374</a> (killzoner)</p></li>
+<li><p>feat: improve tpch benchmark CLI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1391">#1391</a> (andygrove)</p></li>
+<li><p>feat: Add sort-based shuffle implementation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1389">#1389</a> (andygrove)</p></li>
+<li><p>feat: New ballista python interface <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1338">#1338</a> (milenkovicm)</p></li>
+<li><p>feat: Add batch coalescing ability to shuffle reader exec <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1380">#1380</a> (danielhumanmod)</p></li>
+<li><p>feat: Add arrow flight proxy to scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1351">#1351</a> (sebbegg)</p></li>
+<li><p>feat: Creating SubstraitSchedulerClient and standalone Substrait examples <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1376">#1376</a> (mattcuento)</p></li>
+<li><p>feat: Cluster RPC customisations to support TLS and custom headers <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1400">#1400</a> (phillipleblanc)</p></li>
+<li><p>feat: add -c config override flag to tpch benchmark <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1435">#1435</a> (andygrove)</p></li>
+<li><p>feat: Extract <code class="docutils literal notranslate"><span class="pre">execution_graph</span></code> to a trait <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1361">#1361</a> (milenkovicm)</p></li>
+<li><p>feat: Add spark-compat mode to integrate datafusion-spark features au… <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1416">#1416</a> (mattcuento)</p></li>
+<li><p>feat: add <code class="docutils literal notranslate"><span class="pre">Dataframe.cache()</span></code> factory (no planner handling) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1420">#1420</a> (killzoner)</p></li>
+<li><p>feat: Adaptive query execution (AQE) planner fundamentals <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1372">#1372</a> (milenkovicm)</p></li>
+<li><p>feat: Make push scheduling policy default as it has lower latency <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1461">#1461</a> (milenkovicm)</p></li>
+<li><p>feat: job scheduling with push based job status updates <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1478">#1478</a> (milenkovicm)</p></li>
 </ul>
-<p>All commands in this section are run from the <code class="docutils literal notranslate"><span class="pre">python/</span></code> directory:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">cd</span><span class="w"> </span>python
-</pre></div>
-</div>
-</section>
-<section id="create-a-virtual-environment">
-<h3>Create a virtual environment<a class="headerlink" href="#create-a-virtual-environment" title="Link to this heading">#</a></h3>
-<p>Using <code class="docutils literal notranslate"><span class="pre">pip</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>python3<span class="w"> </span>-m<span class="w"> </span>venv<span class="w"> </span>.venv
-<span class="nb">source</span><span class="w"> </span>.venv/bin/activate
-pip3<span class="w"> </span>install<span class="w"> </span>--upgrade<span class="w"> </span>pip
-pip3<span class="w"> </span>install<span class="w"> </span>-r<span class="w"> </span>requirements.txt
-</pre></div>
-</div>
-<p>The <code class="docutils literal notranslate"><span class="pre">pip</span></code> upgrade is required because <code class="docutils literal notranslate"><span class="pre">maturin</span> <span class="pre">develop</span></code> invokes <code class="docutils literal notranslate"><span class="pre">pip</span> <span class="pre">install</span> <span class="pre">--group</span></code>, which
-needs pip 25.1 or newer. The pip shipped with <code class="docutils literal notranslate"><span class="pre">python3</span> <span class="pre">-m</span> <span class="pre">venv</span></code> is often older than that.</p>
-<p>Using <a class="reference external" href="https://docs.astral.sh/uv/"><code class="docutils literal notranslate"><span class="pre">uv</span></code></a>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>sync<span class="w"> </span>--dev<span class="w"> </span>--no-install-package<span class="w"> </span>ballista
-</pre></div>
-</div>
-</section>
-<section id="build-and-install">
-<h3>Build and install<a class="headerlink" href="#build-and-install" title="Link to this heading">#</a></h3>
-<p><code class="docutils literal notranslate"><span class="pre">maturin</span> <span class="pre">develop</span></code> compiles the Rust extension and installs it into the active virtual environment
-as an editable package, so subsequent Python imports pick up your local changes.</p>
-<p>Using <code class="docutils literal notranslate"><span class="pre">pip</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>maturin<span class="w"> </span>develop<span class="w">            </span><span class="c1"># debug build</span>
-maturin<span class="w"> </span>develop<span class="w"> </span>--release<span class="w">  </span><span class="c1"># release build (slower to compile, faster at runtime)</span>
-</pre></div>
-</div>
-<p>Using <code class="docutils literal notranslate"><span class="pre">uv</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>run<span class="w"> </span>--no-project<span class="w"> </span>maturin<span class="w"> </span>develop<span class="w"> </span>--uv
-</pre></div>
-</div>
-<p>To produce a wheel without installing it (for example, to share or publish):</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>run<span class="w"> </span>--no-project<span class="w"> </span>maturin<span class="w"> </span>build<span class="w"> </span>--release<span class="w"> </span>--strip
-</pre></div>
-</div>
-</section>
-<section id="run-the-tests">
-<h3>Run the tests<a class="headerlink" href="#run-the-tests" title="Link to this heading">#</a></h3>
-<p>Using <code class="docutils literal notranslate"><span class="pre">pip</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>python3<span class="w"> </span>-m<span class="w"> </span>pytest
-</pre></div>
-</div>
-<p>Using <code class="docutils literal notranslate"><span class="pre">uv</span></code>:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span>uv<span class="w"> </span>run<span class="w"> </span>--no-project<span class="w"> </span>pytest
-</pre></div>
-</div>
-<p>For more detail on the underlying workflow, including tips for improving build speed, see the
-<a class="reference external" href="https://datafusion.apache.org/python/contributor-guide/introduction.html">DataFusion Python contributor guide</a>.</p>
-</section>
-</section>
-<section id="benchmarking">
-<h2>Benchmarking<a class="headerlink" href="#benchmarking" title="Link to this heading">#</a></h2>
-<p>For performance testing and benchmarking with TPC-H and other datasets, see the <a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/benchmarks/README.md">benchmarks README</a>.</p>
-<p>This includes instructions for:</p>
+<p><strong>Fixed bugs:</strong></p>
 <ul class="simple">
-<li><p>Generating TPC-H test data</p></li>
-<li><p>Running benchmarks against DataFusion and Ballista</p></li>
-<li><p>Comparing performance with Apache Spark</p></li>
-<li><p>Running load tests</p></li>
+<li><p>fix: compile issue after unsuccessful merge <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1402">#1402</a> (milenkovicm)</p></li>
+<li><p>fix: prost build keda and TLS RPC example <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1429">#1429</a> (killzoner)</p></li>
+<li><p>fix: remove <code class="docutils literal notranslate"><span class="pre">scheduler_config_spec.toml</span></code> as it is unused <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1462">#1462</a> (milenkovicm)</p></li>
+<li><p>fix: Don’t use <code class="docutils literal notranslate"><span class="pre">maxrows</span></code> as a “fetched rows” but calculate it from the batches <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1480">#1480</a> (martin-g)</p></li>
+</ul>
+<p><strong>Documentation updates:</strong></p>
+<ul class="simple">
+<li><p>docs: fix outdated content in documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1385">#1385</a> (andygrove)</p></li>
+<li><p>docs: use tpchgen-rs for TPC-H data generation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1390">#1390</a> (andygrove)</p></li>
+<li><p>docs: add Jupyter notebook support documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1399">#1399</a> (andygrove)</p></li>
+<li><p>chore: Document ballista features in README.md <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1418">#1418</a> (mattcuento)</p></li>
+</ul>
+<p><strong>Merged pull requests:</strong></p>
+<ul class="simple">
+<li><p>feat: add config option for skipping arrow ipc read validation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1374">#1374</a> (killzoner)</p></li>
+<li><p>docs: fix outdated content in documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1385">#1385</a> (andygrove)</p></li>
+<li><p>restrict python CI to python directory <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1383">#1383</a> (Huy1Ng)</p></li>
+<li><p>perf: optimize shuffle writer with buffered I/O and fix file size bug <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1386">#1386</a> (andygrove)</p></li>
+<li><p>docs: use tpchgen-rs for TPC-H data generation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1390">#1390</a> (andygrove)</p></li>
+<li><p>feat: improve tpch benchmark CLI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1391">#1391</a> (andygrove)</p></li>
+<li><p>doc: Add Ballista extensions example to the docs. <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1382">#1382</a> (LouisBurke)</p></li>
+<li><p>feat: Add sort-based shuffle implementation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1389">#1389</a> (andygrove)</p></li>
+<li><p>feat: New ballista python interface <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1338">#1338</a> (milenkovicm)</p></li>
+<li><p>doc: add more details for protobuf extension <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1393">#1393</a> (LouisBurke)</p></li>
+<li><p>feat: Add batch coalescing ability to shuffle reader exec <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1380">#1380</a> (danielhumanmod)</p></li>
+<li><p>docs: add Jupyter notebook support documentation <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1399">#1399</a> (andygrove)</p></li>
+<li><p>feat: Add arrow flight proxy to scheduler <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1351">#1351</a> (sebbegg)</p></li>
+<li><p>chore: update datafusion to 52 <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1394">#1394</a> (killzoner)</p></li>
+<li><p>feat: Creating SubstraitSchedulerClient and standalone Substrait examples <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1376">#1376</a> (mattcuento)</p></li>
+<li><p>fix: compile issue after unsuccessful merge <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1402">#1402</a> (milenkovicm)</p></li>
+<li><p>feat: Cluster RPC customisations to support TLS and custom headers <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1400">#1400</a> (phillipleblanc)</p></li>
+<li><p>chore: Document ballista features in README.md <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1418">#1418</a> (mattcuento)</p></li>
+<li><p>fix: prost build keda and TLS RPC example <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1429">#1429</a> (killzoner)</p></li>
+<li><p>Improve sort-based shuffle: single spill file per partition and batch coalescing <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1431">#1431</a> (andygrove)</p></li>
+<li><p>feat: add -c config override flag to tpch benchmark <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1435">#1435</a> (andygrove)</p></li>
+<li><p>feat: Extract <code class="docutils literal notranslate"><span class="pre">execution_graph</span></code> to a trait <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1361">#1361</a> (milenkovicm)</p></li>
+<li><p>chore: add confirmation before tarball is released <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1445">#1445</a> (milenkovicm)</p></li>
+<li><p>minor: add test to cover IPC arrow file read <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1450">#1450</a> (milenkovicm)</p></li>
+<li><p>feat: Add spark-compat mode to integrate datafusion-spark features au… <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1416">#1416</a> (mattcuento)</p></li>
+<li><p>feat: add <code class="docutils literal notranslate"><span class="pre">Dataframe.cache()</span></code> factory (no planner handling) <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1420">#1420</a> (killzoner)</p></li>
+<li><p>fix: remove <code class="docutils literal notranslate"><span class="pre">scheduler_config_spec.toml</span></code> as it is unused <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1462">#1462</a> (milenkovicm)</p></li>
+<li><p>feat: Adaptive query execution (AQE) planner fundamentals <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1372">#1372</a> (milenkovicm)</p></li>
+<li><p>feat: Make push scheduling policy default as it has lower latency <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1461">#1461</a> (milenkovicm)</p></li>
+<li><p>minor: improve log statements <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1482">#1482</a> (milenkovicm)</p></li>
+<li><p>chore: update datafusion to 52.2 and other deps to latest <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1483">#1483</a> (milenkovicm)</p></li>
+<li><p>fix: Don’t use <code class="docutils literal notranslate"><span class="pre">maxrows</span></code> as a “fetched rows” but calculate it from the batches <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1480">#1480</a> (martin-g)</p></li>
+<li><p>feat: job scheduling with push based job status updates <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1478">#1478</a> (milenkovicm)</p></li>
 </ul>
-</section>
 </section>
 
 
@@ -488,20 +468,20 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
                   
 <div class="prev-next-area">
     <a class="left-prev"
-       href="code-organization.html"
+       href="53.0.0.html"
        title="previous page">
       <i class="fa-solid fa-angle-left"></i>
       <div class="prev-next-info">
         <p class="prev-next-subtitle">previous</p>
-        <p class="prev-next-title">Ballista Code Organization</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 53.0.0 Changelog</p>
       </div>
     </a>
     <a class="right-next"
-       href="../community/communication.html"
+       href="51.0.0.html"
        title="next page">
       <div class="prev-next-info">
         <p class="prev-next-subtitle">next</p>
-        <p class="prev-next-title">Communication</p>
+        <p class="prev-next-title">Apache DataFusion Ballista 51.0.0 Changelog</p>
       </div>
       <i class="fa-solid fa-angle-right"></i>
     </a>
@@ -517,33 +497,10 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
 
 
   <div class="sidebar-secondary-item">
-<div
-    id="pst-page-navigation-heading-2"
-    class="page-toc tocsection onthispage">
-    <i class="fa-solid fa-list"></i> On this page
-  </div>
-  <nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
-    <ul class="pst-show_toc_level nav section-nav flex-column">
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#development-environment">Development Environment</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#build-the-project">Build the project</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#testing-the-project">Testing the project</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#running-the-examples">Running the examples</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#building-the-python-client-from-source">Building the Python Client from Source</a><ul class="nav section-nav flex-column">
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#prerequisites">Prerequisites</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#create-a-virtual-environment">Create a virtual environment</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#build-and-install">Build and install</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#run-the-tests">Run the tests</a></li>
-</ul>
-</li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#benchmarking">Benchmarking</a></li>
-</ul>
-  </nav></div>
-
-  <div class="sidebar-secondary-item">
 
   
   <div class="tocsection editthispage">
-    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/contributors-guide/development.md">
+    <a href="https://github.com/apache/datafusion-ballista/edit/main/docs/source/changelog/52.0.0.md">
       <i class="fa-solid fa-pencil"></i>
       
       
@@ -558,7 +515,7 @@ maturin<span class="w"> </span>develop<span class="w"> </span>--release<span cla
   <div class="sidebar-secondary-item">
 
   <div class="tocsection sourcelink">
-    <a href="../_sources/contributors-guide/development.md.txt">
+    <a href="../_sources/changelog/52.0.0.md.txt">
       <i class="fa-solid fa-file-lines"></i> Show Source
     </a>
   </div>
diff --git a/changelog/53.0.0.html b/changelog/53.0.0.html
new file mode 100644
index 000000000..48fe34472
--- /dev/null
+++ b/changelog/53.0.0.html
@@ -0,0 +1,703 @@
+
+<!DOCTYPE html>
+
+
+<html lang="en" data-content_root="../" >
+
+  <head>
+    <meta charset="utf-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
+
+    <title>Apache DataFusion Ballista 53.0.0 Changelog &#8212; Apache DataFusion Ballista  documentation</title>
+  
+  
+  
+  <script data-cfasync="false">
+    document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+    document.documentElement.dataset.theme = localStorage.getItem("theme") || "";
+  </script>
+  <!--
+    this give us a css class that will be invisible only if js is disabled
+  -->
+  <noscript>
+    <style>
+      .pst-js-only { display: none !important; }
+
+    </style>
+  </noscript>
+  
+  <!-- Loaded before other Sphinx assets -->
+  <link href="../_static/styles/theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+<link href="../_static/styles/pydata-sphinx-theme.css?digest=a95f357e85573c9b56d5" rel="stylesheet" />
+
+    <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=8f2a1f02" />
+    <link rel="stylesheet" type="text/css" href="../_static/theme_overrides.css?v=3f0bb95a" />
+  
+  <!-- So that users can add custom icons -->
+  <script defer src="../_static/scripts/fontawesome.js?digest=a95f357e85573c9b56d5"></script>
+  <!-- Pre-loaded scripts that we'll load fully later -->
+  <link rel="preload" as="script" href="../_static/scripts/bootstrap.js?digest=a95f357e85573c9b56d5" />
+<link rel="preload" as="script" href="../_static/scripts/pydata-sphinx-theme.js?digest=a95f357e85573c9b56d5" />
+
+    <script src="../_static/documentation_options.js?v=5929fcd5"></script>
+    <script src="../_static/doctools.js?v=fd6eb6e6"></script>
+    <script src="../_static/sphinx_highlight.js?v=6ffebe34"></script>
+    <script>DOCUMENTATION_OPTIONS.pagename = 'changelog/53.0.0';</script>
+    <script>DOCUMENTATION_OPTIONS.search_as_you_type = false;</script>
+    <link rel="index" title="Index" href="../genindex.html" />
+    <link rel="search" title="Search" href="../search.html" />
+    <link rel="next" title="Apache DataFusion Ballista 52.0.0 Changelog" href="52.0.0.html" />
+    <link rel="prev" title="Changelog" href="index.html" />
+  <meta name="viewport" content="width=device-width, initial-scale=1"/>
+  <meta name="docsearch:language" content="en"/>
+  <meta name="docsearch:version" content="" />
+  
+    
+    <script src="../_static/searchtools.js"></script>
+    <script src="../_static/language_data.js"></script>
+    <script src="../searchindex.js"></script>
+  
+  </head>
+  <body data-default-mode="">
+  
+  
+  <div id="pst-skip-link" class="skip-link d-print-none"><a href="#main-content">Skip to main content</a></div>
+
+  
+  <div id="pst-scroll-pixel-helper"></div>
+  
+  <button type="button" class="btn rounded-pill" id="pst-back-to-top">
+    <i class="fa-solid fa-arrow-up"></i>Back to top</button>
+  
+  
+  
+  
+  <dialog id="pst-search-dialog">
+    
+<form class="bd-search d-flex align-items-center"
+      action="../search.html"
+      method="get">
+  <i class="fa-solid fa-magnifying-glass"></i>
+  <input type="search"
+         class="form-control"
+         name="q"
+         placeholder="Search the docs ..."
+         aria-label="Search the docs ..."
+         autocomplete="off"
+         autocorrect="off"
+         autocapitalize="off"
+         spellcheck="false"/>
+  <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd>K</kbd></span>
+</form>
+  </dialog>
+
+  <div class="pst-async-banner-revealer d-none">
+  <aside id="bd-header-version-warning" class="d-none d-print-none" aria-label="Version warning"></aside>
+</div>
+
+  
+    <header id="pst-header" class="bd-header navbar navbar-expand-lg bd-navbar d-print-none">
+<div class="bd-header__inner bd-page-width">
+  <button class="pst-navbar-icon sidebar-toggle primary-toggle" aria-label="Site navigation">
+    <span class="fa-solid fa-bars"></span>
+  </button>
+  
+  
+  <div class="col-lg-3 navbar-header-items__start">
+    
+      <div class="navbar-item">
+
+  
+    
+  
+
+<a class="navbar-brand logo" href="../index.html">
+  
+  
+  
+  
+  
+    
+    
+      
+    
+    
+    <img src="../_static/ballista_black.svg" class="logo__image only-light" alt="Apache DataFusion Ballista  documentation - Home"/>
+    <img src="../_static/ballista_white.svg" class="logo__image only-dark pst-js-only" alt="Apache DataFusion Ballista  documentation - Home"/>
+  
+  
+</a></div>
+    
+  </div>
+  
+  <div class="col-lg-9 navbar-header-items">
+    
+    
+    <div class="navbar-header-items__end">
+      
+        <div class="navbar-item navbar-persistent--container">
+          
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+        </div>
+      
+      
+        <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+      
+    </div>
+    
+  </div>
+  
+  
+    <div class="navbar-persistent--mobile">
+
+<button class="btn search-button-field search-button__button pst-js-only" title="Search" aria-label="Search" data-bs-placement="bottom" data-bs-toggle="tooltip">
+ <i class="fa-solid fa-magnifying-glass"></i>
+ <span class="search-button__default-text">Search</span>
+ <span class="search-button__kbd-shortcut"><kbd class="kbd-shortcut__modifier">Ctrl</kbd>+<kbd class="kbd-shortcut__modifier">K</kbd></span>
+</button>
+    </div>
+  
+
+  
+    <button class="pst-navbar-icon sidebar-toggle secondary-toggle" aria-label="On this page">
+      <span class="fa-solid fa-outdent"></span>
+    </button>
+  
+</div>
+
+    </header>
+  
+
+  <div class="bd-container">
+    <div class="bd-container__inner bd-page-width">
+      
+      
+      
+      <dialog id="pst-primary-sidebar-modal"></dialog>
+      <div id="pst-primary-sidebar" class="bd-sidebar-primary bd-sidebar">
+        
+
+  
+  <div class="sidebar-header-items sidebar-primary__section">
+    
+    
+    
+    
+      <div class="sidebar-header-items__end">
+        
+          <div class="navbar-item">
+
+<div class="theme-switch-container dropdown pst-js-only" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Color mode">
+  <button class="btn btn-sm nav-link pst-navbar-icon theme-switch-button dropdown-toggle" aria-label="Color mode" data-bs-toggle="dropdown">
+    <i class="theme-switch fa-solid fa-sun fa-lg fa-fw" data-mode="light" title="Light"></i>
+    <i class="theme-switch fa-solid fa-moon fa-lg fa-fw" data-mode="dark" title="Dark"></i>
+    <i class="theme-switch fa-solid fa-circle-half-stroke fa-lg fa-fw" data-mode="auto" title="System Settings"></i>
+  </button>
+  <ul class="dropdown-menu dropdown-menu-end">
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="auto"><i class="fa-solid fa-circle-half-stroke fa-lg fa-fw me-1"></i>System Settings</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="light"><i class="fa-solid fa-sun fa-lg fa-fw me-1"></i>Light</button></li>
+    <li><button class="dropdown-item d-flex align-items-center theme-change-button" data-mode="dark"><i class="fa-solid fa-moon fa-lg fa-fw me-1"></i>Dark</button></li>
+  </ul>
+</div></div>
+        
+      </div>
+    
+  </div>
+  
+    <div class="sidebar-primary-items__start sidebar-primary__section">
+        <div class="sidebar-primary-item"><nav class="bd-links" id="bd-docs-nav" aria-label="Main navigation">
+
+  <div class="bd-toc-item active">
+    
+    <p aria-level="2" class="caption" role="heading"><span class="caption-text">User Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/introduction.html">Introduction</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Cluster Deployment</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/deployment/index.html">Deployment</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/quick-start.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/cargo-install.html">Cargo Install</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker.html">Docker</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/docker-compose.html">Docker Compose</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/deployment/kubernetes.html">Kubernetes</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/scheduler.html">Scheduler</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Clients</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1 has-children"><a class="reference internal" href="../user-guide/python/index.html">Python</a><details><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/quickstart.html">Quick Start</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/cloud-storage.html">Querying S3 Data</a></li>
+<li class="toctree-l2"><a class="reference internal" href="../user-guide/python/jupyter.html">Jupyter Notebooks</a></li>
+</ul>
+</details></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/rust.html">Rust</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/cli.html">SQL CLI</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Reference</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/configs.html">Configuration</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/tuning-guide.html">Tuning Guide</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/metrics.html">Ballista Scheduler Metrics</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/faq.html">Frequently Asked Questions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extending-components.html">Extending Ballista Scheduler And Executors</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/spark-compatible-functions.html">Spark-Compatible Functions</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../user-guide/extensions-example.html">Extensions Example</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Changelog</span></p>
+<ul class="current nav bd-sidenav">
+<li class="toctree-l1 current active has-children"><a class="reference internal" href="index.html">Changelog</a><details open="open"><summary><span class="toctree-toggle" role="presentation"><i class="fa-solid fa-chevron-down"></i></span></summary><ul class="current">
+<li class="toctree-l2 current active"><a class="current reference internal" href="#">Apache DataFusion Ballista 53.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="52.0.0.html">Apache DataFusion Ballista 52.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="51.0.0.html">Apache DataFusion Ballista 51.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="50.0.0.html">Apache DataFusion Ballista 50.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="49.0.0.html">Apache DataFusion Ballista 49.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="48.0.0.html">Apache DataFusion Ballista 48.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="47.0.0.html">Apache DataFusion Ballista 47.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="46.0.0.html">Apache DataFusion Ballista 46.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="45.0.0.html">Apache DataFusion Ballista 45.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="44.0.0.html">Apache DataFusion Ballista 44.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="43.0.0.html">Apache DataFusion Ballista 43.0.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.12.0.html">Apache DataFusion Ballista 0.12.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.11.0.html">Apache DataFusion Ballista 0.11.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.10.0.html">Apache DataFusion Ballista 0.10.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.9.0.html">Apache DataFusion Ballista 0.9.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.8.0.html">Apache DataFusion Ballista 0.8.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.7.0.html">Apache DataFusion Ballista 0.7.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.6.0.html">Apache DataFusion Ballista 0.6.0 Changelog</a></li>
+<li class="toctree-l2"><a class="reference internal" href="0.5.0.html">Apache DataFusion Ballista 0.5.0 Changelog</a></li>
+</ul>
+</details></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Contributors Guide</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/architecture.html">Ballista Architecture</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/code-organization.html">Ballista Code Organization</a></li>
+<li class="toctree-l1"><a class="reference internal" href="../contributors-guide/development.html">Ballista Development</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/">Source code</a></li>
+</ul>
+<p aria-level="2" class="caption" role="heading"><span class="caption-text">Community</span></p>
+<ul class="nav bd-sidenav">
+<li class="toctree-l1"><a class="reference internal" href="../community/communication.html">Communication</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/issues">Issue tracker</a></li>
+<li class="toctree-l1"><a class="reference external" href="https://github.com/apache/datafusion-ballista/blob/main/CODE_OF_CONDUCT.md">Code of conduct</a></li>
+</ul>
+
+    
+  </div>
+</nav></div>
+    </div>
+  
+  
+  <div class="sidebar-primary-items__end sidebar-primary__section">
+      <div class="sidebar-primary-item">
+<div id="ethical-ad-placement"
+      class="flat"
+      data-ea-publisher="readthedocs"
+      data-ea-type="readthedocs-sidebar"
+      data-ea-manual="true">
+</div></div>
+  </div>
+
+
+      </div>
+      
+      <main id="main-content" class="bd-main" role="main">
+        
+        
+          <div class="bd-content">
+            <div class="bd-article-container">
+              
+              <div class="bd-header-article d-print-none">
+<div class="header-article-items header-article__inner">
+  
+    <div class="header-article-items__start">
+      
+        <div class="header-article-item">
+
+<nav aria-label="Breadcrumb" class="d-print-none">
+  <ul class="bd-breadcrumbs">
+    
+    <li class="breadcrumb-item breadcrumb-home">
+      <a href="../index.html" class="nav-link" aria-label="Home">
+        <i class="fa-solid fa-home"></i>
+      </a>
+    </li>
+    
+    <li class="breadcrumb-item"><a href="index.html" class="nav-link">Changelog</a></li>
+    
+    <li class="breadcrumb-item active" aria-current="page"><span class="ellipsis">Apache DataFusion Ballista 53.0.0 Changelog</span></li>
+  </ul>
+</nav>
+</div>
+      
+    </div>
+  
+  
+</div>
+</div>
+              
+              
+              
+                
+<div id="searchbox"></div>
+                <article class="bd-article">
+                  
+  <!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+  http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+<section id="apache-datafusion-ballista-53-0-0-changelog">
+<h1>Apache DataFusion Ballista 53.0.0 Changelog<a class="headerlink" href="#apache-datafusion-ballista-53-0-0-changelog" title="Link to this heading">#</a></h1>
+<p>This release consists of 174 commits from 16 contributors. See credits at the end of this changelog for more information.</p>
+<p><strong>Fixed bugs:</strong></p>
+<ul class="simple">
+<li><p>fix: remove unwrap from executor and improve task error handling <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1540">#1540</a> (eachsaj)</p></li>
+<li><p>fix: handle None task slot in update_task_info after executor lost <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1523">#1523</a> (milenkovicm)</p></li>
+<li><p>fix: [Python] serialize optimized logical plan to fix subquery support <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1586">#1586</a> (andygrove)</p></li>
+<li><p>fix: allow S3 access without explicit credentials <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1584">#1584</a> (andygrove)</p></li>
+<li><p>fix: route collect/show/to_pandas through Ballista cluster <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1585">#1585</a> (andygrove)</p></li>
+<li><p>fix: propagate session config from Python client to Ballista cluster <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1592">#1592</a> (andygrove)</p></li>
+<li><p>fix(python): ignore ballista-namespaced cluster_config keys locally <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1613">#1613</a> (andygrove)</p></li>
+<li><p>fix: <code class="docutils literal notranslate"><span class="pre">df.write_</span></code> fix as it was broken after update <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1625">#1625</a> (milenkovicm)</p></li>
+<li><p>fix(rest): remove unwrap and return 404 if executor does not exist <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1628">#1628</a> (milenkovicm)</p></li>
+<li><p>fix(metrics): avoid stage metrics inflation by tracking partition snapshots <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1652">#1652</a> (danielhumanmod)</p></li>
+<li><p>fix: compilation issue after merge <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1658">#1658</a> (milenkovicm)</p></li>
+<li><p>fix: rest api calculates stage running time correctly <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1675">#1675</a> (milenkovicm)</p></li>
+<li><p>fix: REST API does not show running jobs <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1703">#1703</a> (gittihub-jpg)</p></li>
+<li><p>fix: no executor warning, correct prometheus feature name in TUI <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1698">#1698</a> (killzoner)</p></li>
+</ul>
+<p><strong>Implemented enhancements:</strong></p>
+<ul class="simple">
+<li><p>[REST]: Cancelling a completed/failed job should return “false” <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1494">#1494</a> (martin-g)</p></li>
+<li><p>feat: Add plain “status” field to the JobResponse <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1497">#1497</a> (martin-g)</p></li>
+<li><p>feat: Expose Logical and Physical plan details in the REST API <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1498">#1498</a> (milenkovicm)</p></li>
+<li><p>feat: (remote) shuffle reader cleanup <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1503">#1503</a> (milenkovicm)</p></li>
+<li><p>feat: enable scheduler rest api by default <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1506">#1506</a> (milenkovicm)</p></li>
+<li><p>feat: [REST] Return the job’s start and end times <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1511">#1511</a> (martin-g)</p></li>
+<li><p>feat: remove hash policy task distribution as not used <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1526">#1526</a> (eachsaj)</p></li>
+<li><p>feat: remove full path from partition locations <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1527">#1527</a> (milenkovicm)</p></li>
+<li><p>feat: add config to ExecutorEngine::create_query_stage_exec <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1542">#1542</a> (milenkovicm)</p></li>
+<li><p>feat: Improve REST API adding task related info to job stages <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1543">#1543</a> (milenkovicm)</p></li>
+<li><p>feat: Ballista Text User Interface <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1436">#1436</a> (martin-g)</p></li>
+<li><p>feat: jupyter notebook support <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1513">#1513</a> (sandugood)</p></li>
+<li><p>feat: ExecutionEngine::create_query_stage_exec accepts partition_id <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1556">#1556</a> (milenkovicm)</p></li>
+<li><p>feat: make ballista client retry policy configurable <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1577">#1577</a> (eachsaj)</p></li>
+<li><p>feat: Executor system &amp; process metrics reporting <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1547">#1547</a> (sandugood)</p></li>
+<li><p>feat: Scheduler config update <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1597">#1597</a> (sandugood)</p></li>
+<li><p>feat: Support <code class="docutils literal notranslate"><span class="pre">EXPLAIN</span> <span class="pre">ANALYZE</span></code> in Ballista <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1567">#1567</a> (danielhumanmod)</p></li>
+<li><p>feat: Add standalone shuffle writer benchmark that shuffles real Parquet input <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1600">#1600</a> (andygrove)</p></li>
+<li><p>feat: defer sort-shuffle materialization with interleave_record_batch <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1598">#1598</a> (andygrove)</p></li>
+<li><p>feat(executor): bound executor memory via –memory-pool-size <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1624">#1624</a> (andygrove)</p></li>
+<li><p>feat(bench): show TPC-H query timings in seconds and add total time <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1641">#1641</a> (andygrove)</p></li>
+<li><p>feat(aqe): Support sort-based shuffle writer in AQE <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1640">#1640</a> (danielhumanmod)</p></li>
+<li><p>feat: rest api supports plan tree rendering <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1650">#1650</a> (sandugood)</p></li>
+<li><p>feat: Cache ballista clients on executor <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1578">#1578</a> (milenkovicm)</p></li>
+<li><p>feat(aqe): Lazy stage evaluation in AQE <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1649">#1649</a> (milenkovicm)</p></li>
+<li><p>feat: move shuffle writer disk I/O off tokio worker threads <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1537">#1537</a> (hcrosse)</p></li>
+<li><p>feat(scheduler): broadcast-style hash join for small-side joins <a class="reference external" href="https://github.com/apache/datafusion-ballista/pull/1647">#1647</a> (andygrove)</p></li>
... 1581 lines suppressed ...


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org