You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by mi...@apache.org on 2026/08/12 09:04:16 UTC
(datafusion-ballista) branch main updated: docs: clean up stale and broken documentation links (#2287)
This is an automated email from the ASF dual-hosted git repository.
milenkovicm pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-ballista.git
The following commit(s) were added to refs/heads/main by this push:
new 666c58b54 docs: clean up stale and broken documentation links (#2287)
666c58b54 is described below
commit 666c58b540023d93e18414476379c6e8515ea5c2
Author: Li Zinuo <an...@qq.com>
AuthorDate: Wed Aug 12 17:04:12 2026 +0800
docs: clean up stale and broken documentation links (#2287)
---
docs/source/contributors-guide/architecture.md | 9 +++------
docs/source/contributors-guide/code-organization.md | 6 ++----
docs/source/user-guide/introduction.md | 11 +++--------
3 files changed, 8 insertions(+), 18 deletions(-)
diff --git a/docs/source/contributors-guide/architecture.md b/docs/source/contributors-guide/architecture.md
index 8a7ff1063..b076ac85b 100644
--- a/docs/source/contributors-guide/architecture.md
+++ b/docs/source/contributors-guide/architecture.md
@@ -33,13 +33,13 @@ than for data science.
### Arrow-native
Ballista uses the Apache Arrow memory format during query execution, and Apache Arrow IPC format on disk for
-shuffle files and for exchanging data between executors. Queries can be submitted using the Arrow Flight SQL API
-and the Arrow Flight SQL JDBC Driver.
+shuffle files and for exchanging data between executors. Queries can be submitted from Rust and Python clients
+or the Ballista CLI.
### Language Agnostic
Although most of the implementation code is written in Rust, the scheduler and executor APIs are based on open
-standards, including protocol buffers, gRPC, Apache Arrow IPC, and Apache Arrow Flight SQL.
+standards, including protocol buffers, gRPC, Apache Arrow IPC, and Apache Arrow Flight.
This language agnostic approach will allow Ballista to eventually support UDFs in languages other than Rust,
including Wasm.
@@ -72,7 +72,6 @@ between the executor(s) and the scheduler for fetching tasks and reporting task
The scheduler provides the following interfaces:
- gRPC service for submitting and managing jobs
-- Flight SQL API
- REST API for monitoring jobs
Jobs are submitted to the scheduler's gRPC service from a client context, either in the form of a logical query
@@ -96,8 +95,6 @@ There are multiple clients available for submitting jobs to a Ballista cluster:
context with support for SQL and DataFrame operations.
- The [ballista crate](https://crates.io/crates/ballista) provides a native Rust session context with support for
SQL and DataFrame operations.
-- The [Flight SQL JDBC driver](https://arrow.apache.org/docs/java/flight_sql_jdbc_driver.html) can be used from
- popular SQL tools to execute SQL queries against a cluster.
## Distributed Query Scheduling
diff --git a/docs/source/contributors-guide/code-organization.md b/docs/source/contributors-guide/code-organization.md
index b130d5d1c..073604b7c 100644
--- a/docs/source/contributors-guide/code-organization.md
+++ b/docs/source/contributors-guide/code-organization.md
@@ -23,7 +23,7 @@ This section provides links to the source code for major areas of functionality.
### ballista-core crate
-- [Crate Source](https://github.com/apache/datafusion-ballista/blob/main/ballista/core)
+- [Crate Source](https://github.com/apache/datafusion-ballista/tree/main/ballista/core)
- [Protocol Buffer Definition](https://github.com/apache/datafusion-ballista/blob/main/ballista/core/proto/ballista.proto)
- [Execution Plans](https://github.com/apache/datafusion-ballista/tree/main/ballista/core/src/execution_plans)
- [Ballista Client](https://github.com/apache/datafusion-ballista/blob/main/ballista/core/src/client.rs)
@@ -33,7 +33,6 @@ This section provides links to the source code for major areas of functionality.
- [Crate Source](https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler)
- [Distributed Query Planner](https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/planner.rs)
- [gRPC Service](https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/scheduler_server/grpc.rs)
-- [Flight SQL Service](https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/flight_sql.rs)
- [REST API](https://github.com/apache/datafusion-ballista/tree/main/ballista/scheduler/src/api)
- [Prometheus Integration](https://github.com/apache/datafusion-ballista/blob/main/ballista/scheduler/src/metrics/prometheus.rs)
@@ -46,9 +45,8 @@ This section provides links to the source code for major areas of functionality.
### ballista crate
- [Crate Source](https://github.com/apache/datafusion-ballista/tree/main/ballista/client)
-- [Context](https://github.com/apache/datafusion-ballista/blob/main/ballista/client/src/context.rs)
+- [Context Extensions](https://github.com/apache/datafusion-ballista/blob/main/ballista/client/src/extension.rs)
### PyBallista
- [Source](https://github.com/apache/datafusion-ballista/tree/main/python)
-- [Context](https://github.com/apache/datafusion-ballista/blob/main/python/src/context.rs)
diff --git a/docs/source/user-guide/introduction.md b/docs/source/user-guide/introduction.md
index 9fa01b055..9c753a76b 100644
--- a/docs/source/user-guide/introduction.md
+++ b/docs/source/user-guide/introduction.md
@@ -24,11 +24,10 @@ Ballista is a distributed compute platform primarily implemented in Rust, and po
Ballista has both scheduler and an executor component processes that are standard Rust executables.
Dockerfiles are also provided to build images for use in containerized environments, such as Docker, Docker Compose,
-and Kubernetes. See the [deployment guide](deployment.md) for more information.
+and Kubernetes. See the [deployment guide](deployment/) for more information.
-SQL and DataFrame queries can be submitted from Python and Rust, and SQL queries can be submitted via the Arrow
-Flight SQL JDBC driver, supporting your favorite JDBC compliant tools such as [DataGrip](datagrip)
-or [tableau](tableau). For setup instructions, please see the [FlightSQL guide](flightsql.md).
+SQL and DataFrame queries can be submitted from Python and Rust, and SQL queries can also be submitted using the
+Ballista CLI.
## How does this compare to Apache Spark?
@@ -44,7 +43,3 @@ Although Ballista is largely inspired by Apache Spark, there are some key differ
distributed compute.
- The use of Apache Arrow as the memory model and network protocol means that data can be exchanged between executors
in any programming language with minimal serialization overhead.
-
-[deployment](./deployment)
-[datagrip](https://www.jetbrains.com/datagrip/)
-[tableau](https://help.tableau.com/current/pro/desktop/en-us/examples_otherdatabases_jdbc.htm)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org