You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/05/24 03:37:52 UTC
(spark-connect-swift) branch main updated: [SPARK-52277] Upgrade Docker tags to `4.0.0` instead of `4.0.0-preview2`
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new e6f7cc9 [SPARK-52277] Upgrade Docker tags to `4.0.0` instead of `4.0.0-preview2`
e6f7cc9 is described below
commit e6f7cc921a53fb0cf4ae9c6df6d43b7b5024d40c
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Fri May 23 20:37:44 2025 -0700
[SPARK-52277] Upgrade Docker tags to `4.0.0` instead of `4.0.0-preview2`
### What changes were proposed in this pull request?
This PR aims to use Spark docker image tag `4.0.0` instead of `4.0.0-preview2`.
### Why are the changes needed?
To use the official one instead of the preview.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #171 from dongjoon-hyun/SPARK-52277.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/integration_test_linux.yml | 2 +-
Examples/app/README.md | 6 +++---
Examples/pi/README.md | 2 +-
Examples/spark-sql/README.md | 4 ++--
Examples/stream/README.md | 2 +-
Examples/web/README.md | 2 +-
README.md | 4 ++--
Sources/SparkConnect/Documentation.docc/Examples.md | 4 ++--
8 files changed, 13 insertions(+), 13 deletions(-)
diff --git a/.github/workflows/integration_test_linux.yml b/.github/workflows/integration_test_linux.yml
index 656b628..b5b270b 100644
--- a/.github/workflows/integration_test_linux.yml
+++ b/.github/workflows/integration_test_linux.yml
@@ -31,7 +31,7 @@ jobs:
SPARK_REMOTE: "sc://localhost:15003"
services:
spark:
- image: apache/spark:4.0.0-preview2
+ image: apache/spark:4.0.0
env:
SPARK_NO_DAEMONIZE: 1
ports:
diff --git a/Examples/app/README.md b/Examples/app/README.md
index bede7c2..fd98481 100644
--- a/Examples/app/README.md
+++ b/Examples/app/README.md
@@ -7,7 +7,7 @@ This is an example Swift application to show how to use Apache Spark Connect Swi
Prepare `Spark Connect Server` via running Docker image.
```
-docker run --rm -p 15002:15002 apache/spark:4.0.0-preview2 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
+docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
```
Build an application Docker image.
@@ -23,7 +23,7 @@ Run `app` docker image.
```
$ docker run --rm -e SPARK_REMOTE=sc://host.docker.internal:15002 apache/spark-connect-swift:app
-Connected to Apache Spark 4.0.0-preview2 Server
+Connected to Apache Spark 4.0.0 Server
EXECUTE: DROP TABLE IF EXISTS t
EXECUTE: CREATE TABLE IF NOT EXISTS t(a INT) USING ORC
EXECUTE: INSERT INTO t VALUES (1), (2), (3)
@@ -52,7 +52,7 @@ Run from source code.
```
$ swift run
...
-Connected to Apache Spark 4.0.0-preview2 Server
+Connected to Apache Spark 4.0.0 Server
EXECUTE: DROP TABLE IF EXISTS t
EXECUTE: CREATE TABLE IF NOT EXISTS t(a INT) USING ORC
EXECUTE: INSERT INTO t VALUES (1), (2), (3)
diff --git a/Examples/pi/README.md b/Examples/pi/README.md
index 715c381..88d3bf9 100644
--- a/Examples/pi/README.md
+++ b/Examples/pi/README.md
@@ -6,7 +6,7 @@ This is an example Swift application to show how to use Apache Spark Connect Swi
Prepare `Spark Connect Server` via running Docker image.
```
-docker run --rm -p 15002:15002 apache/spark:4.0.0-preview2 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
+docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
```
Build an application Docker image.
diff --git a/Examples/spark-sql/README.md b/Examples/spark-sql/README.md
index 63b2202..5457ba4 100644
--- a/Examples/spark-sql/README.md
+++ b/Examples/spark-sql/README.md
@@ -7,7 +7,7 @@ This is an example Swift application to show how to develop a Spark SQL REPL(Rea
Prepare `Spark Connect Server` via running Docker image.
```
-docker run -it --rm -p 15002:15002 apache/spark:4.0.0-preview2 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
+docker run -it --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
```
Build an application Docker image.
@@ -23,7 +23,7 @@ Run `spark-sql` docker image.
```
$ docker run -it --rm -e SPARK_REMOTE=sc://host.docker.internal:15002 apache/spark-connect-swift:spark-sql
-Connected to Apache Spark 4.0.0-preview2 Server
+Connected to Apache Spark 4.0.0 Server
spark-sql (default)> SHOW DATABASES;
+---------+
|namespace|
diff --git a/Examples/stream/README.md b/Examples/stream/README.md
index 3d0221a..2924358 100644
--- a/Examples/stream/README.md
+++ b/Examples/stream/README.md
@@ -5,7 +5,7 @@ This is an example Swift stream processing application to show how to count word
## Run `Spark Connect Server`
```bash
-docker run --rm -p 15002:15002 apache/spark:4.0.0-preview2 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
+docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
```
## Run `Netcat` as a streaming input server
diff --git a/Examples/web/README.md b/Examples/web/README.md
index c744ef2..788b504 100644
--- a/Examples/web/README.md
+++ b/Examples/web/README.md
@@ -77,7 +77,7 @@ index 2edcc8f..22313c8 100644
Prepare `Spark Connect Server` via running Docker image.
```
-docker run --rm -p 15002:15002 apache/spark:4.0.0-preview2 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
+docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
```
Build an application Docker image.
diff --git a/README.md b/README.md
index c24350f..6768a5b 100644
--- a/README.md
+++ b/README.md
@@ -6,7 +6,7 @@
This is an experimental Swift library to show how to connect to a remote Apache Spark Connect Server and run SQL statements to manipulate remote data.
-So far, this library project is tracking the upstream changes like the [Apache Spark](https://spark.apache.org) 4.0.0 RC7 release and [Apache Arrow](https://arrow.apache.org) project's Swift-support.
+So far, this library project is tracking the upstream changes of [Apache Arrow](https://arrow.apache.org) project's Swift-support.
## Resources
@@ -16,7 +16,7 @@ So far, this library project is tracking the upstream changes like the [Apache S
## Requirement
-- [Apache Spark 4.0.0 RC7 (May 2025)](https://github.com/apache/spark/releases/tag/v4.0.0)
+- [Apache Spark 4.0.0 (May 2025)](https://github.com/apache/spark/releases/tag/v4.0.0)
- [Swift 6.0 (2024) or 6.1 (2025)](https://swift.org)
- [gRPC Swift 2.2 (May 2025)](https://github.com/grpc/grpc-swift/releases/tag/2.2.1)
- [gRPC Swift Protobuf 1.3 (May 2025)](https://github.com/grpc/grpc-swift-protobuf/releases/tag/1.3.0)
diff --git a/Sources/SparkConnect/Documentation.docc/Examples.md b/Sources/SparkConnect/Documentation.docc/Examples.md
index 7999151..864e702 100644
--- a/Sources/SparkConnect/Documentation.docc/Examples.md
+++ b/Sources/SparkConnect/Documentation.docc/Examples.md
@@ -7,7 +7,7 @@ This document provides an overview of the example applications inside [Examples]
Start a Spark Connect Server:
```bash
-docker run -it --rm -p 15002:15002 apache/spark:4.0.0-preview2 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
+docker run -it --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
```
## Basic Application Example
@@ -147,7 +147,7 @@ Welcome to the Swift world. Say hello!%
# Spark-powered endpoint
curl http://127.0.0.1:8080/hello
-Hi, this is powered by the Apache Spark 4.0.0-preview2.%
+Hi, this is powered by the Apache Spark 4.0.0.%
```
## Development Environment
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org