You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/05/14 04:29:49 UTC
(spark-connect-swift) branch main updated: [SPARK-52125] Create a daily linux integration test GitHub Action job
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new b37890e [SPARK-52125] Create a daily linux integration test GitHub Action job
b37890e is described below
commit b37890e627b71eff84f070881435611f4b60dd2b
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Tue May 13 21:29:41 2025 -0700
[SPARK-52125] Create a daily linux integration test GitHub Action job
### What changes were proposed in this pull request?
This PR aims to add a daily linux integration test GitHub Action job in order to move `linux-integration-test` into it while keeping `build-ubuntu-latest` and `build-ubuntu-arm`.
### Why are the changes needed?
To isolate the linux flakiness from the main PR builder and commit builder. Instead, this dedicated GitHub Action job will focus on the linux integration independently.
### Does this PR introduce _any_ user-facing change?
No. This is a test-infra change.
### How was this patch tested?
This PR will not trigger `integration-test-linux` job.
<img width="576" alt="Screenshot 2025-05-13 at 20 50 14" src="https://github.com/user-attachments/assets/f24e9835-73d0-42a4-bd04-8c9049e9d444" />
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #146 from dongjoon-hyun/SPARK-52125.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 19 ------------
.github/workflows/integration_test_linux.yml | 45 ++++++++++++++++++++++++++++
2 files changed, 45 insertions(+), 19 deletions(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 20ff462..5f8ab34 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -78,25 +78,6 @@ jobs:
docker run swift:6.1 uname -a
docker run -v $PWD:/spark -w /spark swift:6.1 swift build -c release
- integration-test-linux:
- runs-on: ubuntu-latest
- env:
- SPARK_REMOTE: "sc://localhost:15003"
- services:
- spark:
- image: apache/spark:4.0.0-preview2
- env:
- SPARK_NO_DAEMONIZE: 1
- ports:
- - 15003:15002
- options: --entrypoint /opt/spark/sbin/start-connect-server.sh
- steps:
- - uses: actions/checkout@v4
- - name: Build
- run: |
- docker run swift:6.1 uname -a
- docker run --add-host=host.docker.internal:host-gateway -v $PWD:/spark -w /spark -e SPARK_REMOTE='sc://host.docker.internal:15003' swift:6.1 swift test --no-parallel -c release
-
integration-test-mac:
runs-on: macos-15
steps:
diff --git a/.github/workflows/integration_test_linux.yml b/.github/workflows/integration_test_linux.yml
new file mode 100644
index 0000000..656b628
--- /dev/null
+++ b/.github/workflows/integration_test_linux.yml
@@ -0,0 +1,45 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+
+name: Integration Test (linux)
+
+on:
+ schedule:
+ - cron: '0 0 * * *'
+ workflow_dispatch:
+
+jobs:
+ integration-test-linux:
+ runs-on: ubuntu-latest
+ env:
+ SPARK_REMOTE: "sc://localhost:15003"
+ services:
+ spark:
+ image: apache/spark:4.0.0-preview2
+ env:
+ SPARK_NO_DAEMONIZE: 1
+ ports:
+ - 15003:15002
+ options: --entrypoint /opt/spark/sbin/start-connect-server.sh
+ steps:
+ - uses: actions/checkout@v4
+ - name: Build
+ run: |
+ docker run swift:6.1 uname -a
+ docker run --add-host=host.docker.internal:host-gateway -v $PWD:/spark -w /spark -e SPARK_REMOTE='sc://host.docker.internal:15003' swift:6.1 swift test --no-parallel -c release
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org