You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/08/25 19:46:36 UTC
(spark-connect-swift) branch main updated: [SPARK-53375] Remove downloaded tgz files
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new e8cd5e5 [SPARK-53375] Remove downloaded tgz files
e8cd5e5 is described below
commit e8cd5e56ee8cce925880a01995f4920478509073
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Mon Aug 25 12:46:28 2025 -0700
[SPARK-53375] Remove downloaded tgz files
### What changes were proposed in this pull request?
This PR aims to remove downloaded tgz files to save disk spaces.
### Why are the changes needed?
Due to the limitation on disk space, Xcode compilation fails currently.
https://github.com/apache/spark-connect-swift/actions/runs/17217952618/job/48847747900
```
warning: input verification failed
note: while processing /Users/runner/work/spark-connect-swift/spark-connect-swift/.build/arm64-apple-macosx/release/SparkConnect.build/ArrowArray.swift.o
```
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #221 from dongjoon-hyun/SPARK-53375.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 10 +++++-----
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 14a6b81..591b807 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -104,7 +104,7 @@ jobs:
- name: Test
run: |
curl -LO https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/spark-4.1.0-preview1-bin-hadoop3.tgz
- tar xvfz spark-4.1.0-preview1-bin-hadoop3.tgz
+ tar xvfz spark-4.1.0-preview1-bin-hadoop3.tgz && rm spark-4.1.0-preview1-bin-hadoop3.tgz
mv spark-4.1.0-preview1-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh
@@ -122,7 +122,7 @@ jobs:
- name: Test
run: |
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz?action=download
- tar xvfz spark-4.0.0-bin-hadoop3.tgz
+ tar xvfz spark-4.0.0-bin-hadoop3.tgz && rm spark-4.0.0-bin-hadoop3.tgz
mv spark-4.0.0-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh
@@ -142,7 +142,7 @@ jobs:
- name: Test
run: |
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.0.0/spark-4.0.0-bin-hadoop3.tgz?action=download
- tar xvfz spark-4.0.0-bin-hadoop3.tgz
+ tar xvfz spark-4.0.0-bin-hadoop3.tgz && rm spark-4.0.0-bin-hadoop3.tgz
mv spark-4.0.0-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh
@@ -165,7 +165,7 @@ jobs:
- name: Test
run: |
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz?action=download
- tar xvfz spark-3.5.6-bin-hadoop3.tgz
+ tar xvfz spark-3.5.6-bin-hadoop3.tgz && rm spark-3.5.6-bin-hadoop3.tgz
mv spark-3.5.6-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:3.5.6
@@ -190,7 +190,7 @@ jobs:
- name: Test
run: |
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-3.5.6/spark-3.5.6-bin-hadoop3.tgz?action=download
- tar xvfz spark-3.5.6-bin-hadoop3.tgz
+ tar xvfz spark-3.5.6-bin-hadoop3.tgz && rm spark-3.5.6-bin-hadoop3.tgz
mv spark-3.5.6-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:3.5.6,org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.9.0 -c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c spark.sql.catalog.local.type=hadoop -c spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c spark.sql.defaultCatalog=local
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org