You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/09/12 23:46:42 UTC
(spark-connect-swift) branch main updated: [SPARK-53569] Use `Iceberg` 1.10 for `Spark 3`-based Iceberg integration test
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new 3bbc056 [SPARK-53569] Use `Iceberg` 1.10 for `Spark 3`-based Iceberg integration test
3bbc056 is described below
commit 3bbc056c8533c7e9d74002650b465ea787e5ba7f
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Fri Sep 12 16:46:33 2025 -0700
[SPARK-53569] Use `Iceberg` 1.10 for `Spark 3`-based Iceberg integration test
### What changes were proposed in this pull request?
This PR aims to use `Apache Iceberg` 1.10 for Iceberg integration test.
### Why are the changes needed?
Apache Iceberg 1.10 is released.
- https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0
### Does this PR introduce _any_ user-facing change?
No, this is an test infra change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #237 from dongjoon-hyun/SPARK-53569.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 6808865..f46a802 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -249,7 +249,7 @@ jobs:
tar xvfz spark-3.5.6-bin-hadoop3.tgz && rm spark-3.5.6-bin-hadoop3.tgz
mv spark-3.5.6-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
- ./start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:3.5.6,org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.9.0 -c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c spark.sql.catalog.local.type=hadoop -c spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c spark.sql.defaultCatalog=local
+ ./start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:3.5.6,org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.10.0 -c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c spark.sql.catalog.local.type=hadoop -c spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c spark.sql.defaultCatalog=local
cd -
swift test --filter DataFrameWriterV2Tests -c release
swift test --filter IcebergTest -c release
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org