You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kyuubi.apache.org by ch...@apache.org on 2026/10/19 02:12:20 UTC
(kyuubi) branch master updated: [KYUUBI #7788] Bump Delta 4.4.1 and enable Delta tests for Spark 4.2
This is an automated email from the ASF dual-hosted git repository.
pan3793 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kyuubi.git
The following commit(s) were added to refs/heads/master by this push:
new 0aadafc930 [KYUUBI #7788] Bump Delta 4.4.1 and enable Delta tests for Spark 4.2
0aadafc930 is described below
commit 0aadafc93053088c5b781047e5bb1196cdf42f5d
Author: Cheng Pan <pa...@gmail.com>
AuthorDate: Mon Oct 19 10:12:10 2026 +0800
[KYUUBI #7788] Bump Delta 4.4.1 and enable Delta tests for Spark 4.2
### Why are the changes needed?
Delta Lake [4.4.1](https://github.com/delta-io/delta/releases/tag/v4.4.1) is the latest release. It publishes artifacts for Spark 4.0.1, 4.1.0 and 4.2.0, but none for Spark 4.3, so the `spark-4.3` profile keeps the Spark 4.1 artifact.
The `spark-4.2` and `spark-4.3` profiles drop the shared Spark 4.1 artifact fallback (`spark.binary.version`) and pin each lakehouse artifact explicitly, and Delta tests are enabled for Spark 4.2.
### How was this patch tested?
- `build/mvn test -pl extensions/spark/kyuubi-spark-authz -Pspark-4.2 -Pscala-2.13`, 468 tests pass, including the newly enabled `DeltaCatalogRangerSparkExtensionSuite`.
- `build/mvn test -pl extensions/spark/kyuubi-spark-authz -Pspark-4.1 -Pscala-2.13 -Dtest=none -DwildcardSuites=org.apache.kyuubi.plugin.spark.authz.ranger.DeltaCatalogRangerSparkExtensionSuite`, 39 tests pass.
### Was this patch assisted by generative AI tooling?
Assisted-by: Codex
Closes #7788 from pan3793/delta-upgrade.
Closes #7788
476c98173 [Cheng Pan] Bump Delta Lake 4.4.1
Authored-by: Cheng Pan <pa...@gmail.com>
Signed-off-by: Cheng Pan <ch...@apache.org>
---
pom.xml | 14 +++++++-------
1 file changed, 7 insertions(+), 7 deletions(-)
diff --git a/pom.xml b/pom.xml
index 2787d98955..d8892b1c50 100644
--- a/pom.xml
+++ b/pom.xml
@@ -2077,7 +2077,7 @@
<spark.version>4.0.3</spark.version>
<spark.binary.version>4.0</spark.binary.version>
<antlr4.version>4.13.1</antlr4.version>
- <delta.version>4.3.1</delta.version>
+ <delta.version>4.4.1</delta.version>
<delta.artifact>delta-spark_${spark.binary.version}_${scala.binary.version}</delta.artifact>
<hudi.version>1.2.0</hudi.version>
<!-- Paimon 2.x references the Spark 4.1+ Table.constraints() API in its Spark 4.0
@@ -2102,7 +2102,7 @@
<spark.version>4.1.2</spark.version>
<spark.binary.version>4.1</spark.binary.version>
<antlr4.version>4.13.1</antlr4.version>
- <delta.version>4.3.1</delta.version>
+ <delta.version>4.4.1</delta.version>
<delta.artifact>delta-spark_${spark.binary.version}_${scala.binary.version}</delta.artifact>
<hudi.version>1.2.0</hudi.version>
<paimon.version>2.1.0</paimon.version>
@@ -2122,20 +2122,20 @@
<maven.compiler.release>17</maven.compiler.release>
<enforcer.maxJdkVersion>17</enforcer.maxJdkVersion>
<spark.version>4.2.0</spark.version>
- <!-- TODO: update once Delta and Iceberg support Spark 4.2. -->
+ <!-- TODO: update once Iceberg and Hudi support Spark 4.2. -->
<spark.binary.version>4.1</spark.binary.version>
<!-- SPARK-47086 (4.2.0) upgraded Jetty to 12 (ee10), which requires the
Jakarta Servlet 6.0 API; jakarta.servlet.ServletConnection
was introduced in Servlet 6.0. -->
<jakarta.servlet-api.version>6.0.0</jakarta.servlet-api.version>
<antlr4.version>4.13.1</antlr4.version>
- <delta.version>4.3.1</delta.version>
- <delta.artifact>delta-spark_${spark.binary.version}_${scala.binary.version}</delta.artifact>
+ <delta.version>4.4.1</delta.version>
+ <delta.artifact>delta-spark_4.2_${scala.binary.version}</delta.artifact>
<hudi.version>1.2.0</hudi.version>
<!-- TODO: update once Paimon support Spark 4.2. -->
<paimon.version>2.1.0</paimon.version>
<paimon.artifact>paimon-spark-${spark.binary.version}_${scala.binary.version}</paimon.artifact>
- <maven.plugin.scalatest.exclude.tags>org.scalatest.tags.Slow,org.apache.kyuubi.tags.DeltaTest,org.apache.kyuubi.tags.IcebergTest,org.apache.kyuubi.tags.PaimonTest,org.apache.kyuubi.tags.HudiTest</maven.plugin.scalatest.exclude.tags>
+ <maven.plugin.scalatest.exclude.tags>org.scalatest.tags.Slow,org.apache.kyuubi.tags.IcebergTest,org.apache.kyuubi.tags.PaimonTest,org.apache.kyuubi.tags.HudiTest</maven.plugin.scalatest.exclude.tags>
<spark.archive.name>spark-${spark.version}-bin-hadoop3.tgz</spark.archive.name>
</properties>
</profile>
@@ -2158,7 +2158,7 @@
was introduced in Servlet 6.0. -->
<jakarta.servlet-api.version>6.0.0</jakarta.servlet-api.version>
<antlr4.version>4.13.1</antlr4.version>
- <delta.version>4.3.1</delta.version>
+ <delta.version>4.4.1</delta.version>
<delta.artifact>delta-spark_${spark.binary.version}_${scala.binary.version}</delta.artifact>
<hudi.version>1.2.0</hudi.version>
<!-- TODO: update once Paimon support Spark 4.3. -->