You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2024/11/07 05:02:21 UTC
(spark) branch master updated: [SPARK-50135][BUILD] Upgrade ZooKeeper to 3.9.3
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 07301ddb889b [SPARK-50135][BUILD] Upgrade ZooKeeper to 3.9.3
07301ddb889b is described below
commit 07301ddb889bdf361499f65e1708b5fdcab7e539
Author: panbingkun <pa...@baidu.com>
AuthorDate: Wed Nov 6 21:02:07 2024 -0800
[SPARK-50135][BUILD] Upgrade ZooKeeper to 3.9.3
### What changes were proposed in this pull request?
The pr aims to upgrade `ZooKeeper` from `3.9.2` to `3.9.3`.
This PR is to fix potential issues with PR https://github.com/apache/spark/pull/48666
### Why are the changes needed?
The full release notes: https://zookeeper.apache.org/doc/r3.9.3/releasenotes.html
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
- Pass GA.
- Manually check
```shell
./build/sbt -Phadoop-3 -Pkubernetes -Pkinesis-asl -Phive-thriftserver -Pdocker-integration-tests -Pyarn -Phadoop-cloud -Pspark-ganglia-lgpl -Phive -Pjvm-profiler clean package
[info] Note: Some input files use or override a deprecated API.
[info] Note: Recompile with -Xlint:deprecation for details.
[warn] multiple main classes detected: run 'show discoveredMainClasses' to see the list
[success] Total time: 272 s (04:32), completed Nov 6, 2024, 4:29:52 PM
```
```shell
(pyspark) ➜ spark-community git:(SPARK-50135_FOLLOWUP) ✗ ./python/run-tests --python-executables=python3 --testnames "pyspark.sql.tests.connect.test_connect_collection"
Running PySpark tests. Output is in /Users/panbingkun/Developer/spark/spark-community/python/unit-tests.log
Will test against the following Python executables: ['python3']
Will test the following Python tests: ['pyspark.sql.tests.connect.test_connect_collection']
python3 python_implementation is CPython
python3 version is: Python 3.9.19
Starting test(python3): pyspark.sql.tests.connect.test_connect_collection (temp output: /Users/panbingkun/Developer/spark/spark-community/python/target/097bd7e0-9311-4484-ae2d-c0f4c63fc6f9/python3__pyspark.sql.tests.connect.test_connect_collection__8dzaeio9.log)
Finished test(python3): pyspark.sql.tests.connect.test_connect_collection (14s)
Tests passed in 14 seconds
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #48771 from panbingkun/SPARK-50135_FOLLOWUP.
Authored-by: panbingkun <pa...@baidu.com>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 4 ++--
pom.xml | 2 +-
2 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3 b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 6e69200dc402..d2fedb2f2955 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -278,6 +278,6 @@ xbean-asm9-shaded/4.26//xbean-asm9-shaded-4.26.jar
xmlschema-core/2.3.1//xmlschema-core-2.3.1.jar
xz/1.10//xz-1.10.jar
zjsonpatch/0.3.0//zjsonpatch-0.3.0.jar
-zookeeper-jute/3.9.2//zookeeper-jute-3.9.2.jar
-zookeeper/3.9.2//zookeeper-3.9.2.jar
+zookeeper-jute/3.9.3//zookeeper-jute-3.9.3.jar
+zookeeper/3.9.3//zookeeper-3.9.3.jar
zstd-jni/1.5.6-7//zstd-jni-1.5.6-7.jar
diff --git a/pom.xml b/pom.xml
index db969ef22deb..9009ac9c7748 100644
--- a/pom.xml
+++ b/pom.xml
@@ -128,7 +128,7 @@
<protobuf.version>4.28.3</protobuf.version>
<protoc-jar-maven-plugin.version>3.11.4</protoc-jar-maven-plugin.version>
<yarn.version>${hadoop.version}</yarn.version>
- <zookeeper.version>3.9.2</zookeeper.version>
+ <zookeeper.version>3.9.3</zookeeper.version>
<curator.version>5.7.1</curator.version>
<hive.group>org.apache.hive</hive.group>
<hive.classifier>core</hive.classifier>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org