You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2022/09/17 05:26:51 UTC
[spark] branch master updated: [SPARK-40471][BUILD] Upgrade RoaringBitmap to 0.9.32
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 5aeae892562 [SPARK-40471][BUILD] Upgrade RoaringBitmap to 0.9.32
5aeae892562 is described below
commit 5aeae892562f484cc0f4ff301c93291ed052e92a
Author: yangjie01 <ya...@baidu.com>
AuthorDate: Fri Sep 16 22:26:10 2022 -0700
[SPARK-40471][BUILD] Upgrade RoaringBitmap to 0.9.32
### What changes were proposed in this pull request?
This pr aims upgrade RoaringBitmap 0.9.32
### Why are the changes needed?
This is a bug fix version:
- https://github.com/RoaringBitmap/RoaringBitmap/issues/575
- https://github.com/RoaringBitmap/RoaringBitmap/pull/578
other changes as follows:
- https://github.com/RoaringBitmap/RoaringBitmap/compare/0.9.31...0.9.32
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Pass GitHub Actions
Closes #37914 from LuciferYang/SPARK-40471.
Authored-by: yangjie01 <ya...@baidu.com>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt | 10 +++++-----
core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt | 10 +++++-----
core/benchmarks/MapStatusesConvertBenchmark-results.txt | 8 ++++----
dev/deps/spark-deps-hadoop-2-hive-2.3 | 4 ++--
dev/deps/spark-deps-hadoop-3-hive-2.3 | 4 ++--
pom.xml | 2 +-
6 files changed, 19 insertions(+), 19 deletions(-)
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt b/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
index 96fa24175c5..adac80834e4 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.15+10-LTS on Linux 5.13.0-1031-azure
-Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 11.0.16+8-LTS on Linux 5.15.0-1019-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
MapStatuses Convert: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 1324 1333 7 0.0 1324283680.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 2650 2670 32 0.0 2650318387.0 0.5X
-Num Maps: 50000 Fetch partitions:1500 4018 4059 53 0.0 4017921009.0 0.3X
+Num Maps: 50000 Fetch partitions:500 1269 1276 8 0.0 1268666001.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 2672 2695 39 0.0 2671542753.0 0.5X
+Num Maps: 50000 Fetch partitions:1500 4034 4069 50 0.0 4033696987.0 0.3X
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt b/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
index 0ba8d756dfc..9911ae3326f 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 17.0.3+7-LTS on Linux 5.13.0-1031-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 17.0.4+8-LTS on Linux 5.15.0-1019-azure
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
MapStatuses Convert: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 1092 1104 22 0.0 1091691925.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 2172 2192 29 0.0 2171702137.0 0.5X
-Num Maps: 50000 Fetch partitions:1500 3268 3291 27 0.0 3267904436.0 0.3X
+Num Maps: 50000 Fetch partitions:500 1228 1238 17 0.0 1228191051.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 2380 2393 16 0.0 2379601524.0 0.5X
+Num Maps: 50000 Fetch partitions:1500 3803 3857 55 0.0 3802550172.0 0.3X
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-results.txt b/core/benchmarks/MapStatusesConvertBenchmark-results.txt
index ae84abfdcc2..e52d7ed2af8 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_332-b09 on Linux 5.13.0-1031-azure
+OpenJDK 64-Bit Server VM 1.8.0_345-b01 on Linux 5.15.0-1019-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
MapStatuses Convert: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 1001 1033 36 0.0 1000638934.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 1699 1705 7 0.0 1699358972.0 0.6X
-Num Maps: 50000 Fetch partitions:1500 2647 2855 314 0.0 2646904255.0 0.4X
+Num Maps: 50000 Fetch partitions:500 1179 1187 13 0.0 1178581948.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 2237 2257 21 0.0 2236562602.0 0.5X
+Num Maps: 50000 Fetch partitions:1500 3448 3680 367 0.0 3447793753.0 0.3X
diff --git a/dev/deps/spark-deps-hadoop-2-hive-2.3 b/dev/deps/spark-deps-hadoop-2-hive-2.3
index 88a77c74ec4..eaf07541bcb 100644
--- a/dev/deps/spark-deps-hadoop-2-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-2-hive-2.3
@@ -1,7 +1,7 @@
HikariCP/2.5.1//HikariCP-2.5.1.jar
JLargeArrays/1.5//JLargeArrays-1.5.jar
JTransforms/3.1//JTransforms-3.1.jar
-RoaringBitmap/0.9.31//RoaringBitmap-0.9.31.jar
+RoaringBitmap/0.9.32//RoaringBitmap-0.9.32.jar
ST4/4.0.4//ST4-4.0.4.jar
activation/1.1.1//activation-1.1.1.jar
aircompressor/0.21//aircompressor-0.21.jar
@@ -242,7 +242,7 @@ scala-library/2.12.16//scala-library-2.12.16.jar
scala-parser-combinators_2.12/1.1.2//scala-parser-combinators_2.12-1.1.2.jar
scala-reflect/2.12.16//scala-reflect-2.12.16.jar
scala-xml_2.12/2.1.0//scala-xml_2.12-2.1.0.jar
-shims/0.9.31//shims-0.9.31.jar
+shims/0.9.32//shims-0.9.32.jar
slf4j-api/1.7.36//slf4j-api-1.7.36.jar
snakeyaml/1.31//snakeyaml-1.31.jar
snappy-java/1.1.8.4//snappy-java-1.1.8.4.jar
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3 b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 0201df37b87..d82edc92095 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -1,7 +1,7 @@
HikariCP/2.5.1//HikariCP-2.5.1.jar
JLargeArrays/1.5//JLargeArrays-1.5.jar
JTransforms/3.1//JTransforms-3.1.jar
-RoaringBitmap/0.9.31//RoaringBitmap-0.9.31.jar
+RoaringBitmap/0.9.32//RoaringBitmap-0.9.32.jar
ST4/4.0.4//ST4-4.0.4.jar
activation/1.1.1//activation-1.1.1.jar
aircompressor/0.21//aircompressor-0.21.jar
@@ -229,7 +229,7 @@ scala-library/2.12.16//scala-library-2.12.16.jar
scala-parser-combinators_2.12/1.1.2//scala-parser-combinators_2.12-1.1.2.jar
scala-reflect/2.12.16//scala-reflect-2.12.16.jar
scala-xml_2.12/2.1.0//scala-xml_2.12-2.1.0.jar
-shims/0.9.31//shims-0.9.31.jar
+shims/0.9.32//shims-0.9.32.jar
slf4j-api/1.7.36//slf4j-api-1.7.36.jar
snakeyaml/1.31//snakeyaml-1.31.jar
snappy-java/1.1.8.4//snappy-java-1.1.8.4.jar
diff --git a/pom.xml b/pom.xml
index 7bb803228fe..b30ef2f389c 100644
--- a/pom.xml
+++ b/pom.xml
@@ -825,7 +825,7 @@
<dependency>
<groupId>org.roaringbitmap</groupId>
<artifactId>RoaringBitmap</artifactId>
- <version>0.9.31</version>
+ <version>0.9.32</version>
</dependency>
<!-- Netty Begin -->
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org