You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ya...@apache.org on 2024/06/25 03:45:57 UTC

(spark) branch master updated: [SPARK-48692][BUILD] Upgrade `rocksdbjni` to 9.2.1

This is an automated email from the ASF dual-hosted git repository.

yangjie01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 5112e5887714 [SPARK-48692][BUILD] Upgrade `rocksdbjni` to 9.2.1
5112e5887714 is described below

commit 5112e58877147c7fb169d2c53845ce00de127866
Author: panbingkun <pa...@baidu.com>
AuthorDate: Tue Jun 25 11:45:42 2024 +0800

    [SPARK-48692][BUILD] Upgrade `rocksdbjni` to 9.2.1
    
    ### What changes were proposed in this pull request?
    The pr aims to upgrade rocksdbjni from `8.11.4` to `9.2.1`.
    
    ### Why are the changes needed?
    The full release notes as follows:
    https://github.com/facebook/rocksdb/releases/tag/v9.2.1
    https://github.com/facebook/rocksdb/releases/tag/v9.1.1
    https://github.com/facebook/rocksdb/releases/tag/v9.1.0
    https://github.com/facebook/rocksdb/releases/tag/v9.0.1
    https://github.com/facebook/rocksdb/releases/tag/v9.0.0
    
    ### Does this PR introduce _any_ user-facing change?
    No.
    
    ### How was this patch tested?
    Pass GA.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    No.
    
    Closes #46146 from panbingkun/test_rocksdbjni_9.
    
    Authored-by: panbingkun <pa...@baidu.com>
    Signed-off-by: yangjie01 <ya...@baidu.com>
---
 dev/deps/spark-deps-hadoop-3-hive-2.3              |   2 +-
 pom.xml                                            |   2 +-
 ...StoreBasicOperationsBenchmark-jdk21-results.txt | 120 ++++++++++-----------
 .../StateStoreBasicOperationsBenchmark-results.txt | 120 ++++++++++-----------
 4 files changed, 122 insertions(+), 122 deletions(-)

diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3 b/dev/deps/spark-deps-hadoop-3-hive-2.3
index edaf1c494d13..b99ec346e6ab 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -244,7 +244,7 @@ parquet-jackson/1.13.1//parquet-jackson-1.13.1.jar
 pickle/1.5//pickle-1.5.jar
 py4j/0.10.9.7//py4j-0.10.9.7.jar
 remotetea-oncrpc/1.1.2//remotetea-oncrpc-1.1.2.jar
-rocksdbjni/8.11.4//rocksdbjni-8.11.4.jar
+rocksdbjni/9.2.1//rocksdbjni-9.2.1.jar
 scala-collection-compat_2.13/2.7.0//scala-collection-compat_2.13-2.7.0.jar
 scala-compiler/2.13.14//scala-compiler-2.13.14.jar
 scala-library/2.13.14//scala-library-2.13.14.jar
diff --git a/pom.xml b/pom.xml
index 85fc2aefdf90..a6dc3a60d89c 100644
--- a/pom.xml
+++ b/pom.xml
@@ -691,7 +691,7 @@
       <dependency>
         <groupId>org.rocksdb</groupId>
         <artifactId>rocksdbjni</artifactId>
-        <version>8.11.4</version>
+        <version>9.2.1</version>
       </dependency>
       <dependency>
         <groupId>${leveldbjni.group}</groupId>
diff --git a/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-jdk21-results.txt b/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-jdk21-results.txt
index e563e60a8f48..6a42c7b283b7 100644
--- a/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-jdk21-results.txt
+++ b/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-jdk21-results.txt
@@ -2,143 +2,143 @@
 put rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (10000 rows to overwrite - rate 100):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ---------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                           10             12           1          1.0        1023.2       1.0X
-RocksDB (trackTotalNumberOfRows: true)                              42             44           2          0.2        4197.6       0.2X
-RocksDB (trackTotalNumberOfRows: false)                             16             17           1          0.6        1591.7       0.6X
+In-memory                                                           10             11           1          1.0         968.0       1.0X
+RocksDB (trackTotalNumberOfRows: true)                              40             42           2          0.2        4033.5       0.2X
+RocksDB (trackTotalNumberOfRows: false)                             15             16           1          0.7        1502.0       0.6X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (5000 rows to overwrite - rate 50):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                         10             11           1          1.0        1009.0       1.0X
-RocksDB (trackTotalNumberOfRows: true)                            41             43           1          0.2        4109.6       0.2X
-RocksDB (trackTotalNumberOfRows: false)                           16             17           1          0.6        1584.7       0.6X
+In-memory                                                          9             11           1          1.1         943.4       1.0X
+RocksDB (trackTotalNumberOfRows: true)                            48             50           1          0.2        4817.3       0.2X
+RocksDB (trackTotalNumberOfRows: false)                           15             16           1          0.7        1499.9       0.6X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (1000 rows to overwrite - rate 10):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                         10             11           1          1.0         978.4       1.0X
-RocksDB (trackTotalNumberOfRows: true)                            40             41           1          0.3        3994.7       0.2X
-RocksDB (trackTotalNumberOfRows: false)                           16             16           1          0.6        1559.3       0.6X
+In-memory                                                          9             10           1          1.1         906.1       1.0X
+RocksDB (trackTotalNumberOfRows: true)                            54             56           1          0.2        5418.7       0.2X
+RocksDB (trackTotalNumberOfRows: false)                           15             16           1          0.7        1535.8       0.6X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (0 rows to overwrite - rate 0):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ---------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                     10             11           1          1.0         959.7       1.0X
-RocksDB (trackTotalNumberOfRows: true)                        39             41           1          0.3        3946.1       0.2X
-RocksDB (trackTotalNumberOfRows: false)                       16             16           1          0.6        1554.8       0.6X
+In-memory                                                     10             11           1          1.1         951.0       1.0X
+RocksDB (trackTotalNumberOfRows: true)                        57             58           1          0.2        5680.0       0.2X
+RocksDB (trackTotalNumberOfRows: false)                       16             16           1          0.6        1563.7       0.6X
 
 
 ================================================================================================
 merge rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (10000 rows to overwrite - rate 100):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 --------------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                                    525            535           5          0.0       52482.0       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                                   168            174           3          0.1       16842.2       3.1X
+RocksDB (trackTotalNumberOfRows: true)                                                    531            550           7          0.0       53076.7       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                                   175            183           3          0.1       17475.3       3.0X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (5000 rows to overwrite - rate 50):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ------------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                                  515            525           5          0.0       51496.4       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                                 169            174           4          0.1       16929.6       3.0X
+RocksDB (trackTotalNumberOfRows: true)                                                  522            538           8          0.0       52183.0       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                                 171            177           3          0.1       17100.7       3.1X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (1000 rows to overwrite - rate 10):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ------------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                                  498            510           5          0.0       49792.9       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                                 168            173           2          0.1       16840.0       3.0X
+RocksDB (trackTotalNumberOfRows: true)                                                  518            534           7          0.0       51827.6       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                                 174            179           2          0.1       17358.9       3.0X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (0 rows to overwrite - rate 0):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 --------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                              495            506           5          0.0       49512.3       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                             168            172           3          0.1       16809.9       2.9X
+RocksDB (trackTotalNumberOfRows: true)                                              522            537           6          0.0       52162.9       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                             173            181           3          0.1       17259.8       3.0X
 
 
 ================================================================================================
 delete rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(10000 rows are non-existing - rate 100):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                        0              1           0         26.6          37.6       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                          40             41           1          0.3        3993.4       0.0X
-RocksDB (trackTotalNumberOfRows: false)                                                         16             16           0          0.6        1565.5       0.0X
+In-memory                                                                                        1              1           0         17.5          57.2       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                          56             58           1          0.2        5647.4       0.0X
+RocksDB (trackTotalNumberOfRows: false)                                                         15             16           1          0.7        1525.5       0.0X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(5000 rows are non-existing - rate 50):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -----------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                      8              9           1          1.2         831.0       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                        41             42           1          0.2        4100.4       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                                       16             16           0          0.6        1558.6       0.5X
+In-memory                                                                                      8              9           0          1.2         826.2       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                        50             51           1          0.2        4955.2       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                                       15             16           0          0.7        1533.6       0.5X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(1000 rows are non-existing - rate 10):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -----------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                      9             10           1          1.1         883.2       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                        42             43           1          0.2        4172.7       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                                       16             16           0          0.6        1557.0       0.6X
+In-memory                                                                                      9             11           1          1.1         892.6       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                        44             45           1          0.2        4351.5       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                                       15             16           1          0.7        1526.5       0.6X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(0 rows are non-existing - rate 0):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                  9             10           1          1.1         899.0       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                    42             43           1          0.2        4175.1       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                                   16             16           0          0.6        1573.8       0.6X
+In-memory                                                                                  9             10           1          1.1         894.3       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                    41             42           1          0.2        4142.6       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                                   15             16           0          0.7        1509.7       0.6X
 
 
 ================================================================================================
 evict rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 10000 rows (maxTimestampToEvictInMillis: 9999) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                            9              9           1          1.1         872.8       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                              40             41           1          0.3        3979.9       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                             16             16           0          0.6        1623.4       0.5X
+In-memory                                                                            9              9           1          1.2         851.8       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                              40             41           1          0.2        4030.3       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                             16             17           1          0.6        1632.1       0.5X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 5000 rows (maxTimestampToEvictInMillis: 4999) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                           8              9           0          1.2         809.3       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                             21             22           1          0.5        2111.4       0.4X
-RocksDB (trackTotalNumberOfRows: false)                                             9             10           0          1.1         936.9       0.9X
+In-memory                                                                           8              9           1          1.2         807.1       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                             21             22           1          0.5        2124.6       0.4X
+RocksDB (trackTotalNumberOfRows: false)                                             9             10           0          1.1         940.9       0.9X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 1000 rows (maxTimestampToEvictInMillis: 999) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -----------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                          8              8           0          1.3         755.9       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                             7              7           0          1.5         672.2       1.1X
-RocksDB (trackTotalNumberOfRows: false)                                            4              5           0          2.3         441.2       1.7X
+In-memory                                                                          7              8           1          1.4         739.1       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                             7              7           0          1.4         697.1       1.1X
+RocksDB (trackTotalNumberOfRows: false)                                            5              5           0          2.2         460.0       1.6X
 
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 0 rows (maxTimestampToEvictInMillis: -1) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                      0              0           0         23.7          42.1       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                         3              3           0          3.3         303.2       0.1X
-RocksDB (trackTotalNumberOfRows: false)                                        3              3           0          3.3         303.4       0.1X
+In-memory                                                                      0              1           0         23.9          41.8       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                         3              3           0          3.0         328.1       0.1X
+RocksDB (trackTotalNumberOfRows: false)                                        3              3           0          3.0         329.5       0.1X
 
 
diff --git a/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-results.txt b/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-results.txt
index d009895b3d58..9c99d86e3bfd 100644
--- a/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-results.txt
+++ b/sql/core/benchmarks/StateStoreBasicOperationsBenchmark-results.txt
@@ -2,143 +2,143 @@
 put rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (10000 rows to overwrite - rate 100):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ---------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                           10             11           1          1.0         983.8       1.0X
-RocksDB (trackTotalNumberOfRows: true)                              42             43           2          0.2        4192.5       0.2X
-RocksDB (trackTotalNumberOfRows: false)                             16             16           1          0.6        1556.9       0.6X
+In-memory                                                            9             10           0          1.1         927.6       1.0X
+RocksDB (trackTotalNumberOfRows: true)                              41             42           2          0.2        4063.3       0.2X
+RocksDB (trackTotalNumberOfRows: false)                             15             16           1          0.7        1500.5       0.6X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (5000 rows to overwrite - rate 50):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                         10             11           1          1.0         981.4       1.0X
-RocksDB (trackTotalNumberOfRows: true)                            41             42           2          0.2        4061.8       0.2X
-RocksDB (trackTotalNumberOfRows: false)                           15             16           1          0.6        1547.5       0.6X
+In-memory                                                          9             10           1          1.1         926.5       1.0X
+RocksDB (trackTotalNumberOfRows: true)                            49             50           1          0.2        4853.7       0.2X
+RocksDB (trackTotalNumberOfRows: false)                           15             16           1          0.7        1495.9       0.6X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (1000 rows to overwrite - rate 10):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                          9             10           1          1.1         949.5       1.0X
-RocksDB (trackTotalNumberOfRows: true)                            40             41           1          0.3        3979.3       0.2X
-RocksDB (trackTotalNumberOfRows: false)                           15             16           1          0.6        1540.0       0.6X
+In-memory                                                          9             10           0          1.1         900.9       1.0X
+RocksDB (trackTotalNumberOfRows: true)                            54             55           1          0.2        5359.6       0.2X
+RocksDB (trackTotalNumberOfRows: false)                           15             15           1          0.7        1491.9       0.6X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 putting 10000 rows (0 rows to overwrite - rate 0):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ---------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                      9             10           1          1.1         947.6       1.0X
-RocksDB (trackTotalNumberOfRows: true)                        39             40           1          0.3        3935.4       0.2X
-RocksDB (trackTotalNumberOfRows: false)                       15             16           1          0.6        1539.4       0.6X
+In-memory                                                      9             10           0          1.1         899.6       1.0X
+RocksDB (trackTotalNumberOfRows: true)                        55             56           1          0.2        5500.9       0.2X
+RocksDB (trackTotalNumberOfRows: false)                       15             15           0          0.7        1493.8       0.6X
 
 
 ================================================================================================
 merge rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (10000 rows to overwrite - rate 100):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 --------------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                                    529            540           8          0.0       52863.1       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                                   172            178           3          0.1       17244.4       3.1X
+RocksDB (trackTotalNumberOfRows: true)                                                    515            526           6          0.0       51507.8       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                                   167            175           3          0.1       16747.6       3.1X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (5000 rows to overwrite - rate 50):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ------------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                                  515            527           8          0.0       51526.8       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                                 172            178           4          0.1       17248.0       3.0X
+RocksDB (trackTotalNumberOfRows: true)                                                  516            526           4          0.0       51588.3       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                                 166            171           3          0.1       16579.3       3.1X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (1000 rows to overwrite - rate 10):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ------------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                                  502            511           5          0.0       50176.5       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                                 173            177           2          0.1       17252.8       2.9X
+RocksDB (trackTotalNumberOfRows: true)                                                  513            523           5          0.0       51287.0       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                                 165            170           2          0.1       16532.2       3.1X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 merging 10000 rows with 10 values per key (0 rows to overwrite - rate 0):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 --------------------------------------------------------------------------------------------------------------------------------------------------------
-RocksDB (trackTotalNumberOfRows: true)                                              500            510           5          0.0       49983.4       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                             171            177           3          0.1       17117.0       2.9X
+RocksDB (trackTotalNumberOfRows: true)                                              513            521           4          0.0       51288.3       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                             165            169           2          0.1       16482.6       3.1X
 
 
 ================================================================================================
 delete rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(10000 rows are non-existing - rate 100):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                        0              1           0         25.8          38.8       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                          39             40           1          0.3        3924.3       0.0X
-RocksDB (trackTotalNumberOfRows: false)                                                         15             16           2          0.7        1533.9       0.0X
+In-memory                                                                                        0              0           0         27.9          35.8       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                          54             56           1          0.2        5448.6       0.0X
+RocksDB (trackTotalNumberOfRows: false)                                                         15             15           0          0.7        1458.7       0.0X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(5000 rows are non-existing - rate 50):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -----------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                      8              9           0          1.2         806.7       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                        41             42           1          0.2        4061.1       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                                       15             16           0          0.7        1536.1       0.5X
+In-memory                                                                                      8              8           0          1.3         772.5       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                        48             49           1          0.2        4773.0       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                                       14             15           0          0.7        1445.6       0.5X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(1000 rows are non-existing - rate 10):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -----------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                      9              9           0          1.2         862.9       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                        42             43           1          0.2        4157.1       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                                       15             16           0          0.6        1538.5       0.6X
+In-memory                                                                                      8              9           0          1.2         826.1       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                        42             43           1          0.2        4198.7       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                                       15             15           0          0.7        1460.1       0.6X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 trying to delete 10000 rows from 10000 rows(0 rows are non-existing - rate 0):  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                                  9              9           0          1.1         874.9       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                                    42             43           1          0.2        4157.6       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                                   15             16           0          0.7        1529.0       0.6X
+In-memory                                                                                  8              9           0          1.2         833.2       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                                    40             41           1          0.2        4043.6       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                                   15             15           0          0.7        1457.1       0.6X
 
 
 ================================================================================================
 evict rows
 ================================================================================================
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 10000 rows (maxTimestampToEvictInMillis: 9999) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                            9              9           0          1.2         868.3       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                              40             41           0          0.2        4042.0       0.2X
-RocksDB (trackTotalNumberOfRows: false)                                             16             17           0          0.6        1617.0       0.5X
+In-memory                                                                            8              9           0          1.2         835.1       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                              40             40           0          0.3        3972.7       0.2X
+RocksDB (trackTotalNumberOfRows: false)                                             15             16           0          0.6        1547.2       0.5X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 5000 rows (maxTimestampToEvictInMillis: 4999) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 ------------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                           8              9           0          1.2         815.5       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                             22             22           0          0.5        2194.1       0.4X
-RocksDB (trackTotalNumberOfRows: false)                                            10             10           0          1.0         994.9       0.8X
+In-memory                                                                           8              8           0          1.3         775.3       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                             21             22           1          0.5        2130.5       0.4X
+RocksDB (trackTotalNumberOfRows: false)                                            10             10           0          1.0         973.2       0.8X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 1000 rows (maxTimestampToEvictInMillis: 999) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -----------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                          8              8           0          1.3         756.1       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                             7              7           0          1.4         720.6       1.0X
-RocksDB (trackTotalNumberOfRows: false)                                            5              5           0          2.1         484.1       1.6X
+In-memory                                                                          7              8           0          1.4         704.9       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                             7              7           0          1.4         717.5       1.0X
+RocksDB (trackTotalNumberOfRows: false)                                            5              5           0          2.1         482.3       1.5X
 
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
 AMD EPYC 7763 64-Core Processor
 evicting 0 rows (maxTimestampToEvictInMillis: -1) from 10000 rows:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
 -------------------------------------------------------------------------------------------------------------------------------------------------
-In-memory                                                                      0              1           0         21.3          46.8       1.0X
-RocksDB (trackTotalNumberOfRows: true)                                         4              4           0          2.8         351.5       0.1X
-RocksDB (trackTotalNumberOfRows: false)                                        4              4           0          2.8         352.0       0.1X
+In-memory                                                                      0              0           0         23.0          43.4       1.0X
+RocksDB (trackTotalNumberOfRows: true)                                         4              4           0          2.8         352.8       0.1X
+RocksDB (trackTotalNumberOfRows: false)                                        4              4           0          2.8         353.7       0.1X
 
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org