You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2021/10/28 18:09:26 UTC
[spark] branch master updated: [SPARK-37143][TESTS] Supplement the
missing Java 11 benchmark result files
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 4a09e74 [SPARK-37143][TESTS] Supplement the missing Java 11 benchmark result files
4a09e74 is described below
commit 4a09e74f1d6c46f3ca5150e1b4eaff13a9034ab1
Author: yangjie01 <ya...@baidu.com>
AuthorDate: Thu Oct 28 11:08:43 2021 -0700
[SPARK-37143][TESTS] Supplement the missing Java 11 benchmark result files
### What changes were proposed in this pull request?
`CharVarcharBenchmark-results.txt`and `UpdateFieldsBenchmark-results.txt` exist in the project, but `CharVarcharBenchmark-jdk11-results.txt` and `UpdateFieldsBenchmark-jdk11-results.txt `are missing, so this pr added them.
### Why are the changes needed?
Supplement the missing Java 11 benchmark result files.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
The 2 file was generated from:
- [Run benchmarks: * (JDK 11)](https://github.com/LuciferYang/spark/actions/runs/1392788240)
Closes #34423 from LuciferYang/bench-jdk11.
Authored-by: yangjie01 <ya...@baidu.com>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.../CharVarcharBenchmark-jdk11-results.txt | 122 +++++++++++++++++++++
.../UpdateFieldsBenchmark-jdk11-results.txt | 26 +++++
2 files changed, 148 insertions(+)
diff --git a/sql/core/benchmarks/CharVarcharBenchmark-jdk11-results.txt b/sql/core/benchmarks/CharVarcharBenchmark-jdk11-results.txt
new file mode 100644
index 0000000..25740d0
--- /dev/null
+++ b/sql/core/benchmarks/CharVarcharBenchmark-jdk11-results.txt
@@ -0,0 +1,122 @@
+================================================================================================
+Char Varchar Write Side Perf w/o Tailing Spaces
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 5: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 5 11587 11682 133 3.5 289.7 1.0X
+write char with length 5 15479 15566 103 2.6 387.0 0.7X
+write varchar with length 5 12057 12165 122 3.3 301.4 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 10: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 10 5660 5698 56 3.5 283.0 1.0X
+write char with length 10 9484 9542 60 2.1 474.2 0.6X
+write varchar with length 10 5908 5928 26 3.4 295.4 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 20: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 20 2968 2981 21 3.4 296.8 1.0X
+write char with length 20 6647 6672 22 1.5 664.7 0.4X
+write varchar with length 20 3064 3070 6 3.3 306.4 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 40: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 40 1508 1538 31 3.3 301.7 1.0X
+write char with length 40 5218 5233 13 1.0 1043.6 0.3X
+write varchar with length 40 1603 1609 6 3.1 320.7 0.9X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 60: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 60 1066 1097 53 3.1 319.7 1.0X
+write char with length 60 4643 4648 7 0.7 1392.9 0.2X
+write varchar with length 60 1097 1115 26 3.0 329.1 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 80: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 80 824 840 14 3.0 329.5 1.0X
+write char with length 80 4520 4539 27 0.6 1807.8 0.2X
+write varchar with length 80 852 861 11 2.9 340.9 1.0X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 100: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 100 678 692 19 2.9 339.1 1.0X
+write char with length 100 4384 4390 6 0.5 2191.8 0.2X
+write varchar with length 100 711 716 8 2.8 355.3 1.0X
+
+
+================================================================================================
+Char Varchar Write Side Perf w/ Tailing Spaces
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 5: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 5 18526 18553 32 2.2 463.2 1.0X
+write char with length 5 20668 20674 6 1.9 516.7 0.9X
+write varchar with length 5 20642 20742 169 1.9 516.0 0.9X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 10: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 10 10490 10522 45 1.9 524.5 1.0X
+write char with length 10 12474 12522 59 1.6 623.7 0.8X
+write varchar with length 10 12522 12578 49 1.6 626.1 0.8X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 20: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 20 7087 7089 2 1.4 708.7 1.0X
+write char with length 20 8936 8952 16 1.1 893.6 0.8X
+write varchar with length 20 8985 8988 6 1.1 898.5 0.8X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 40: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 40 5220 5222 4 1.0 1043.9 1.0X
+write char with length 40 7021 7025 4 0.7 1404.2 0.7X
+write varchar with length 40 7025 7027 2 0.7 1405.0 0.7X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 60: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 60 4504 4505 0 0.7 1351.3 1.0X
+write char with length 60 6446 6453 7 0.5 1933.7 0.7X
+write varchar with length 60 6315 6322 6 0.5 1894.6 0.7X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 80: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 80 4277 4279 2 0.6 1711.0 1.0X
+write char with length 80 6094 6103 9 0.4 2437.6 0.7X
+write varchar with length 80 6098 6099 2 0.4 2439.2 0.7X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write with length 100: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+write string with length 100 4070 4076 9 0.5 2035.1 1.0X
+write char with length 100 5975 5983 10 0.3 2987.7 0.7X
+write varchar with length 100 6034 6041 6 0.3 3017.1 0.7X
+
+
diff --git a/sql/core/benchmarks/UpdateFieldsBenchmark-jdk11-results.txt b/sql/core/benchmarks/UpdateFieldsBenchmark-jdk11-results.txt
new file mode 100644
index 0000000..552f5c9
--- /dev/null
+++ b/sql/core/benchmarks/UpdateFieldsBenchmark-jdk11-results.txt
@@ -0,0 +1,26 @@
+================================================================================================
+Add 2 columns and drop 2 columns at 3 different depths of nesting
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+Add 2 columns and drop 2 columns at 3 different depths of nesting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+-------------------------------------------------------------------------------------------------------------------------------------------------
+To non-nullable StructTypes using performant method 3 5 2 0.0 Infinity 1.0X
+To nullable StructTypes using performant method 3 4 1 0.0 Infinity 1.2X
+To non-nullable StructTypes using non-performant method 56 61 4 0.0 Infinity 0.1X
+To nullable StructTypes using non-performant method 1158 1216 81 0.0 Infinity 0.0X
+
+
+================================================================================================
+Add 50 columns and drop 50 columns at 100 different depths of nesting
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.8.0-1042-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+Add 50 columns and drop 50 columns at 100 different depths of nesting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+-----------------------------------------------------------------------------------------------------------------------------------------------------
+To non-nullable StructTypes using performant method 3617 3661 62 0.0 Infinity 1.0X
+To nullable StructTypes using performant method 3566 3606 57 0.0 Infinity 1.0X
+
+
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org