You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/12/29 00:45:08 UTC
[GitHub] [spark] dongjoon-hyun opened a new pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
dongjoon-hyun opened a new pull request #35046:
URL: https://github.com/apache/spark/pull/35046
### What changes were proposed in this pull request?
This PR aims to regenerate benchmark results.
### Why are the changes needed?
To make the benchmark up-to-date according to the latest code change. The oldest benchmark result files are 9 months ago.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manually review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776118133
##########
File path: sql/catalyst/benchmarks/EnumTypeSetBenchmark-results.txt
##########
@@ -1,104 +1,105 @@
-Java HotSpot(TM) 64-Bit Server VM 1.8.0_152-b16 on Linux 4.14.0_1-0-0-42
-Intel(R) Xeon(R) Gold 6271C CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Test contains use empty Set: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Use HashSet 1 1 0 1316.2 0.8 1.0X
-Use EnumSet 0 0 0 16393442.6 0.0 12454.9X
+Use HashSet 0 1 1 2192.0 0.5 1.0X
+Use EnumSet 0 0 0 Infinity 0.0 InfinityX
Review comment:
This benchmark looks a little weird although the previous ratio is also huge already.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776117331
##########
File path: mllib-local/benchmarks/BLASBenchmark-jdk11-results.txt
##########
@@ -2,251 +2,337 @@
daxpy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
daxpy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 530 554 11 188.8 5.3 1.0X
-java 533 563 11 187.5 5.3 1.0X
+f2j 527 535 5 189.8 5.3 1.0X
+java 530 533 1 188.8 5.3 1.0X
+native 531 534 1 188.3 5.3 1.0X
================================================================================================
saxpy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
saxpy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 295 309 5 338.8 3.0 1.0X
-java 290 300 6 345.2 2.9 1.0X
+f2j 284 286 1 352.1 2.8 1.0X
+java 280 284 1 356.7 2.8 1.0X
+native 281 283 1 355.5 2.8 1.0X
================================================================================================
-ddot
+dcopy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-ddot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dcopy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 155 165 6 643.5 1.6 1.0X
-java 131 142 4 764.1 1.3 1.2X
+f2j 526 529 2 190.3 5.3 1.0X
+java 503 518 14 199.0 5.0 1.0X
+native 525 527 1 190.5 5.2 1.0X
================================================================================================
-sdot
+scopy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-sdot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+scopy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 121 131 4 827.9 1.2 1.0X
-java 91 99 3 1101.7 0.9 1.3X
+f2j 281 283 1 355.9 2.8 1.0X
+java 249 263 14 402.2 2.5 1.1X
+native 268 271 1 372.7 2.7 1.0X
================================================================================================
-dscal
+ddot
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+ddot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 486 502 9 205.7 4.9 1.0X
-java 486 501 8 205.7 4.9 1.0X
+f2j 210 212 1 477.2 2.1 1.0X
+java 185 187 1 540.0 1.9 1.1X
+native 205 208 1 487.7 2.1 1.0X
================================================================================================
-sscal
+sdot
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-sscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+sdot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 257 265 5 389.8 2.6 1.0X
-java 253 267 4 395.1 2.5 1.0X
+f2j 156 157 1 640.4 1.6 1.0X
+java 104 105 1 964.2 1.0 1.5X
+native 155 156 0 644.4 1.6 1.0X
================================================================================================
-dspmv[U]
+dnrm2
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dspmv[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dnrm2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 884.8 1.1 1.0X
-java 0 1 0 1064.7 0.9 1.2X
+f2j 212 216 4 470.9 2.1 1.0X
+java 78 79 1 1278.0 0.8 2.7X
+native 200 201 0 499.0 2.0 1.1X
================================================================================================
-dspr[U]
+snrm2
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dspr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+snrm2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 533.3 1.9 1.0X
-java 1 1 0 523.9 1.9 1.0X
+f2j 223 224 0 447.5 2.2 1.0X
+java 54 54 0 1848.3 0.5 4.1X
+native 146 147 0 683.2 1.5 1.5X
================================================================================================
-dsyr[U]
+dscal
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dsyr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 418 420 1 239.4 4.2 1.0X
+java 429 432 1 233.2 4.3 1.0X
+native 423 427 4 236.1 4.2 1.0X
+
+
+================================================================================================
+sscal
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+sscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 2 1 340.5 2.9 1.0X
-java 1 2 1 344.2 2.9 1.0X
+f2j 236 239 1 423.1 2.4 1.0X
+java 234 236 1 426.9 2.3 1.0X
+native 234 236 1 427.4 2.3 1.0X
================================================================================================
dgemv[N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemv[N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1491.4 0.7 1.0X
-java 0 1 0 2554.3 0.4 1.7X
+f2j 112 113 1 893.8 1.1 1.0X
+java 84 84 0 1195.1 0.8 1.3X
+native 108 108 1 928.9 1.1 1.0X
================================================================================================
dgemv[T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemv[T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1189.3 0.8 1.0X
-java 0 0 0 2770.9 0.4 2.3X
+f2j 183 183 0 545.5 1.8 1.0X
+java 81 81 0 1235.8 0.8 2.3X
+native 172 173 1 581.3 1.7 1.1X
================================================================================================
sgemv[N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
sgemv[N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1580.8 0.6 1.0X
-java 0 1 0 2091.6 0.5 1.3X
+f2j 90 90 0 1112.5 0.9 1.0X
+java 52 52 0 1918.4 0.5 1.7X
+native 89 90 0 1118.9 0.9 1.0X
================================================================================================
sgemv[T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
sgemv[T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1190.6 0.8 1.0X
-java 0 1 0 2551.7 0.4 2.1X
+f2j 145 145 0 690.7 1.4 1.0X
+java 46 46 0 2195.1 0.5 3.2X
+native 143 143 0 698.2 1.4 1.0X
+
+
+================================================================================================
+dger
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dger: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 447 450 2 223.7 4.5 1.0X
+java 431 434 4 232.2 4.3 1.0X
+native 442 445 1 226.1 4.4 1.0X
+
+
+================================================================================================
+dspmv[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dspmv[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 95 95 0 524.9 1.9 1.0X
+java 66 66 0 756.3 1.3 1.4X
+native 95 95 0 526.3 1.9 1.0X
+
+
+================================================================================================
+dspr[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dspr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 235 237 1 212.7 4.7 1.0X
+java 236 238 2 212.1 4.7 1.0X
+native 225 227 1 222.3 4.5 1.0X
+
+
+================================================================================================
+dsyr[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dsyr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 387 390 3 129.1 7.7 1.0X
+java 387 390 1 129.1 7.7 1.0X
+native 384 387 1 130.2 7.7 1.0X
================================================================================================
dgemm[N,N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemm[N,N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 914 956 25 1094.1 0.9 1.0X
-java 347 370 11 2881.8 0.3 2.6X
+f2j 744 749 5 1343.4 0.7 1.0X
+java 286 293 6 3497.6 0.3 2.6X
+native 685 687 2 1459.0 0.7 1.1X
================================================================================================
dgemm[N,T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemm[N,T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 927 968 22 1078.4 0.9 1.0X
-java 348 370 10 2872.6 0.3 2.7X
+f2j 773 780 6 1294.1 0.8 1.0X
+java 288 296 6 3473.2 0.3 2.7X
+native 708 711 2 1412.4 0.7 1.1X
Review comment:
According to SPARK-35150 (#32253), this means that native libraries are installed somehow, but the performance is worse than Java.
```
If native libraries are not properly configured in the system, the Java implementation (javaBLAS) will be used as fallback option.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776116134
##########
File path: external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt
##########
@@ -2,129 +2,140 @@
SQL Single Numeric Column Scan
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum 3468 3495 39 4.5 220.5 1.0X
+Sum 3014 3071 81 5.2 191.6 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum 3378 3388 13 4.7 214.8 1.0X
+Sum 2975 2987 17 5.3 189.1 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum 3353 3371 26 4.7 213.2 1.0X
+Sum 2950 2956 8 5.3 187.5 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum 3712 3739 38 4.2 236.0 1.0X
+Sum 3479 3489 13 4.5 221.2 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum 3290 3322 45 4.8 209.2 1.0X
+Sum 3066 3069 4 5.1 195.0 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum 3475 3493 25 4.5 220.9 1.0X
+Sum 3159 3236 109 5.0 200.9 1.0X
================================================================================================
Int and String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum of columns 5032 5053 29 2.1 479.9 1.0X
+Sum of columns 4839 4872 47 2.2 461.4 1.0X
================================================================================================
Partitioned Table Scan
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Data column 3819 3820 1 4.1 242.8 1.0X
-Partition column 3285 3340 77 4.8 208.8 1.2X
-Both columns 4051 4066 21 3.9 257.6 0.9X
+Data column 3466 3517 72 4.5 220.4 1.0X
+Partition column 3234 3261 38 4.9 205.6 1.1X
+Both columns 3798 3806 12 4.1 241.5 0.9X
================================================================================================
Repeated String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum of string length 3631 3653 32 2.9 346.2 1.0X
+Sum of string length 3466 3515 69 3.0 330.6 1.0X
================================================================================================
String with Nulls Scan
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum of string length 5786 5801 21 1.8 551.8 1.0X
+Sum of string length 5532 5575 61 1.9 527.5 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum of string length 3767 3791 34 2.8 359.2 1.0X
+Sum of string length 3568 3591 32 2.9 340.3 1.0X
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Sum of string length 2472 2498 36 4.2 235.8 1.0X
+Sum of string length 2210 2275 92 4.7 210.7 1.0X
+
+
+================================================================================================
+Select All From Wide Columns
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+Wide Column Scan from 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+Select of all columns 41061 41151 128 0.0 82121.6 1.0X
Review comment:
This test case seems to be added without updating the result file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776130803
##########
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##########
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
+OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-One quoted string 43757 44446 765 0.0 875148.4 1.0X
+One quoted string 51747 52432 599 0.0 1034931.8 1.0X
-OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
+OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Select 1000 columns 96330 99161 NaN 0.0 96329.7 1.0X
-Select 100 columns 41414 42672 1556 0.0 41414.1 2.3X
-Select one column 35365 36113 662 0.0 35365.4 2.7X
-count() 18845 18867 26 0.1 18845.0 5.1X
-Select 100 columns, one bad input field 68271 68305 51 0.0 68270.7 1.4X
-Select 100 columns, corrupt record field 77700 78165 803 0.0 77699.7 1.2X
+Select 1000 columns 118598 119530 1380 0.0 118598.1 1.0X
+Select 100 columns 41421 41669 221 0.0 41420.9 2.9X
+Select one column 34304 34521 325 0.0 34304.3 3.5X
+count() 10934 11080 128 0.1 10934.5 10.8X
Review comment:
This looks improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on pull request #35046:
URL: https://github.com/apache/spark/pull/35046#issuecomment-1002342915
Ya, @HyukjinKwon . I also want to see the updated result of year 2021 through GitHub PR viewer. This result would be a snapshot result before starting 2022 work.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776116323
##########
File path: external/avro/benchmarks/AvroWriteBenchmark-jdk11-results.txt
##########
@@ -1,10 +1,16 @@
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Avro writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Output Single Int Column 3307 3313 8 4.8 210.3 1.0X
-Output Single Double Column 3566 3584 26 4.4 226.7 0.9X
-Output Int and String Column 6913 6988 106 2.3 439.5 0.5X
-Output Partitions 5984 6112 181 2.6 380.5 0.6X
-Output Buckets 8403 8505 144 1.9 534.3 0.4X
+Output Single Int Column 2495 2503 11 6.3 158.6 1.0X
+Output Single Double Column 2709 2784 106 5.8 172.2 0.9X
+Output Int and String Column 5062 5107 64 3.1 321.8 0.5X
+Output Partitions 4966 4973 10 3.2 315.7 0.5X
+Output Buckets 6326 6569 343 2.5 402.2 0.4X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write wide rows into 20 files: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+Write wide rows 40358 40374 23 0.0 80715.3 1.0X
Review comment:
Ditto. The original PR seems to miss to update this file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776118479
##########
File path: sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt
##########
@@ -2,76 +2,76 @@
Benchmark for MurMurHash 3 and xxHash64
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Hash byte arrays with length 8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Murmur3_x86_32 15 16 1 140.1 7.1 1.0X
-xxHash 64-bit 18 19 1 118.8 8.4 0.8X
-HiveHasher 17 18 1 122.4 8.2 0.9X
+Murmur3_x86_32 13 13 0 159.2 6.3 1.0X
+xxHash 64-bit 12 12 0 173.6 5.8 1.1X
Review comment:
This case looks strange because the ratio (Murmur vs xxHash) is reversed somehow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776118872
##########
File path: sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk17-results.txt
##########
@@ -2,76 +2,76 @@
Benchmark for MurMurHash 3 and xxHash64
================================================================================================
-OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.8.0-1042-azure
-Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
+OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Hash byte arrays with length 8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Murmur3_x86_32 27 29 2 77.9 12.8 1.0X
-xxHash 64-bit 23 25 1 92.4 10.8 1.2X
-HiveHasher 18 19 1 119.0 8.4 1.5X
+Murmur3_x86_32 13 14 1 165.3 6.1 1.0X
+xxHash 64-bit 19 20 1 110.5 9.0 0.7X
Review comment:
The data size `8` is too small to be consistent.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #35046:
URL: https://github.com/apache/spark/pull/35046#issuecomment-1002342915
Ya, @HyukjinKwon . I also want to see the updated result of year 2021 through GitHub PR viewer. This would be a snapshot result before starting 2022 work.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776118479
##########
File path: sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt
##########
@@ -2,76 +2,76 @@
Benchmark for MurMurHash 3 and xxHash64
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Hash byte arrays with length 8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Murmur3_x86_32 15 16 1 140.1 7.1 1.0X
-xxHash 64-bit 18 19 1 118.8 8.4 0.8X
-HiveHasher 17 18 1 122.4 8.2 0.9X
+Murmur3_x86_32 13 13 0 159.2 6.3 1.0X
+xxHash 64-bit 12 12 0 173.6 5.8 1.1X
Review comment:
~This case looks strange because the ratio (Murmur vs xxHash) is reversed somehow.~ I realized that the previous one was wrong(misleading) because `xxHash` is faster consistently in other test cases in this benchmark. New result is consistent with the others.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776118479
##########
File path: sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt
##########
@@ -2,76 +2,76 @@
Benchmark for MurMurHash 3 and xxHash64
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Hash byte arrays with length 8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Murmur3_x86_32 15 16 1 140.1 7.1 1.0X
-xxHash 64-bit 18 19 1 118.8 8.4 0.8X
-HiveHasher 17 18 1 122.4 8.2 0.9X
+Murmur3_x86_32 13 13 0 159.2 6.3 1.0X
+xxHash 64-bit 12 12 0 173.6 5.8 1.1X
Review comment:
~This case looks strange because the ratio (Murmur vs xxHash) is reversed somehow.~ I realized that the previous one was wrong(misleading) because `xxHash` is faster consistently in other test cases in this benchmark.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #35046:
URL: https://github.com/apache/spark/pull/35046#issuecomment-1002377397
This doesn't change any code and only the result of the AS-IS code. I'll merge this. Thank you, @HyukjinKwon .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun closed pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun closed pull request #35046:
URL: https://github.com/apache/spark/pull/35046
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776116775
##########
File path: mllib-local/benchmarks/BLASBenchmark-jdk11-results.txt
##########
@@ -2,251 +2,337 @@
daxpy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
daxpy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 530 554 11 188.8 5.3 1.0X
-java 533 563 11 187.5 5.3 1.0X
+f2j 527 535 5 189.8 5.3 1.0X
+java 530 533 1 188.8 5.3 1.0X
+native 531 534 1 188.3 5.3 1.0X
================================================================================================
saxpy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
saxpy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 295 309 5 338.8 3.0 1.0X
-java 290 300 6 345.2 2.9 1.0X
+f2j 284 286 1 352.1 2.8 1.0X
+java 280 284 1 356.7 2.8 1.0X
+native 281 283 1 355.5 2.8 1.0X
================================================================================================
-ddot
+dcopy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-ddot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dcopy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 155 165 6 643.5 1.6 1.0X
-java 131 142 4 764.1 1.3 1.2X
+f2j 526 529 2 190.3 5.3 1.0X
+java 503 518 14 199.0 5.0 1.0X
+native 525 527 1 190.5 5.2 1.0X
================================================================================================
-sdot
+scopy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-sdot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+scopy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 121 131 4 827.9 1.2 1.0X
-java 91 99 3 1101.7 0.9 1.3X
+f2j 281 283 1 355.9 2.8 1.0X
+java 249 263 14 402.2 2.5 1.1X
+native 268 271 1 372.7 2.7 1.0X
================================================================================================
-dscal
+ddot
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+ddot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 486 502 9 205.7 4.9 1.0X
-java 486 501 8 205.7 4.9 1.0X
+f2j 210 212 1 477.2 2.1 1.0X
+java 185 187 1 540.0 1.9 1.1X
+native 205 208 1 487.7 2.1 1.0X
================================================================================================
-sscal
+sdot
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-sscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+sdot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 257 265 5 389.8 2.6 1.0X
-java 253 267 4 395.1 2.5 1.0X
+f2j 156 157 1 640.4 1.6 1.0X
+java 104 105 1 964.2 1.0 1.5X
+native 155 156 0 644.4 1.6 1.0X
================================================================================================
-dspmv[U]
+dnrm2
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dspmv[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dnrm2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 884.8 1.1 1.0X
-java 0 1 0 1064.7 0.9 1.2X
+f2j 212 216 4 470.9 2.1 1.0X
+java 78 79 1 1278.0 0.8 2.7X
+native 200 201 0 499.0 2.0 1.1X
================================================================================================
-dspr[U]
+snrm2
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dspr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+snrm2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 533.3 1.9 1.0X
-java 1 1 0 523.9 1.9 1.0X
+f2j 223 224 0 447.5 2.2 1.0X
+java 54 54 0 1848.3 0.5 4.1X
+native 146 147 0 683.2 1.5 1.5X
================================================================================================
-dsyr[U]
+dscal
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dsyr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 418 420 1 239.4 4.2 1.0X
+java 429 432 1 233.2 4.3 1.0X
+native 423 427 4 236.1 4.2 1.0X
+
+
+================================================================================================
+sscal
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+sscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 2 1 340.5 2.9 1.0X
-java 1 2 1 344.2 2.9 1.0X
+f2j 236 239 1 423.1 2.4 1.0X
+java 234 236 1 426.9 2.3 1.0X
+native 234 236 1 427.4 2.3 1.0X
================================================================================================
dgemv[N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemv[N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1491.4 0.7 1.0X
-java 0 1 0 2554.3 0.4 1.7X
+f2j 112 113 1 893.8 1.1 1.0X
+java 84 84 0 1195.1 0.8 1.3X
+native 108 108 1 928.9 1.1 1.0X
================================================================================================
dgemv[T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemv[T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1189.3 0.8 1.0X
-java 0 0 0 2770.9 0.4 2.3X
+f2j 183 183 0 545.5 1.8 1.0X
+java 81 81 0 1235.8 0.8 2.3X
+native 172 173 1 581.3 1.7 1.1X
================================================================================================
sgemv[N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
sgemv[N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1580.8 0.6 1.0X
-java 0 1 0 2091.6 0.5 1.3X
+f2j 90 90 0 1112.5 0.9 1.0X
+java 52 52 0 1918.4 0.5 1.7X
+native 89 90 0 1118.9 0.9 1.0X
================================================================================================
sgemv[T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
sgemv[T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1190.6 0.8 1.0X
-java 0 1 0 2551.7 0.4 2.1X
+f2j 145 145 0 690.7 1.4 1.0X
+java 46 46 0 2195.1 0.5 3.2X
+native 143 143 0 698.2 1.4 1.0X
+
+
+================================================================================================
+dger
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dger: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 447 450 2 223.7 4.5 1.0X
+java 431 434 4 232.2 4.3 1.0X
+native 442 445 1 226.1 4.4 1.0X
+
+
+================================================================================================
+dspmv[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dspmv[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 95 95 0 524.9 1.9 1.0X
+java 66 66 0 756.3 1.3 1.4X
+native 95 95 0 526.3 1.9 1.0X
+
+
+================================================================================================
+dspr[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dspr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 235 237 1 212.7 4.7 1.0X
+java 236 238 2 212.1 4.7 1.0X
+native 225 227 1 222.3 4.5 1.0X
+
+
+================================================================================================
+dsyr[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dsyr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 387 390 3 129.1 7.7 1.0X
+java 387 390 1 129.1 7.7 1.0X
+native 384 387 1 130.2 7.7 1.0X
Review comment:
ditto.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776116323
##########
File path: external/avro/benchmarks/AvroWriteBenchmark-jdk11-results.txt
##########
@@ -1,10 +1,16 @@
-OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Avro writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Output Single Int Column 3307 3313 8 4.8 210.3 1.0X
-Output Single Double Column 3566 3584 26 4.4 226.7 0.9X
-Output Int and String Column 6913 6988 106 2.3 439.5 0.5X
-Output Partitions 5984 6112 181 2.6 380.5 0.6X
-Output Buckets 8403 8505 144 1.9 534.3 0.4X
+Output Single Int Column 2495 2503 11 6.3 158.6 1.0X
+Output Single Double Column 2709 2784 106 5.8 172.2 0.9X
+Output Int and String Column 5062 5107 64 3.1 321.8 0.5X
+Output Partitions 4966 4973 10 3.2 315.7 0.5X
+Output Buckets 6326 6569 343 2.5 402.2 0.4X
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+Write wide rows into 20 files: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+Write wide rows 40358 40374 23 0.0 80715.3 1.0X
Review comment:
Ditto. This test is also added without generating benchmarks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #35046: [SPARK-37766][TESTS] Regenerate benchmark results
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #35046:
URL: https://github.com/apache/spark/pull/35046#discussion_r776117331
##########
File path: mllib-local/benchmarks/BLASBenchmark-jdk11-results.txt
##########
@@ -2,251 +2,337 @@
daxpy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
daxpy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 530 554 11 188.8 5.3 1.0X
-java 533 563 11 187.5 5.3 1.0X
+f2j 527 535 5 189.8 5.3 1.0X
+java 530 533 1 188.8 5.3 1.0X
+native 531 534 1 188.3 5.3 1.0X
================================================================================================
saxpy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
saxpy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 295 309 5 338.8 3.0 1.0X
-java 290 300 6 345.2 2.9 1.0X
+f2j 284 286 1 352.1 2.8 1.0X
+java 280 284 1 356.7 2.8 1.0X
+native 281 283 1 355.5 2.8 1.0X
================================================================================================
-ddot
+dcopy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-ddot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dcopy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 155 165 6 643.5 1.6 1.0X
-java 131 142 4 764.1 1.3 1.2X
+f2j 526 529 2 190.3 5.3 1.0X
+java 503 518 14 199.0 5.0 1.0X
+native 525 527 1 190.5 5.2 1.0X
================================================================================================
-sdot
+scopy
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-sdot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+scopy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 121 131 4 827.9 1.2 1.0X
-java 91 99 3 1101.7 0.9 1.3X
+f2j 281 283 1 355.9 2.8 1.0X
+java 249 263 14 402.2 2.5 1.1X
+native 268 271 1 372.7 2.7 1.0X
================================================================================================
-dscal
+ddot
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+ddot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 486 502 9 205.7 4.9 1.0X
-java 486 501 8 205.7 4.9 1.0X
+f2j 210 212 1 477.2 2.1 1.0X
+java 185 187 1 540.0 1.9 1.1X
+native 205 208 1 487.7 2.1 1.0X
================================================================================================
-sscal
+sdot
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-sscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+sdot: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 257 265 5 389.8 2.6 1.0X
-java 253 267 4 395.1 2.5 1.0X
+f2j 156 157 1 640.4 1.6 1.0X
+java 104 105 1 964.2 1.0 1.5X
+native 155 156 0 644.4 1.6 1.0X
================================================================================================
-dspmv[U]
+dnrm2
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dspmv[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dnrm2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 884.8 1.1 1.0X
-java 0 1 0 1064.7 0.9 1.2X
+f2j 212 216 4 470.9 2.1 1.0X
+java 78 79 1 1278.0 0.8 2.7X
+native 200 201 0 499.0 2.0 1.1X
================================================================================================
-dspr[U]
+snrm2
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dspr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+snrm2: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 533.3 1.9 1.0X
-java 1 1 0 523.9 1.9 1.0X
+f2j 223 224 0 447.5 2.2 1.0X
+java 54 54 0 1848.3 0.5 4.1X
+native 146 147 0 683.2 1.5 1.5X
================================================================================================
-dsyr[U]
+dscal
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
-dsyr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 418 420 1 239.4 4.2 1.0X
+java 429 432 1 233.2 4.3 1.0X
+native 423 427 4 236.1 4.2 1.0X
+
+
+================================================================================================
+sscal
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+sscal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 2 1 340.5 2.9 1.0X
-java 1 2 1 344.2 2.9 1.0X
+f2j 236 239 1 423.1 2.4 1.0X
+java 234 236 1 426.9 2.3 1.0X
+native 234 236 1 427.4 2.3 1.0X
================================================================================================
dgemv[N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemv[N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1491.4 0.7 1.0X
-java 0 1 0 2554.3 0.4 1.7X
+f2j 112 113 1 893.8 1.1 1.0X
+java 84 84 0 1195.1 0.8 1.3X
+native 108 108 1 928.9 1.1 1.0X
================================================================================================
dgemv[T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemv[T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1189.3 0.8 1.0X
-java 0 0 0 2770.9 0.4 2.3X
+f2j 183 183 0 545.5 1.8 1.0X
+java 81 81 0 1235.8 0.8 2.3X
+native 172 173 1 581.3 1.7 1.1X
================================================================================================
sgemv[N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
sgemv[N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1580.8 0.6 1.0X
-java 0 1 0 2091.6 0.5 1.3X
+f2j 90 90 0 1112.5 0.9 1.0X
+java 52 52 0 1918.4 0.5 1.7X
+native 89 90 0 1118.9 0.9 1.0X
================================================================================================
sgemv[T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
sgemv[T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 1 1 0 1190.6 0.8 1.0X
-java 0 1 0 2551.7 0.4 2.1X
+f2j 145 145 0 690.7 1.4 1.0X
+java 46 46 0 2195.1 0.5 3.2X
+native 143 143 0 698.2 1.4 1.0X
+
+
+================================================================================================
+dger
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dger: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 447 450 2 223.7 4.5 1.0X
+java 431 434 4 232.2 4.3 1.0X
+native 442 445 1 226.1 4.4 1.0X
+
+
+================================================================================================
+dspmv[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dspmv[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 95 95 0 524.9 1.9 1.0X
+java 66 66 0 756.3 1.3 1.4X
+native 95 95 0 526.3 1.9 1.0X
+
+
+================================================================================================
+dspr[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dspr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 235 237 1 212.7 4.7 1.0X
+java 236 238 2 212.1 4.7 1.0X
+native 225 227 1 222.3 4.5 1.0X
+
+
+================================================================================================
+dsyr[U]
+================================================================================================
+
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
+dsyr[U]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
+------------------------------------------------------------------------------------------------------------------------
+f2j 387 390 3 129.1 7.7 1.0X
+java 387 390 1 129.1 7.7 1.0X
+native 384 387 1 130.2 7.7 1.0X
================================================================================================
dgemm[N,N]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemm[N,N]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 914 956 25 1094.1 0.9 1.0X
-java 347 370 11 2881.8 0.3 2.6X
+f2j 744 749 5 1343.4 0.7 1.0X
+java 286 293 6 3497.6 0.3 2.6X
+native 685 687 2 1459.0 0.7 1.1X
================================================================================================
dgemm[N,T]
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.11+9-LTS on Linux 5.4.0-1046-azure
-Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
+OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
dgemm[N,T]: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-f2j 927 968 22 1078.4 0.9 1.0X
-java 348 370 10 2872.6 0.3 2.7X
+f2j 773 780 6 1294.1 0.8 1.0X
+java 288 296 6 3473.2 0.3 2.7X
+native 708 711 2 1412.4 0.7 1.1X
Review comment:
According to SPARK-35150, this means that native libraries are installed somehow, but the performance is worse than Java.
```
If native libraries are not properly configured in the system, the Java implementation (javaBLAS) will be used as fallback option.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org