You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2023/01/04 04:43:13 UTC
[GitHub] [spark] dongjoon-hyun commented on a diff in pull request #39380: [SPARK-41862][SQL][TESTS][FOLLOWUP] Update OrcReadBenchmark result
dongjoon-hyun commented on code in PR #39380:
URL: https://github.com/apache/spark/pull/39380#discussion_r1061131503
##########
sql/hive/benchmarks/OrcReadBenchmark-results.txt:
##########
@@ -3,220 +3,220 @@ SQL Single Numeric Column Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1137 1146 14 13.8 72.3 1.0X
-Native ORC MR 1034 1048 20 15.2 65.7 1.1X
-Native ORC Vectorized 92 117 23 170.9 5.8 12.4X
+Hive built-in ORC 933 956 20 16.9 59.3 1.0X
+Native ORC MR 908 1013 149 17.3 57.7 1.0X
+Native ORC Vectorized 131 166 28 120.2 8.3 7.1X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1269 1319 71 12.4 80.7 1.0X
-Native ORC MR 1087 1088 1 14.5 69.1 1.2X
-Native ORC Vectorized 155 182 24 101.3 9.9 8.2X
+Hive built-in ORC 1051 1087 51 15.0 66.8 1.0X
+Native ORC MR 750 773 26 21.0 47.7 1.4X
+Native ORC Vectorized 116 135 17 136.1 7.3 9.1X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1369 1466 137 11.5 87.0 1.0X
-Native ORC MR 1103 1277 247 14.3 70.1 1.2X
-Native ORC Vectorized 175 192 26 90.1 11.1 7.8X
+Hive built-in ORC 963 1018 70 16.3 61.2 1.0X
+Native ORC MR 814 822 11 19.3 51.8 1.2X
+Native ORC Vectorized 138 172 21 113.8 8.8 7.0X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1469 1539 98 10.7 93.4 1.0X
-Native ORC MR 1214 1239 36 13.0 77.2 1.2X
-Native ORC Vectorized 256 274 26 61.4 16.3 5.7X
+Hive built-in ORC 1020 1041 29 15.4 64.9 1.0X
+Native ORC MR 828 899 117 19.0 52.6 1.2X
+Native ORC Vectorized 165 191 17 95.4 10.5 6.2X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1467 1480 18 10.7 93.3 1.0X
-Native ORC MR 1239 1303 90 12.7 78.8 1.2X
-Native ORC Vectorized 217 224 8 72.6 13.8 6.8X
+Hive built-in ORC 1018 1022 6 15.5 64.7 1.0X
+Native ORC MR 812 828 17 19.4 51.6 1.3X
+Native ORC Vectorized 175 195 21 90.0 11.1 5.8X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1432 1456 33 11.0 91.1 1.0X
-Native ORC MR 1230 1244 20 12.8 78.2 1.2X
-Native ORC Vectorized 243 263 24 64.7 15.5 5.9X
+Hive built-in ORC 1063 1076 19 14.8 67.6 1.0X
+Native ORC MR 864 890 23 18.2 54.9 1.2X
+Native ORC Vectorized 212 235 25 74.1 13.5 5.0X
================================================================================================
Int and String Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 2601 2642 57 4.0 248.1 1.0X
-Native ORC MR 2371 2376 7 4.4 226.1 1.1X
-Native ORC Vectorized 1270 1294 33 8.3 121.2 2.0X
+Hive built-in ORC 2233 2247 19 4.7 213.0 1.0X
+Native ORC MR 1941 1948 10 5.4 185.1 1.2X
+Native ORC Vectorized 1086 1104 26 9.7 103.6 2.1X
================================================================================================
Partitioned Table Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Data column - Hive built-in ORC 1584 1607 33 9.9 100.7 1.0X
-Data column - Native ORC MR 1502 1537 49 10.5 95.5 1.1X
-Data column - Native ORC Vectorized 268 280 12 58.7 17.0 5.9X
-Partition column - Hive built-in ORC 1209 1212 5 13.0 76.8 1.3X
-Partition column - Native ORC MR 1010 1018 12 15.6 64.2 1.6X
-Partition column - Native ORC Vectorized 52 59 12 301.1 3.3 30.3X
-Both columns - Hive built-in ORC 1712 1735 33 9.2 108.8 0.9X
-Both columns - Native ORC MR 1608 1704 136 9.8 102.2 1.0X
-Both columns - Native ORC Vectorized 303 314 14 51.9 19.3 5.2X
+Data column - Hive built-in ORC 1090 1115 35 14.4 69.3 1.0X
+Data column - Native ORC MR 1025 1048 32 15.3 65.2 1.1X
+Data column - Native ORC Vectorized 170 193 25 92.5 10.8 6.4X
+Partition column - Hive built-in ORC 803 842 40 19.6 51.0 1.4X
+Partition column - Native ORC MR 629 686 50 25.0 40.0 1.7X
+Partition column - Native ORC Vectorized 47 53 10 335.2 3.0 23.2X
+Both columns - Hive built-in ORC 1167 1180 18 13.5 74.2 0.9X
+Both columns - Native ORC MR 1028 1037 12 15.3 65.4 1.1X
+Both columns - Native ORC Vectorized 181 209 46 87.1 11.5 6.0X
================================================================================================
Repeated String Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1390 1396 9 7.5 132.5 1.0X
-Native ORC MR 1144 1155 16 9.2 109.1 1.2X
-Native ORC Vectorized 222 240 25 47.2 21.2 6.3X
+Hive built-in ORC 1071 1123 74 9.8 102.1 1.0X
+Native ORC MR 840 871 28 12.5 80.1 1.3X
+Native ORC Vectorized 163 175 9 64.3 15.6 6.6X
================================================================================================
String with Nulls Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 2446 2516 100 4.3 233.2 1.0X
-Native ORC MR 2004 2028 34 5.2 191.1 1.2X
-Native ORC Vectorized 556 577 30 18.9 53.0 4.4X
+Hive built-in ORC 2025 2059 48 5.2 193.1 1.0X
+Native ORC MR 1608 1614 7 6.5 153.4 1.3X
+Native ORC Vectorized 500 530 25 21.0 47.7 4.1X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 2207 2267 85 4.8 210.4 1.0X
-Native ORC MR 1942 1946 6 5.4 185.2 1.1X
-Native ORC Vectorized 733 747 14 14.3 69.9 3.0X
+Hive built-in ORC 1853 1862 12 5.7 176.7 1.0X
+Native ORC MR 1537 1563 37 6.8 146.6 1.2X
+Native ORC Vectorized 623 636 15 16.8 59.4 3.0X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1300 1317 24 8.1 124.0 1.0X
-Native ORC MR 1046 1049 3 10.0 99.8 1.2X
-Native ORC Vectorized 274 282 8 38.2 26.2 4.7X
+Hive built-in ORC 958 1005 48 10.9 91.3 1.0X
+Native ORC MR 753 773 27 13.9 71.8 1.3X
+Native ORC Vectorized 196 215 34 53.5 18.7 4.9X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1098 1300 285 1.0 1047.4 1.0X
-Native ORC MR 155 162 7 6.7 148.2 7.1X
-Native ORC Vectorized 89 96 9 11.8 84.7 12.4X
+Hive built-in ORC 847 924 85 1.2 807.6 1.0X
+Native ORC MR 115 134 23 9.1 109.5 7.4X
+Native ORC Vectorized 63 74 12 16.7 59.9 13.5X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 2004 2027 33 0.5 1910.7 1.0X
-Native ORC MR 202 235 24 5.2 192.4 9.9X
-Native ORC Vectorized 128 138 16 8.2 121.7 15.7X
+Hive built-in ORC 1625 1678 76 0.6 1549.4 1.0X
+Native ORC MR 144 162 18 7.3 137.0 11.3X
+Native ORC Vectorized 92 101 13 11.4 87.4 17.7X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3016 3041 36 0.3 2875.9 1.0X
-Native ORC MR 247 262 20 4.2 235.5 12.2X
-Native ORC Vectorized 181 201 24 5.8 172.2 16.7X
+Hive built-in ORC 2334 2353 26 0.4 2225.9 1.0X
+Native ORC MR 176 198 33 6.0 167.7 13.3X
+Native ORC Vectorized 128 146 17 8.2 122.2 18.2X
================================================================================================
Struct scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Struct Column Scan with 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 523 575 68 2.0 498.5 1.0X
-Native ORC MR 1477 1477 0 0.7 1408.2 0.4X
-Native ORC Vectorized 210 225 14 5.0 199.8 2.5X
+Hive built-in ORC 782 795 19 1.3 746.2 1.0X
+Native ORC MR 288 296 8 3.6 274.5 2.7X
+Native ORC Vectorized 154 163 11 6.8 146.8 5.1X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Struct Column Scan with 100 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3677 4179 709 0.3 3507.0 1.0X
-Native ORC MR 12584 12615 43 0.1 12001.3 0.3X
-Native ORC Vectorized 1867 1875 11 0.6 1780.9 2.0X
+Hive built-in ORC 5146 5164 25 0.2 4907.5 1.0X
+Native ORC MR 2403 2410 9 0.4 2292.1 2.1X
+Native ORC Vectorized 1333 1339 8 0.8 1271.3 3.9X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Struct Column Scan with 300 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 14307 15087 1103 0.1 13644.5 1.0X
-Native ORC MR 39693 41121 2020 0.0 37853.7 0.4X
-Native ORC Vectorized 39081 39252 243 0.0 37270.5 0.4X
+Hive built-in ORC 15968 17060 1545 0.1 15228.3 1.0X
+Native ORC MR 8321 8459 195 0.1 7935.3 1.9X
+Native ORC Vectorized 8055 8145 127 0.1 7682.2 2.0X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
-Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
+Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Single Struct Column Scan with 600 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 32291 36141 NaN 0.0 30795.2 1.0X
-Native ORC MR 94939 95045 149 0.0 90541.2 0.3X
-Native ORC Vectorized 93062 93335 386 0.0 88750.4 0.3X
+Hive built-in ORC 36374 37652 1808 0.0 34688.9 1.0X
+Native ORC MR 30738 31431 980 0.0 29313.9 1.2X
+Native ORC Vectorized 27877 28169 413 0.0 26585.4 1.3X
Review Comment:
This is the fixed result.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org