You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/03/22 01:59:30 UTC
[PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
dongjoon-hyun opened a new pull request, #45654:
URL: https://github.com/apache/spark/pull/45654
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://spark.apache.org/contributing.html
2. Ensure you have added or run the appropriate tests for your PR: https://spark.apache.org/developer-tools.html
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][SPARK-XXXX] Your PR title ...'.
4. Be sure to keep the PR description updated to reflect all changes.
5. Please write your PR title to summarize what this PR proposes.
6. If possible, provide a concise example to reproduce the issue for a faster review.
7. If you want to add a new configuration, please read the guideline first for naming configurations in
'core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala'.
8. If you want to add or modify an error type or message, please read the guideline first in
'common/utils/src/main/resources/error/README.md'.
-->
### What changes were proposed in this pull request?
<!--
Please clarify what changes you are proposing. The purpose of this section is to outline the changes and how this PR fixes the issue.
If possible, please consider writing useful notes for better and faster reviews in your PR. See the examples below.
1. If you refactor some codes with changing classes, showing the class hierarchy will help reviewers.
2. If you fix some SQL features, you can provide some references of other DBMSes.
3. If there is design documentation, please add the link.
4. If there is a discussion in the mailing list, please add the link.
-->
### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
1. If you propose a new API, clarify the use case for a new API.
2. If you fix a bug, you can clarify why it is a bug.
-->
### Does this PR introduce _any_ user-facing change?
<!--
Note that it means *any* user-facing change including all aspects such as the documentation fix.
If yes, please clarify the previous behavior and the change this PR proposes - provide the console output, description and/or an example to show the behavior difference if possible.
If possible, please also clarify if this is a user-facing change compared to the released Spark versions or within the unreleased branches such as master.
If no, write 'No'.
-->
### How was this patch tested?
<!--
If tests were added, say they were added here. Please make sure to add some test cases that check the changes thoroughly including negative and positive cases if possible.
If it was tested in a way different from regular unit tests, please clarify how you tested step by step, ideally copy and paste-able, so that other reviewers can test and check, and descendants can verify in the future.
If tests were not added, please describe why they were not added and/or why it was difficult to add.
If benchmark tests were added, please run the benchmarks in GitHub Actions for the consistent environment, and the instructions could accord to: https://spark.apache.org/developer-tools.html#github-workflow-benchmarks.
-->
### Was this patch authored or co-authored using generative AI tooling?
<!--
If generative AI tooling has been used in the process of authoring this patch, please include the
phrase: 'Generated-by: ' followed by the name of the tool and its version.
If no, write 'No'.
Please refer to the [ASF Generative Tooling Guidance](https://www.apache.org/legal/generative-tooling.html) for details.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534986983
##########
sql/core/benchmarks/BloomFilterBenchmark-jdk21-results.txt:
##########
@@ -2,191 +2,191 @@
ORC Write
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter 7394 7604 297 13.5 73.9 1.0X
-With bloom filter 9697 9733 51 10.3 97.0 0.8X
+Without bloom filter 7752 7991 337 12.9 77.5 1.0X
+With bloom filter 10081 10242 228 9.9 100.8 0.8X
================================================================================================
ORC Read
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter, blocksize: 2097152 869 901 52 115.1 8.7 1.0X
-With bloom filter, blocksize: 2097152 890 895 7 112.4 8.9 1.0X
+Without bloom filter, blocksize: 2097152 838 890 45 119.3 8.4 1.0X
+With bloom filter, blocksize: 2097152 579 596 17 172.8 5.8 1.4X
================================================================================================
ORC Read
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter, blocksize: 4194304 1272 1274 3 78.6 12.7 1.0X
-With bloom filter, blocksize: 4194304 868 881 13 115.1 8.7 1.5X
+Without bloom filter, blocksize: 4194304 824 848 22 121.3 8.2 1.0X
+With bloom filter, blocksize: 4194304 554 574 22 180.4 5.5 1.5X
================================================================================================
ORC Read
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter, blocksize: 6291456 1247 1252 6 80.2 12.5 1.0X
-With bloom filter, blocksize: 6291456 865 879 21 115.6 8.7 1.4X
+Without bloom filter, blocksize: 6291456 805 822 20 124.3 8.0 1.0X
+With bloom filter, blocksize: 6291456 527 582 72 189.9 5.3 1.5X
Review Comment:
ORC Read is improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534977214
##########
sql/hive/benchmarks/OrcReadBenchmark-jdk21-results.txt:
##########
@@ -2,221 +2,221 @@
SQL Single Numeric Column Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 640 693 75 24.6 40.7 1.0X
-Native ORC MR 719 733 24 21.9 45.7 0.9X
-Native ORC Vectorized 90 112 15 175.3 5.7 7.1X
+Hive built-in ORC 662 691 46 23.8 42.1 1.0X
+Native ORC MR 784 812 28 20.1 49.9 0.8X
+Native ORC Vectorized 92 120 35 171.5 5.8 7.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 633 698 79 24.9 40.2 1.0X
-Native ORC MR 726 757 32 21.7 46.1 0.9X
-Native ORC Vectorized 74 91 12 212.5 4.7 8.5X
+Hive built-in ORC 692 724 31 22.7 44.0 1.0X
+Native ORC MR 789 803 15 19.9 50.1 0.9X
+Native ORC Vectorized 73 94 17 214.7 4.7 9.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 732 737 5 21.5 46.5 1.0X
-Native ORC MR 832 872 38 18.9 52.9 0.9X
-Native ORC Vectorized 94 116 29 168.0 6.0 7.8X
+Hive built-in ORC 685 708 21 23.0 43.5 1.0X
+Native ORC MR 811 854 40 19.4 51.5 0.8X
+Native ORC Vectorized 79 94 18 199.8 5.0 8.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 763 778 18 20.6 48.5 1.0X
-Native ORC MR 844 858 14 18.6 53.7 0.9X
-Native ORC Vectorized 110 134 26 143.5 7.0 7.0X
+Hive built-in ORC 733 771 39 21.5 46.6 1.0X
+Native ORC MR 803 819 15 19.6 51.1 0.9X
+Native ORC Vectorized 113 128 16 138.8 7.2 6.5X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 852 871 16 18.5 54.2 1.0X
-Native ORC MR 848 853 4 18.6 53.9 1.0X
-Native ORC Vectorized 163 178 24 96.6 10.4 5.2X
+Hive built-in ORC 804 815 15 19.6 51.1 1.0X
+Native ORC MR 873 904 27 18.0 55.5 0.9X
+Native ORC Vectorized 138 169 29 114.2 8.8 5.8X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 860 885 27 18.3 54.7 1.0X
-Native ORC MR 948 968 31 16.6 60.3 0.9X
-Native ORC Vectorized 242 258 15 65.0 15.4 3.6X
+Hive built-in ORC 812 825 12 19.4 51.6 1.0X
+Native ORC MR 934 943 13 16.8 59.4 0.9X
+Native ORC Vectorized 188 213 24 83.6 12.0 4.3X
================================================================================================
Int and String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1814 1836 31 5.8 173.0 1.0X
-Native ORC MR 1573 1633 84 6.7 150.0 1.2X
-Native ORC Vectorized 763 775 10 13.7 72.8 2.4X
+Hive built-in ORC 1547 1557 15 6.8 147.5 1.0X
+Native ORC MR 1469 1478 13 7.1 140.1 1.1X
+Native ORC Vectorized 573 601 32 18.3 54.6 2.7X
================================================================================================
Partitioned Table Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Data column - Hive built-in ORC 1028 1035 9 15.3 65.4 1.0X
-Data column - Native ORC MR 1016 1023 10 15.5 64.6 1.0X
-Data column - Native ORC Vectorized 110 135 11 143.4 7.0 9.4X
-Partition column - Hive built-in ORC 665 677 19 23.7 42.3 1.5X
-Partition column - Native ORC MR 553 573 23 28.4 35.2 1.9X
-Partition column - Native ORC Vectorized 32 43 8 491.4 2.0 32.1X
-Both columns - Hive built-in ORC 919 939 33 17.1 58.4 1.1X
-Both columns - Native ORC MR 1032 1040 12 15.2 65.6 1.0X
-Both columns - Native ORC Vectorized 121 144 21 129.8 7.7 8.5X
+Data column - Hive built-in ORC 827 859 48 19.0 52.6 1.0X
+Data column - Native ORC MR 977 1025 77 16.1 62.1 0.8X
+Data column - Native ORC Vectorized 109 124 15 144.3 6.9 7.6X
+Partition column - Hive built-in ORC 702 715 12 22.4 44.6 1.2X
+Partition column - Native ORC MR 556 562 9 28.3 35.3 1.5X
+Partition column - Native ORC Vectorized 31 41 8 510.7 2.0 26.8X
+Both columns - Hive built-in ORC 888 933 40 17.7 56.5 0.9X
+Both columns - Native ORC MR 1076 1083 10 14.6 68.4 0.8X
+Both columns - Native ORC Vectorized 126 144 17 125.3 8.0 6.6X
================================================================================================
Repeated String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 873 890 21 12.0 83.3 1.0X
-Native ORC MR 789 858 75 13.3 75.3 1.1X
-Native ORC Vectorized 121 134 16 86.8 11.5 7.2X
+Hive built-in ORC 832 886 48 12.6 79.3 1.0X
+Native ORC MR 821 825 6 12.8 78.3 1.0X
+Native ORC Vectorized 173 189 14 60.7 16.5 4.8X
================================================================================================
String with Nulls Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1723 1732 13 6.1 164.3 1.0X
-Native ORC MR 1311 1327 23 8.0 125.0 1.3X
-Native ORC Vectorized 370 377 6 28.4 35.3 4.7X
+Hive built-in ORC 1421 1433 16 7.4 135.6 1.0X
+Native ORC MR 1205 1215 14 8.7 114.9 1.2X
+Native ORC Vectorized 285 314 29 36.8 27.2 5.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1297 1327 43 8.1 123.7 1.0X
-Native ORC MR 1145 1156 15 9.2 109.2 1.1X
-Native ORC Vectorized 391 419 19 26.8 37.3 3.3X
+Hive built-in ORC 1261 1273 17 8.3 120.3 1.0X
+Native ORC MR 1121 1131 14 9.4 106.9 1.1X
+Native ORC Vectorized 341 357 13 30.8 32.5 3.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 741 766 21 14.1 70.7 1.0X
-Native ORC MR 743 751 8 14.1 70.9 1.0X
-Native ORC Vectorized 154 175 20 67.9 14.7 4.8X
+Hive built-in ORC 840 842 2 12.5 80.1 1.0X
+Native ORC MR 750 751 1 14.0 71.5 1.1X
+Native ORC Vectorized 144 160 9 72.7 13.8 5.8X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 571 611 43 1.8 544.5 1.0X
-Native ORC MR 91 102 8 11.5 86.8 6.3X
-Native ORC Vectorized 39 48 6 27.0 37.0 14.7X
+Hive built-in ORC 669 688 23 1.6 638.3 1.0X
+Native ORC MR 85 100 13 12.3 81.4 7.8X
+Native ORC Vectorized 36 46 9 29.3 34.1 18.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1066 1076 15 1.0 1016.6 1.0X
-Native ORC MR 102 114 9 10.3 96.9 10.5X
-Native ORC Vectorized 50 63 8 21.0 47.7 21.3X
+Hive built-in ORC 1221 1230 13 0.9 1164.4 1.0X
+Native ORC MR 100 111 12 10.5 95.7 12.2X
+Native ORC Vectorized 50 68 11 20.9 47.8 24.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1532 1562 42 0.7 1461.1 1.0X
-Native ORC MR 114 124 7 9.2 109.0 13.4X
-Native ORC Vectorized 62 72 9 17.0 59.0 24.8X
+Hive built-in ORC 1834 1884 70 0.6 1749.1 1.0X
+Native ORC MR 112 135 23 9.3 107.2 16.3X
+Native ORC Vectorized 61 70 8 17.3 58.0 30.2X
================================================================================================
Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 447 499 32 2.3 425.8 1.0X
-Native ORC MR 224 267 41 4.7 213.7 2.0X
-Native ORC Vectorized 99 115 21 10.6 94.5 4.5X
+Hive built-in ORC 279 338 41 3.8 266.0 1.0X
+Native ORC MR 220 268 44 4.8 209.8 1.3X
+Native ORC Vectorized 97 115 18 10.8 92.5 2.9X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 100 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3468 3546 110 0.3 3307.7 1.0X
-Native ORC MR 1623 1655 47 0.6 1547.4 2.1X
-Native ORC Vectorized 795 868 85 1.3 757.8 4.4X
+Hive built-in ORC 1869 1890 29 0.6 1782.7 1.0X
+Native ORC MR 1684 1729 64 0.6 1606.4 1.1X
+Native ORC Vectorized 869 913 56 1.2 828.5 2.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 300 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9046 9092 66 0.1 8626.7 1.0X
-Native ORC MR 6233 6397 232 0.2 5944.5 1.5X
-Native ORC Vectorized 5378 5407 41 0.2 5129.1 1.7X
+Hive built-in ORC 5329 5433 148 0.2 5082.1 1.0X
+Native ORC MR 5514 5545 43 0.2 5259.0 1.0X
+Native ORC Vectorized 5450 5502 74 0.2 5197.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 600 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 22437 22692 361 0.0 21397.7 1.0X
-Native ORC MR 12624 12694 99 0.1 12039.1 1.8X
-Native ORC Vectorized 12680 12860 255 0.1 12092.1 1.8X
+Hive built-in ORC 11352 11377 36 0.1 10826.0 1.0X
+Native ORC MR 12781 12796 22 0.1 12188.7 0.9X
+Native ORC Vectorized 12673 12779 151 0.1 12085.7 0.9X
================================================================================================
Nested Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3599 3644 64 0.3 3432.4 1.0X
-Native ORC MR 1912 1953 58 0.5 1823.8 1.9X
-Native ORC Vectorized 603 629 35 1.7 574.7 6.0X
+Hive built-in ORC 1793 1818 36 0.6 1710.3 1.0X
+Native ORC MR 2053 2069 22 0.5 1958.2 0.9X
+Native ORC Vectorized 539 569 37 1.9 513.7 3.3X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 30 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9213 9334 171 0.1 8786.1 1.0X
-Native ORC MR 4514 4529 20 0.2 4305.0 2.0X
-Native ORC Vectorized 1521 1550 41 0.7 1450.8 6.1X
+Hive built-in ORC 4477 4533 78 0.2 4270.0 1.0X
+Native ORC MR 4467 4484 25 0.2 4259.6 1.0X
+Native ORC Vectorized 1470 1490 29 0.7 1402.0 3.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 30 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9739 9740 2 0.1 9287.4 1.0X
-Native ORC MR 5553 5613 84 0.2 5296.0 1.8X
-Native ORC Vectorized 2090 2108 26 0.5 1993.1 4.7X
+Hive built-in ORC 4417 4430 19 0.2 4212.1 1.0X
+Native ORC MR 5039 5069 42 0.2 4805.9 0.9X
+Native ORC Vectorized 1726 1737 16 0.6 1645.8 2.6X
Review Comment:
Impressive!
Will the related PR be marked release highlight? And does it mean that SPARK-44677 should be planned later?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534988182
##########
sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk21-results.txt:
##########
@@ -2,69 +2,69 @@
Parquet writer benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Parquet(PARQUET_1_0) writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Output Single Int Column 1677 1729 73 9.4 106.6 1.0X
-Output Single Double Column 1879 1895 22 8.4 119.4 0.9X
-Output Int and String Column 4135 4144 13 3.8 262.9 0.4X
-Output Partitions 3027 3042 21 5.2 192.4 0.6X
-Output Buckets 4258 4265 11 3.7 270.7 0.4X
+Output Single Int Column 1744 1797 75 9.0 110.9 1.0X
+Output Single Double Column 1753 1775 31 9.0 111.4 1.0X
+Output Int and String Column 4384 4389 8 3.6 278.7 0.4X
+Output Partitions 2948 3021 103 5.3 187.4 0.6X
+Output Buckets 4110 4219 154 3.8 261.3 0.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Parquet(PARQUET_2_0) writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Output Single Int Column 1770 1797 38 8.9 112.5 1.0X
-Output Single Double Column 1673 1703 43 9.4 106.3 1.1X
-Output Int and String Column 4330 4337 10 3.6 275.3 0.4X
-Output Partitions 3129 3133 6 5.0 198.9 0.6X
-Output Buckets 4160 4192 46 3.8 264.5 0.4X
+Output Single Int Column 1605 1640 50 9.8 102.0 1.0X
+Output Single Double Column 1709 1726 25 9.2 108.6 0.9X
+Output Int and String Column 4570 4587 24 3.4 290.5 0.4X
+Output Partitions 2943 2960 23 5.3 187.1 0.5X
+Output Buckets 3816 3851 50 4.1 242.6 0.4X
================================================================================================
ORC writer benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
Review Comment:
ORC write is improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534986983
##########
sql/core/benchmarks/BloomFilterBenchmark-jdk21-results.txt:
##########
@@ -2,191 +2,191 @@
ORC Write
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter 7394 7604 297 13.5 73.9 1.0X
-With bloom filter 9697 9733 51 10.3 97.0 0.8X
+Without bloom filter 7752 7991 337 12.9 77.5 1.0X
+With bloom filter 10081 10242 228 9.9 100.8 0.8X
================================================================================================
ORC Read
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter, blocksize: 2097152 869 901 52 115.1 8.7 1.0X
-With bloom filter, blocksize: 2097152 890 895 7 112.4 8.9 1.0X
+Without bloom filter, blocksize: 2097152 838 890 45 119.3 8.4 1.0X
+With bloom filter, blocksize: 2097152 579 596 17 172.8 5.8 1.4X
================================================================================================
ORC Read
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter, blocksize: 4194304 1272 1274 3 78.6 12.7 1.0X
-With bloom filter, blocksize: 4194304 868 881 13 115.1 8.7 1.5X
+Without bloom filter, blocksize: 4194304 824 848 22 121.3 8.2 1.0X
+With bloom filter, blocksize: 4194304 554 574 22 180.4 5.5 1.5X
================================================================================================
ORC Read
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Without bloom filter, blocksize: 6291456 1247 1252 6 80.2 12.5 1.0X
-With bloom filter, blocksize: 6291456 865 879 21 115.6 8.7 1.4X
+Without bloom filter, blocksize: 6291456 805 822 20 124.3 8.0 1.0X
+With bloom filter, blocksize: 6291456 527 582 72 189.9 5.3 1.5X
Review Comment:
ORC Read with BloomFilter is improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534982287
##########
sql/hive/benchmarks/OrcReadBenchmark-jdk21-results.txt:
##########
@@ -2,221 +2,221 @@
SQL Single Numeric Column Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 640 693 75 24.6 40.7 1.0X
-Native ORC MR 719 733 24 21.9 45.7 0.9X
-Native ORC Vectorized 90 112 15 175.3 5.7 7.1X
+Hive built-in ORC 662 691 46 23.8 42.1 1.0X
+Native ORC MR 784 812 28 20.1 49.9 0.8X
+Native ORC Vectorized 92 120 35 171.5 5.8 7.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 633 698 79 24.9 40.2 1.0X
-Native ORC MR 726 757 32 21.7 46.1 0.9X
-Native ORC Vectorized 74 91 12 212.5 4.7 8.5X
+Hive built-in ORC 692 724 31 22.7 44.0 1.0X
+Native ORC MR 789 803 15 19.9 50.1 0.9X
+Native ORC Vectorized 73 94 17 214.7 4.7 9.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 732 737 5 21.5 46.5 1.0X
-Native ORC MR 832 872 38 18.9 52.9 0.9X
-Native ORC Vectorized 94 116 29 168.0 6.0 7.8X
+Hive built-in ORC 685 708 21 23.0 43.5 1.0X
+Native ORC MR 811 854 40 19.4 51.5 0.8X
+Native ORC Vectorized 79 94 18 199.8 5.0 8.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 763 778 18 20.6 48.5 1.0X
-Native ORC MR 844 858 14 18.6 53.7 0.9X
-Native ORC Vectorized 110 134 26 143.5 7.0 7.0X
+Hive built-in ORC 733 771 39 21.5 46.6 1.0X
+Native ORC MR 803 819 15 19.6 51.1 0.9X
+Native ORC Vectorized 113 128 16 138.8 7.2 6.5X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 852 871 16 18.5 54.2 1.0X
-Native ORC MR 848 853 4 18.6 53.9 1.0X
-Native ORC Vectorized 163 178 24 96.6 10.4 5.2X
+Hive built-in ORC 804 815 15 19.6 51.1 1.0X
+Native ORC MR 873 904 27 18.0 55.5 0.9X
+Native ORC Vectorized 138 169 29 114.2 8.8 5.8X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 860 885 27 18.3 54.7 1.0X
-Native ORC MR 948 968 31 16.6 60.3 0.9X
-Native ORC Vectorized 242 258 15 65.0 15.4 3.6X
+Hive built-in ORC 812 825 12 19.4 51.6 1.0X
+Native ORC MR 934 943 13 16.8 59.4 0.9X
+Native ORC Vectorized 188 213 24 83.6 12.0 4.3X
================================================================================================
Int and String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1814 1836 31 5.8 173.0 1.0X
-Native ORC MR 1573 1633 84 6.7 150.0 1.2X
-Native ORC Vectorized 763 775 10 13.7 72.8 2.4X
+Hive built-in ORC 1547 1557 15 6.8 147.5 1.0X
+Native ORC MR 1469 1478 13 7.1 140.1 1.1X
+Native ORC Vectorized 573 601 32 18.3 54.6 2.7X
================================================================================================
Partitioned Table Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Data column - Hive built-in ORC 1028 1035 9 15.3 65.4 1.0X
-Data column - Native ORC MR 1016 1023 10 15.5 64.6 1.0X
-Data column - Native ORC Vectorized 110 135 11 143.4 7.0 9.4X
-Partition column - Hive built-in ORC 665 677 19 23.7 42.3 1.5X
-Partition column - Native ORC MR 553 573 23 28.4 35.2 1.9X
-Partition column - Native ORC Vectorized 32 43 8 491.4 2.0 32.1X
-Both columns - Hive built-in ORC 919 939 33 17.1 58.4 1.1X
-Both columns - Native ORC MR 1032 1040 12 15.2 65.6 1.0X
-Both columns - Native ORC Vectorized 121 144 21 129.8 7.7 8.5X
+Data column - Hive built-in ORC 827 859 48 19.0 52.6 1.0X
+Data column - Native ORC MR 977 1025 77 16.1 62.1 0.8X
+Data column - Native ORC Vectorized 109 124 15 144.3 6.9 7.6X
+Partition column - Hive built-in ORC 702 715 12 22.4 44.6 1.2X
+Partition column - Native ORC MR 556 562 9 28.3 35.3 1.5X
+Partition column - Native ORC Vectorized 31 41 8 510.7 2.0 26.8X
+Both columns - Hive built-in ORC 888 933 40 17.7 56.5 0.9X
+Both columns - Native ORC MR 1076 1083 10 14.6 68.4 0.8X
+Both columns - Native ORC Vectorized 126 144 17 125.3 8.0 6.6X
================================================================================================
Repeated String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 873 890 21 12.0 83.3 1.0X
-Native ORC MR 789 858 75 13.3 75.3 1.1X
-Native ORC Vectorized 121 134 16 86.8 11.5 7.2X
+Hive built-in ORC 832 886 48 12.6 79.3 1.0X
+Native ORC MR 821 825 6 12.8 78.3 1.0X
+Native ORC Vectorized 173 189 14 60.7 16.5 4.8X
================================================================================================
String with Nulls Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1723 1732 13 6.1 164.3 1.0X
-Native ORC MR 1311 1327 23 8.0 125.0 1.3X
-Native ORC Vectorized 370 377 6 28.4 35.3 4.7X
+Hive built-in ORC 1421 1433 16 7.4 135.6 1.0X
+Native ORC MR 1205 1215 14 8.7 114.9 1.2X
+Native ORC Vectorized 285 314 29 36.8 27.2 5.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1297 1327 43 8.1 123.7 1.0X
-Native ORC MR 1145 1156 15 9.2 109.2 1.1X
-Native ORC Vectorized 391 419 19 26.8 37.3 3.3X
+Hive built-in ORC 1261 1273 17 8.3 120.3 1.0X
+Native ORC MR 1121 1131 14 9.4 106.9 1.1X
+Native ORC Vectorized 341 357 13 30.8 32.5 3.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 741 766 21 14.1 70.7 1.0X
-Native ORC MR 743 751 8 14.1 70.9 1.0X
-Native ORC Vectorized 154 175 20 67.9 14.7 4.8X
+Hive built-in ORC 840 842 2 12.5 80.1 1.0X
+Native ORC MR 750 751 1 14.0 71.5 1.1X
+Native ORC Vectorized 144 160 9 72.7 13.8 5.8X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 571 611 43 1.8 544.5 1.0X
-Native ORC MR 91 102 8 11.5 86.8 6.3X
-Native ORC Vectorized 39 48 6 27.0 37.0 14.7X
+Hive built-in ORC 669 688 23 1.6 638.3 1.0X
+Native ORC MR 85 100 13 12.3 81.4 7.8X
+Native ORC Vectorized 36 46 9 29.3 34.1 18.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1066 1076 15 1.0 1016.6 1.0X
-Native ORC MR 102 114 9 10.3 96.9 10.5X
-Native ORC Vectorized 50 63 8 21.0 47.7 21.3X
+Hive built-in ORC 1221 1230 13 0.9 1164.4 1.0X
+Native ORC MR 100 111 12 10.5 95.7 12.2X
+Native ORC Vectorized 50 68 11 20.9 47.8 24.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1532 1562 42 0.7 1461.1 1.0X
-Native ORC MR 114 124 7 9.2 109.0 13.4X
-Native ORC Vectorized 62 72 9 17.0 59.0 24.8X
+Hive built-in ORC 1834 1884 70 0.6 1749.1 1.0X
+Native ORC MR 112 135 23 9.3 107.2 16.3X
+Native ORC Vectorized 61 70 8 17.3 58.0 30.2X
================================================================================================
Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 447 499 32 2.3 425.8 1.0X
-Native ORC MR 224 267 41 4.7 213.7 2.0X
-Native ORC Vectorized 99 115 21 10.6 94.5 4.5X
+Hive built-in ORC 279 338 41 3.8 266.0 1.0X
+Native ORC MR 220 268 44 4.8 209.8 1.3X
+Native ORC Vectorized 97 115 18 10.8 92.5 2.9X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 100 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3468 3546 110 0.3 3307.7 1.0X
-Native ORC MR 1623 1655 47 0.6 1547.4 2.1X
-Native ORC Vectorized 795 868 85 1.3 757.8 4.4X
+Hive built-in ORC 1869 1890 29 0.6 1782.7 1.0X
+Native ORC MR 1684 1729 64 0.6 1606.4 1.1X
+Native ORC Vectorized 869 913 56 1.2 828.5 2.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 300 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9046 9092 66 0.1 8626.7 1.0X
-Native ORC MR 6233 6397 232 0.2 5944.5 1.5X
-Native ORC Vectorized 5378 5407 41 0.2 5129.1 1.7X
+Hive built-in ORC 5329 5433 148 0.2 5082.1 1.0X
+Native ORC MR 5514 5545 43 0.2 5259.0 1.0X
+Native ORC Vectorized 5450 5502 74 0.2 5197.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 600 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 22437 22692 361 0.0 21397.7 1.0X
-Native ORC MR 12624 12694 99 0.1 12039.1 1.8X
-Native ORC Vectorized 12680 12860 255 0.1 12092.1 1.8X
+Hive built-in ORC 11352 11377 36 0.1 10826.0 1.0X
+Native ORC MR 12781 12796 22 0.1 12188.7 0.9X
+Native ORC Vectorized 12673 12779 151 0.1 12085.7 0.9X
================================================================================================
Nested Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3599 3644 64 0.3 3432.4 1.0X
-Native ORC MR 1912 1953 58 0.5 1823.8 1.9X
-Native ORC Vectorized 603 629 35 1.7 574.7 6.0X
+Hive built-in ORC 1793 1818 36 0.6 1710.3 1.0X
+Native ORC MR 2053 2069 22 0.5 1958.2 0.9X
+Native ORC Vectorized 539 569 37 1.9 513.7 3.3X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 30 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9213 9334 171 0.1 8786.1 1.0X
-Native ORC MR 4514 4529 20 0.2 4305.0 2.0X
-Native ORC Vectorized 1521 1550 41 0.7 1450.8 6.1X
+Hive built-in ORC 4477 4533 78 0.2 4270.0 1.0X
+Native ORC MR 4467 4484 25 0.2 4259.6 1.0X
+Native ORC Vectorized 1470 1490 29 0.7 1402.0 3.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 30 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9739 9740 2 0.1 9287.4 1.0X
-Native ORC MR 5553 5613 84 0.2 5296.0 1.8X
-Native ORC Vectorized 2090 2108 26 0.5 1993.1 4.7X
+Hive built-in ORC 4417 4430 19 0.2 4212.1 1.0X
+Native ORC MR 5039 5069 42 0.2 4805.9 0.9X
+Native ORC Vectorized 1726 1737 16 0.6 1645.8 2.6X
Review Comment:
It's too early to say any improvement. I hope there is no regression until Apache Spark 4.0.0 release. :)
For SPARK-44677, I believe SPARK-44444 would be the precondition. For now, we didn't make any official agreement yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534999660
##########
sql/core/benchmarks/FilterPushdownBenchmark-jdk21-results.txt:
##########
@@ -2,733 +2,733 @@
Pushdown for many distinct value case
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6598 6767 128 2.4 419.5 1.0X
-Parquet Vectorized (Pushdown) 292 304 14 53.8 18.6 22.6X
-Native ORC Vectorized 7341 7411 88 2.1 466.7 0.9X
-Native ORC Vectorized (Pushdown) 282 291 10 55.7 18.0 23.4X
+Parquet Vectorized 6365 6420 67 2.5 404.7 1.0X
+Parquet Vectorized (Pushdown) 315 341 24 49.9 20.0 20.2X
+Native ORC Vectorized 4984 5073 69 3.2 316.9 1.3X
+Native ORC Vectorized (Pushdown) 311 321 11 50.5 19.8 20.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6631 6653 20 2.4 421.6 1.0X
-Parquet Vectorized (Pushdown) 288 299 15 54.7 18.3 23.1X
-Native ORC Vectorized 7453 7468 19 2.1 473.8 0.9X
-Native ORC Vectorized (Pushdown) 280 287 9 56.2 17.8 23.7X
+Parquet Vectorized 6261 6292 25 2.5 398.1 1.0X
+Parquet Vectorized (Pushdown) 281 298 12 56.1 17.8 22.3X
+Native ORC Vectorized 5053 5078 22 3.1 321.3 1.2X
+Native ORC Vectorized (Pushdown) 300 328 35 52.4 19.1 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6635 6654 17 2.4 421.9 1.0X
-Parquet Vectorized (Pushdown) 271 282 9 58.1 17.2 24.5X
-Native ORC Vectorized 7482 7512 35 2.1 475.7 0.9X
-Native ORC Vectorized (Pushdown) 268 277 4 58.6 17.1 24.7X
+Parquet Vectorized 6294 6356 90 2.5 400.1 1.0X
+Parquet Vectorized (Pushdown) 270 283 14 58.3 17.1 23.3X
+Native ORC Vectorized 5057 5086 20 3.1 321.5 1.2X
+Native ORC Vectorized (Pushdown) 289 298 8 54.4 18.4 21.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6622 6633 10 2.4 421.0 1.0X
-Parquet Vectorized (Pushdown) 262 270 9 60.1 16.6 25.3X
-Native ORC Vectorized 7413 7429 15 2.1 471.3 0.9X
-Native ORC Vectorized (Pushdown) 261 268 6 60.3 16.6 25.4X
+Parquet Vectorized 6252 6274 17 2.5 397.5 1.0X
+Parquet Vectorized (Pushdown) 256 272 15 61.4 16.3 24.4X
+Native ORC Vectorized 5036 5054 12 3.1 320.2 1.2X
+Native ORC Vectorized (Pushdown) 275 291 8 57.1 17.5 22.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6597 6632 34 2.4 419.4 1.0X
-Parquet Vectorized (Pushdown) 260 268 7 60.5 16.5 25.4X
-Native ORC Vectorized 7453 7467 11 2.1 473.9 0.9X
-Native ORC Vectorized (Pushdown) 261 270 7 60.3 16.6 25.3X
+Parquet Vectorized 6241 6259 11 2.5 396.8 1.0X
+Parquet Vectorized (Pushdown) 257 266 12 61.3 16.3 24.3X
+Native ORC Vectorized 5038 5055 20 3.1 320.3 1.2X
+Native ORC Vectorized (Pushdown) 277 290 10 56.8 17.6 22.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 12805 12872 92 1.2 814.1 1.0X
-Parquet Vectorized (Pushdown) 12833 12851 14 1.2 815.9 1.0X
-Native ORC Vectorized 13594 13615 16 1.2 864.3 0.9X
-Native ORC Vectorized (Pushdown) 13626 13637 11 1.2 866.3 0.9X
+Parquet Vectorized 12335 12564 207 1.3 784.2 1.0X
+Parquet Vectorized (Pushdown) 12561 12587 20 1.3 798.6 1.0X
+Native ORC Vectorized 11278 11295 12 1.4 717.0 1.1X
+Native ORC Vectorized (Pushdown) 11398 11468 98 1.4 724.7 1.1X
Review Comment:
Although the ratio is reversed slightly, the different is too small.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534987046
##########
sql/hive/benchmarks/OrcReadBenchmark-jdk21-results.txt:
##########
@@ -2,221 +2,221 @@
SQL Single Numeric Column Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 640 693 75 24.6 40.7 1.0X
-Native ORC MR 719 733 24 21.9 45.7 0.9X
-Native ORC Vectorized 90 112 15 175.3 5.7 7.1X
+Hive built-in ORC 662 691 46 23.8 42.1 1.0X
+Native ORC MR 784 812 28 20.1 49.9 0.8X
+Native ORC Vectorized 92 120 35 171.5 5.8 7.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 633 698 79 24.9 40.2 1.0X
-Native ORC MR 726 757 32 21.7 46.1 0.9X
-Native ORC Vectorized 74 91 12 212.5 4.7 8.5X
+Hive built-in ORC 692 724 31 22.7 44.0 1.0X
+Native ORC MR 789 803 15 19.9 50.1 0.9X
+Native ORC Vectorized 73 94 17 214.7 4.7 9.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 732 737 5 21.5 46.5 1.0X
-Native ORC MR 832 872 38 18.9 52.9 0.9X
-Native ORC Vectorized 94 116 29 168.0 6.0 7.8X
+Hive built-in ORC 685 708 21 23.0 43.5 1.0X
+Native ORC MR 811 854 40 19.4 51.5 0.8X
+Native ORC Vectorized 79 94 18 199.8 5.0 8.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 763 778 18 20.6 48.5 1.0X
-Native ORC MR 844 858 14 18.6 53.7 0.9X
-Native ORC Vectorized 110 134 26 143.5 7.0 7.0X
+Hive built-in ORC 733 771 39 21.5 46.6 1.0X
+Native ORC MR 803 819 15 19.6 51.1 0.9X
+Native ORC Vectorized 113 128 16 138.8 7.2 6.5X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 852 871 16 18.5 54.2 1.0X
-Native ORC MR 848 853 4 18.6 53.9 1.0X
-Native ORC Vectorized 163 178 24 96.6 10.4 5.2X
+Hive built-in ORC 804 815 15 19.6 51.1 1.0X
+Native ORC MR 873 904 27 18.0 55.5 0.9X
+Native ORC Vectorized 138 169 29 114.2 8.8 5.8X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 860 885 27 18.3 54.7 1.0X
-Native ORC MR 948 968 31 16.6 60.3 0.9X
-Native ORC Vectorized 242 258 15 65.0 15.4 3.6X
+Hive built-in ORC 812 825 12 19.4 51.6 1.0X
+Native ORC MR 934 943 13 16.8 59.4 0.9X
+Native ORC Vectorized 188 213 24 83.6 12.0 4.3X
================================================================================================
Int and String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1814 1836 31 5.8 173.0 1.0X
-Native ORC MR 1573 1633 84 6.7 150.0 1.2X
-Native ORC Vectorized 763 775 10 13.7 72.8 2.4X
+Hive built-in ORC 1547 1557 15 6.8 147.5 1.0X
+Native ORC MR 1469 1478 13 7.1 140.1 1.1X
+Native ORC Vectorized 573 601 32 18.3 54.6 2.7X
================================================================================================
Partitioned Table Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Data column - Hive built-in ORC 1028 1035 9 15.3 65.4 1.0X
-Data column - Native ORC MR 1016 1023 10 15.5 64.6 1.0X
-Data column - Native ORC Vectorized 110 135 11 143.4 7.0 9.4X
-Partition column - Hive built-in ORC 665 677 19 23.7 42.3 1.5X
-Partition column - Native ORC MR 553 573 23 28.4 35.2 1.9X
-Partition column - Native ORC Vectorized 32 43 8 491.4 2.0 32.1X
-Both columns - Hive built-in ORC 919 939 33 17.1 58.4 1.1X
-Both columns - Native ORC MR 1032 1040 12 15.2 65.6 1.0X
-Both columns - Native ORC Vectorized 121 144 21 129.8 7.7 8.5X
+Data column - Hive built-in ORC 827 859 48 19.0 52.6 1.0X
+Data column - Native ORC MR 977 1025 77 16.1 62.1 0.8X
+Data column - Native ORC Vectorized 109 124 15 144.3 6.9 7.6X
+Partition column - Hive built-in ORC 702 715 12 22.4 44.6 1.2X
+Partition column - Native ORC MR 556 562 9 28.3 35.3 1.5X
+Partition column - Native ORC Vectorized 31 41 8 510.7 2.0 26.8X
+Both columns - Hive built-in ORC 888 933 40 17.7 56.5 0.9X
+Both columns - Native ORC MR 1076 1083 10 14.6 68.4 0.8X
+Both columns - Native ORC Vectorized 126 144 17 125.3 8.0 6.6X
================================================================================================
Repeated String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 873 890 21 12.0 83.3 1.0X
-Native ORC MR 789 858 75 13.3 75.3 1.1X
-Native ORC Vectorized 121 134 16 86.8 11.5 7.2X
+Hive built-in ORC 832 886 48 12.6 79.3 1.0X
+Native ORC MR 821 825 6 12.8 78.3 1.0X
+Native ORC Vectorized 173 189 14 60.7 16.5 4.8X
================================================================================================
String with Nulls Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1723 1732 13 6.1 164.3 1.0X
-Native ORC MR 1311 1327 23 8.0 125.0 1.3X
-Native ORC Vectorized 370 377 6 28.4 35.3 4.7X
+Hive built-in ORC 1421 1433 16 7.4 135.6 1.0X
+Native ORC MR 1205 1215 14 8.7 114.9 1.2X
+Native ORC Vectorized 285 314 29 36.8 27.2 5.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1297 1327 43 8.1 123.7 1.0X
-Native ORC MR 1145 1156 15 9.2 109.2 1.1X
-Native ORC Vectorized 391 419 19 26.8 37.3 3.3X
+Hive built-in ORC 1261 1273 17 8.3 120.3 1.0X
+Native ORC MR 1121 1131 14 9.4 106.9 1.1X
+Native ORC Vectorized 341 357 13 30.8 32.5 3.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 741 766 21 14.1 70.7 1.0X
-Native ORC MR 743 751 8 14.1 70.9 1.0X
-Native ORC Vectorized 154 175 20 67.9 14.7 4.8X
+Hive built-in ORC 840 842 2 12.5 80.1 1.0X
+Native ORC MR 750 751 1 14.0 71.5 1.1X
+Native ORC Vectorized 144 160 9 72.7 13.8 5.8X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 571 611 43 1.8 544.5 1.0X
-Native ORC MR 91 102 8 11.5 86.8 6.3X
-Native ORC Vectorized 39 48 6 27.0 37.0 14.7X
+Hive built-in ORC 669 688 23 1.6 638.3 1.0X
+Native ORC MR 85 100 13 12.3 81.4 7.8X
+Native ORC Vectorized 36 46 9 29.3 34.1 18.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1066 1076 15 1.0 1016.6 1.0X
-Native ORC MR 102 114 9 10.3 96.9 10.5X
-Native ORC Vectorized 50 63 8 21.0 47.7 21.3X
+Hive built-in ORC 1221 1230 13 0.9 1164.4 1.0X
+Native ORC MR 100 111 12 10.5 95.7 12.2X
+Native ORC Vectorized 50 68 11 20.9 47.8 24.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1532 1562 42 0.7 1461.1 1.0X
-Native ORC MR 114 124 7 9.2 109.0 13.4X
-Native ORC Vectorized 62 72 9 17.0 59.0 24.8X
+Hive built-in ORC 1834 1884 70 0.6 1749.1 1.0X
+Native ORC MR 112 135 23 9.3 107.2 16.3X
+Native ORC Vectorized 61 70 8 17.3 58.0 30.2X
================================================================================================
Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 447 499 32 2.3 425.8 1.0X
-Native ORC MR 224 267 41 4.7 213.7 2.0X
-Native ORC Vectorized 99 115 21 10.6 94.5 4.5X
+Hive built-in ORC 279 338 41 3.8 266.0 1.0X
+Native ORC MR 220 268 44 4.8 209.8 1.3X
+Native ORC Vectorized 97 115 18 10.8 92.5 2.9X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 100 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3468 3546 110 0.3 3307.7 1.0X
-Native ORC MR 1623 1655 47 0.6 1547.4 2.1X
-Native ORC Vectorized 795 868 85 1.3 757.8 4.4X
+Hive built-in ORC 1869 1890 29 0.6 1782.7 1.0X
+Native ORC MR 1684 1729 64 0.6 1606.4 1.1X
+Native ORC Vectorized 869 913 56 1.2 828.5 2.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 300 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9046 9092 66 0.1 8626.7 1.0X
-Native ORC MR 6233 6397 232 0.2 5944.5 1.5X
-Native ORC Vectorized 5378 5407 41 0.2 5129.1 1.7X
+Hive built-in ORC 5329 5433 148 0.2 5082.1 1.0X
+Native ORC MR 5514 5545 43 0.2 5259.0 1.0X
+Native ORC Vectorized 5450 5502 74 0.2 5197.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 600 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 22437 22692 361 0.0 21397.7 1.0X
-Native ORC MR 12624 12694 99 0.1 12039.1 1.8X
-Native ORC Vectorized 12680 12860 255 0.1 12092.1 1.8X
+Hive built-in ORC 11352 11377 36 0.1 10826.0 1.0X
+Native ORC MR 12781 12796 22 0.1 12188.7 0.9X
+Native ORC Vectorized 12673 12779 151 0.1 12085.7 0.9X
================================================================================================
Nested Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3599 3644 64 0.3 3432.4 1.0X
-Native ORC MR 1912 1953 58 0.5 1823.8 1.9X
-Native ORC Vectorized 603 629 35 1.7 574.7 6.0X
+Hive built-in ORC 1793 1818 36 0.6 1710.3 1.0X
+Native ORC MR 2053 2069 22 0.5 1958.2 0.9X
+Native ORC Vectorized 539 569 37 1.9 513.7 3.3X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 30 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9213 9334 171 0.1 8786.1 1.0X
-Native ORC MR 4514 4529 20 0.2 4305.0 2.0X
-Native ORC Vectorized 1521 1550 41 0.7 1450.8 6.1X
+Hive built-in ORC 4477 4533 78 0.2 4270.0 1.0X
+Native ORC MR 4467 4484 25 0.2 4259.6 1.0X
+Native ORC Vectorized 1470 1490 29 0.7 1402.0 3.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 30 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9739 9740 2 0.1 9287.4 1.0X
-Native ORC MR 5553 5613 84 0.2 5296.0 1.8X
-Native ORC Vectorized 2090 2108 26 0.5 1993.1 4.7X
+Hive built-in ORC 4417 4430 19 0.2 4212.1 1.0X
+Native ORC MR 5039 5069 42 0.2 4805.9 0.9X
+Native ORC Vectorized 1726 1737 16 0.6 1645.8 2.6X
Review Comment:
Thanks for the information. @dongjoon-hyun
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535004490
##########
sql/core/benchmarks/JsonBenchmark-results.txt:
##########
@@ -3,128 +3,128 @@ Benchmark for performance of JSON parsing
================================================================================================
Preparing data for benchmarking ...
-OpenJDK 64-Bit Server VM 17.0.9+9-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 17.0.10+7-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-No encoding 4636 4660 28 1.1 927.2 1.0X
-UTF-8 is set 5758 5789 37 0.9 1151.6 0.8X
+No encoding 2456 2513 59 2.0 491.2 1.0X
+UTF-8 is set 3355 3365 15 1.5 671.1 0.7X
Preparing data for benchmarking ...
-OpenJDK 64-Bit Server VM 17.0.9+9-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 17.0.10+7-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-No encoding 2045 2117 82 2.4 409.1 1.0X
-UTF-8 is set 3001 3029 41 1.7 600.3 0.7X
+No encoding 2162 2201 34 2.3 432.4 1.0X
+UTF-8 is set 3168 3178 17 1.6 633.5 0.7X
Preparing data for benchmarking ...
-OpenJDK 64-Bit Server VM 17.0.9+9-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 17.0.10+7-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-No encoding 4483 4590 150 0.2 4483.4 1.0X
-UTF-8 is set 4020 4051 38 0.2 4019.7 1.1X
+No encoding 3185 3258 122 0.3 3185.0 1.0X
+UTF-8 is set 4058 4093 42 0.2 4058.1 0.8X
Review Comment:
The ratio is reversed noticeably. This seems to be a regression on UTF-8.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on PR #45654:
URL: https://github.com/apache/spark/pull/45654#issuecomment-2014302843
There is no noticeably outstanding regression. Let me merge this as a new baseline.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534999948
##########
sql/core/benchmarks/FilterPushdownBenchmark-jdk21-results.txt:
##########
@@ -2,733 +2,733 @@
Pushdown for many distinct value case
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6598 6767 128 2.4 419.5 1.0X
-Parquet Vectorized (Pushdown) 292 304 14 53.8 18.6 22.6X
-Native ORC Vectorized 7341 7411 88 2.1 466.7 0.9X
-Native ORC Vectorized (Pushdown) 282 291 10 55.7 18.0 23.4X
+Parquet Vectorized 6365 6420 67 2.5 404.7 1.0X
+Parquet Vectorized (Pushdown) 315 341 24 49.9 20.0 20.2X
+Native ORC Vectorized 4984 5073 69 3.2 316.9 1.3X
+Native ORC Vectorized (Pushdown) 311 321 11 50.5 19.8 20.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6631 6653 20 2.4 421.6 1.0X
-Parquet Vectorized (Pushdown) 288 299 15 54.7 18.3 23.1X
-Native ORC Vectorized 7453 7468 19 2.1 473.8 0.9X
-Native ORC Vectorized (Pushdown) 280 287 9 56.2 17.8 23.7X
+Parquet Vectorized 6261 6292 25 2.5 398.1 1.0X
+Parquet Vectorized (Pushdown) 281 298 12 56.1 17.8 22.3X
+Native ORC Vectorized 5053 5078 22 3.1 321.3 1.2X
+Native ORC Vectorized (Pushdown) 300 328 35 52.4 19.1 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6635 6654 17 2.4 421.9 1.0X
-Parquet Vectorized (Pushdown) 271 282 9 58.1 17.2 24.5X
-Native ORC Vectorized 7482 7512 35 2.1 475.7 0.9X
-Native ORC Vectorized (Pushdown) 268 277 4 58.6 17.1 24.7X
+Parquet Vectorized 6294 6356 90 2.5 400.1 1.0X
+Parquet Vectorized (Pushdown) 270 283 14 58.3 17.1 23.3X
+Native ORC Vectorized 5057 5086 20 3.1 321.5 1.2X
+Native ORC Vectorized (Pushdown) 289 298 8 54.4 18.4 21.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6622 6633 10 2.4 421.0 1.0X
-Parquet Vectorized (Pushdown) 262 270 9 60.1 16.6 25.3X
-Native ORC Vectorized 7413 7429 15 2.1 471.3 0.9X
-Native ORC Vectorized (Pushdown) 261 268 6 60.3 16.6 25.4X
+Parquet Vectorized 6252 6274 17 2.5 397.5 1.0X
+Parquet Vectorized (Pushdown) 256 272 15 61.4 16.3 24.4X
+Native ORC Vectorized 5036 5054 12 3.1 320.2 1.2X
+Native ORC Vectorized (Pushdown) 275 291 8 57.1 17.5 22.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6597 6632 34 2.4 419.4 1.0X
-Parquet Vectorized (Pushdown) 260 268 7 60.5 16.5 25.4X
-Native ORC Vectorized 7453 7467 11 2.1 473.9 0.9X
-Native ORC Vectorized (Pushdown) 261 270 7 60.3 16.6 25.3X
+Parquet Vectorized 6241 6259 11 2.5 396.8 1.0X
+Parquet Vectorized (Pushdown) 257 266 12 61.3 16.3 24.3X
+Native ORC Vectorized 5038 5055 20 3.1 320.3 1.2X
+Native ORC Vectorized (Pushdown) 277 290 10 56.8 17.6 22.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 12805 12872 92 1.2 814.1 1.0X
-Parquet Vectorized (Pushdown) 12833 12851 14 1.2 815.9 1.0X
-Native ORC Vectorized 13594 13615 16 1.2 864.3 0.9X
-Native ORC Vectorized (Pushdown) 13626 13637 11 1.2 866.3 0.9X
+Parquet Vectorized 12335 12564 207 1.3 784.2 1.0X
+Parquet Vectorized (Pushdown) 12561 12587 20 1.3 798.6 1.0X
+Native ORC Vectorized 11278 11295 12 1.4 717.0 1.1X
+Native ORC Vectorized (Pushdown) 11398 11468 98 1.4 724.7 1.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6401 6574 131 2.5 407.0 1.0X
-Parquet Vectorized (Pushdown) 240 248 7 65.6 15.2 26.7X
-Native ORC Vectorized 6666 6703 34 2.4 423.8 1.0X
-Native ORC Vectorized (Pushdown) 262 269 10 60.0 16.7 24.4X
+Parquet Vectorized 6150 6175 26 2.6 391.0 1.0X
+Parquet Vectorized (Pushdown) 252 276 25 62.4 16.0 24.4X
+Native ORC Vectorized 4484 4503 12 3.5 285.1 1.4X
+Native ORC Vectorized (Pushdown) 276 290 10 57.0 17.5 22.3X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6299 6330 35 2.5 400.5 1.0X
-Parquet Vectorized (Pushdown) 238 251 9 66.0 15.2 26.4X
-Native ORC Vectorized 6662 6673 13 2.4 423.6 0.9X
-Native ORC Vectorized (Pushdown) 256 268 9 61.3 16.3 24.6X
+Parquet Vectorized 5983 5997 10 2.6 380.4 1.0X
+Parquet Vectorized (Pushdown) 258 274 18 61.1 16.4 23.2X
+Native ORC Vectorized 4470 4481 9 3.5 284.2 1.3X
+Native ORC Vectorized (Pushdown) 284 289 6 55.3 18.1 21.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6374 6395 20 2.5 405.3 1.0X
-Parquet Vectorized (Pushdown) 239 244 4 65.7 15.2 26.6X
-Native ORC Vectorized 6699 6745 40 2.3 425.9 1.0X
-Native ORC Vectorized (Pushdown) 255 262 7 61.6 16.2 25.0X
+Parquet Vectorized 6050 6074 27 2.6 384.6 1.0X
+Parquet Vectorized (Pushdown) 251 262 15 62.7 16.0 24.1X
+Native ORC Vectorized 4539 4568 29 3.5 288.6 1.3X
+Native ORC Vectorized (Pushdown) 270 286 11 58.4 17.1 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6363 6385 26 2.5 404.6 1.0X
-Parquet Vectorized (Pushdown) 234 241 4 67.1 14.9 27.1X
-Native ORC Vectorized 6725 6750 22 2.3 427.5 0.9X
-Native ORC Vectorized (Pushdown) 265 273 14 59.3 16.9 24.0X
+Parquet Vectorized 5983 6015 26 2.6 380.4 1.0X
+Parquet Vectorized (Pushdown) 242 247 4 65.0 15.4 24.7X
+Native ORC Vectorized 4502 4529 34 3.5 286.2 1.3X
+Native ORC Vectorized (Pushdown) 267 276 6 58.8 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6363 6399 37 2.5 404.5 1.0X
-Parquet Vectorized (Pushdown) 236 241 5 66.7 15.0 27.0X
-Native ORC Vectorized 6762 6771 14 2.3 429.9 0.9X
-Native ORC Vectorized (Pushdown) 246 256 4 63.9 15.7 25.8X
+Parquet Vectorized 5978 6000 14 2.6 380.1 1.0X
+Parquet Vectorized (Pushdown) 243 254 12 64.8 15.4 24.6X
+Native ORC Vectorized 4520 4532 12 3.5 287.4 1.3X
+Native ORC Vectorized (Pushdown) 267 280 11 58.9 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6365 6401 38 2.5 404.7 1.0X
-Parquet Vectorized (Pushdown) 236 240 5 66.8 15.0 27.0X
-Native ORC Vectorized 6734 6775 46 2.3 428.2 0.9X
-Native ORC Vectorized (Pushdown) 250 255 4 62.8 15.9 25.4X
+Parquet Vectorized 5992 6010 17 2.6 381.0 1.0X
+Parquet Vectorized (Pushdown) 250 257 9 63.0 15.9 24.0X
+Native ORC Vectorized 4525 4536 12 3.5 287.7 1.3X
+Native ORC Vectorized (Pushdown) 267 276 7 58.9 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6968 6990 14 2.3 443.0 1.0X
-Parquet Vectorized (Pushdown) 1456 1487 42 10.8 92.6 4.8X
-Native ORC Vectorized 7284 7290 5 2.2 463.1 1.0X
-Native ORC Vectorized (Pushdown) 1488 1497 8 10.6 94.6 4.7X
+Parquet Vectorized 6624 6642 20 2.4 421.1 1.0X
+Parquet Vectorized (Pushdown) 1438 1450 11 10.9 91.4 4.6X
+Native ORC Vectorized 5086 5101 17 3.1 323.4 1.3X
+Native ORC Vectorized (Pushdown) 1293 1303 8 12.2 82.2 5.1X
Review Comment:
ditto. Although the ratio is reversed, the different is small.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535006122
##########
sql/core/benchmarks/MetricsAggregationBenchmark-results.txt:
##########
@@ -1,12 +1,12 @@
-OpenJDK 64-Bit Server VM 17.0.9+9-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 17.0.10+7-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
metrics aggregation (50 metrics, 100000 tasks per stage): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
-1 stage(s) 650 668 16 0.0 650409908.0 1.0X
-2 stage(s) 931 1010 111 0.0 931458679.0 0.7X
-3 stage(s) 1916 2000 119 0.0 1915675055.0 0.3X
+1 stage(s) 614 653 49 0.0 613999403.0 1.0X
+2 stage(s) 1306 1324 25 0.0 1306014655.0 0.5X
Review Comment:
This change is consistent with Java 21 result.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535010231
##########
sql/core/benchmarks/TPCDSQueryBenchmark-jdk21-results.txt:
##########
@@ -1,810 +1,810 @@
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q1 665 736 120 0.7 1441.1 1.0X
+q1 550 699 210 0.8 1191.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q2 837 863 28 2.7 375.0 1.0X
+q2 792 809 24 2.8 355.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q3 224 261 36 13.2 75.5 1.0X
+q3 221 261 43 13.5 74.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q4 4163 4571 577 1.3 798.8 1.0X
+q4 4185 4574 550 1.2 802.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q5 1111 1276 234 5.1 197.4 1.0X
+q5 1066 1325 366 5.3 189.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q6 1010 1072 88 3.1 323.5 1.0X
+q6 1063 1110 67 2.9 340.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q7 495 569 55 9.9 101.1 1.0X
+q7 549 573 26 8.9 112.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q8 414 457 43 7.5 133.3 1.0X
+q8 460 515 49 6.8 148.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q9 862 878 19 0.0 24614403.5 1.0X
+q9 863 882 25 0.0 24667420.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q10 1778 1899 172 1.2 858.6 1.0X
+q10 1814 1934 170 1.1 875.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q11 1564 1726 229 2.4 414.6 1.0X
+q11 1614 1820 290 2.3 428.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q12 160 192 31 5.1 198.0 1.0X
+q12 163 199 47 5.0 200.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q13 719 764 53 6.9 145.9 1.0X
+q13 726 762 51 6.8 147.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q14a 4618 4802 261 1.1 900.2 1.0X
+q14a 5344 5424 114 1.0 1041.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q14b 3444 3603 225 1.5 671.4 1.0X
+q14b 3893 4053 226 1.3 758.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q15 423 443 35 3.9 254.4 1.0X
+q15 408 443 27 4.1 245.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q16 582 623 29 2.7 372.2 1.0X
+q16 564 627 42 2.8 360.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q17 1334 1361 38 3.5 283.8 1.0X
+q17 1246 1299 74 3.8 265.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q18 972 1208 333 3.7 269.9 1.0X
+q18 944 1043 140 3.8 262.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q19 278 306 23 11.2 89.0 1.0X
+q19 292 321 31 10.7 93.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q20 190 208 12 8.1 124.0 1.0X
+q20 173 187 21 8.9 112.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q21 592 644 48 20.0 50.0 1.0X
+q21 661 672 10 17.9 55.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q22 3287 3346 83 3.6 277.7 1.0X
+q22 3223 3302 112 3.7 272.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q23a 5646 5698 73 0.9 1079.7 1.0X
+q23a 5979 6048 98 0.9 1143.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q23b 5616 5815 281 0.9 1073.9 1.0X
+q23b 6074 6126 74 0.9 1161.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q24a 146 241 62 22.9 43.8 1.0X
+q24a 154 248 48 21.7 46.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q24b 210 252 21 15.9 63.0 1.0X
+q24b 208 249 30 16.0 62.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q25 1287 1338 72 3.7 273.9 1.0X
+q25 1401 1419 26 3.4 298.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q26 303 337 36 11.4 87.7 1.0X
+q26 300 332 35 11.5 86.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q27 474 488 15 10.3 96.8 1.0X
+q27 477 504 28 10.2 97.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q28 1197 1287 127 2.4 415.7 1.0X
+q28 1136 1207 100 2.5 394.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q29 1543 1634 129 3.0 328.3 1.0X
+q29 1244 1413 239 3.8 264.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q30 388 417 32 0.8 1314.4 1.0X
+q30 388 406 33 0.8 1315.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q31 770 862 126 4.8 206.9 1.0X
+q31 749 775 31 5.0 201.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q32 202 239 57 7.6 131.8 1.0X
+q32 183 218 34 8.3 119.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q33 398 420 29 13.0 76.8 1.0X
+q33 379 421 47 13.7 73.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q34 344 370 31 8.9 112.4 1.0X
+q34 341 379 50 9.0 111.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q35 1187 1250 89 1.7 573.4 1.0X
+q35 1145 1212 94 1.8 552.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q36 500 524 41 5.9 168.4 1.0X
+q36 499 531 29 5.9 168.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q37 795 824 25 16.7 59.9 1.0X
+q37 817 864 44 16.3 61.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q38 672 684 10 7.8 129.0 1.0X
+q38 634 690 52 8.2 121.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q39a 1386 1418 46 8.5 117.1 1.0X
+q39a 1401 1529 180 8.4 118.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q39b 1337 1360 31 8.8 113.0 1.0X
+q39b 1356 1362 8 8.7 114.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q40 284 327 40 5.9 169.8 1.0X
+q40 288 338 43 5.8 172.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q41 140 162 25 0.1 7771.3 1.0X
+q41 151 168 19 0.1 8388.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q42 140 160 19 21.2 47.2 1.0X
+q42 142 156 24 20.9 48.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q43 281 311 28 10.5 95.1 1.0X
+q43 275 300 24 10.8 93.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q44 318 357 39 9.1 109.7 1.0X
+q44 302 338 39 9.6 104.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q45 179 207 32 5.4 186.3 1.0X
+q45 182 212 34 5.3 189.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q46 429 468 43 7.3 137.8 1.0X
+q46 418 447 42 7.4 134.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q47 1504 1581 108 2.0 506.4 1.0X
+q47 1518 1551 48 2.0 510.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q48 830 833 2 5.9 168.6 1.0X
+q48 874 891 19 5.6 177.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q49 533 604 51 10.5 94.9 1.0X
+q49 521 632 105 10.8 92.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q50 573 675 114 5.7 176.8 1.0X
+q50 565 599 27 5.7 174.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q51 2570 2633 89 1.4 699.9 1.0X
+q51 2469 2610 199 1.5 672.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q52 141 168 24 21.1 47.4 1.0X
+q52 140 160 21 21.2 47.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q53 267 294 37 11.1 90.0 1.0X
+q53 276 300 23 10.8 92.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q54 1155 1201 65 4.6 218.8 1.0X
+q54 1168 1204 50 4.5 221.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q55 138 151 18 21.5 46.4 1.0X
+q55 139 151 17 21.3 46.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q56 412 451 39 12.6 79.6 1.0X
+q56 415 431 20 12.5 80.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q57 746 808 71 2.1 487.0 1.0X
+q57 772 822 73 2.0 504.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q58 423 503 59 12.1 82.4 1.0X
+q58 394 426 35 13.0 76.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q59 606 652 69 4.9 205.3 1.0X
+q59 583 626 41 5.1 197.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q60 407 444 44 12.7 78.5 1.0X
+q60 383 440 55 13.5 74.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q61 524 556 31 6.0 167.9 1.0X
+q61 530 642 191 5.9 169.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q62 162 176 19 4.9 204.0 1.0X
+q62 162 181 23 4.9 204.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q63 276 297 14 10.8 93.0 1.0X
+q63 269 305 27 11.1 90.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q64 1927 2249 455 3.6 278.4 1.0X
+q64 2129 2334 290 3.3 307.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q65 631 678 75 4.7 212.5 1.0X
+q65 614 646 39 4.8 206.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q66 557 577 20 4.2 240.4 1.0X
+q66 509 575 60 4.6 219.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q67 5285 5314 41 0.6 1779.0 1.0X
+q67 5168 5274 149 0.6 1739.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q68 426 457 22 7.3 137.0 1.0X
+q68 416 455 40 7.5 133.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q69 1590 1603 19 1.3 767.7 1.0X
+q69 1601 1617 22 1.3 773.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q70 514 551 49 5.7 174.0 1.0X
+q70 548 569 25 5.4 185.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q71 347 364 22 15.0 66.6 1.0X
+q71 345 377 38 15.1 66.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q72 117138 117824 970 0.1 7632.1 1.0X
+q72 115881 116420 762 0.1 7550.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q73 319 349 47 9.6 104.3 1.0X
+q73 304 342 30 10.1 99.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q74 1185 1476 412 3.2 314.2 1.0X
+q74 1079 1503 600 3.5 286.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q75 1333 1472 196 4.2 236.6 1.0X
+q75 1369 1575 292 4.1 242.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q76 274 301 28 18.7 53.4 1.0X
+q76 269 305 42 19.1 52.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q77 495 791 257 11.3 88.1 1.0X
+q77 546 755 182 10.3 97.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q78 1963 2198 332 2.9 349.6 1.0X
+q78 2326 2453 179 2.4 414.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q79 398 420 42 7.7 130.0 1.0X
+q79 403 432 33 7.6 131.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q80 1375 1384 13 4.1 243.5 1.0X
+q80 1534 1569 49 3.7 271.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q81 283 371 51 1.3 770.7 1.0X
+q81 293 359 43 1.3 798.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q82 1074 1093 28 13.7 72.9 1.0X
+q82 1067 1080 19 13.8 72.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q83 231 268 29 2.6 388.9 1.0X
+q83 232 285 56 2.6 389.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q84 649 710 72 3.6 274.3 1.0X
+q84 640 688 70 3.7 270.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q85 2113 2151 54 1.3 745.3 1.0X
+q85 1729 2002 386 1.6 610.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q86 175 191 22 4.6 215.8 1.0X
+q86 178 207 30 4.6 219.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q87 626 677 73 8.3 120.1 1.0X
+q87 660 717 61 7.9 126.7 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q88 1090 1264 246 2.7 366.6 1.0X
+q88 1121 1286 234 2.7 376.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q89 294 323 21 10.1 99.1 1.0X
+q89 292 335 35 10.2 98.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q90 118 140 21 6.9 144.7 1.0X
+q90 110 130 16 7.4 135.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q91 284 312 30 8.1 123.6 1.0X
+q91 304 339 35 7.6 132.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q92 123 150 19 6.6 151.3 1.0X
+q92 133 156 23 6.1 163.8 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q93 420 444 29 7.5 132.7 1.0X
+q93 424 453 39 7.5 134.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q94 305 327 25 2.8 362.6 1.0X
+q94 296 345 53 2.8 352.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q95 5032 5202 240 0.2 5976.6 1.0X
+q95 5098 5262 232 0.2 6054.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q96 154 167 21 19.3 51.7 1.0X
+q96 155 167 15 19.1 52.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q97 1140 1192 74 3.9 259.5 1.0X
+q97 1147 1178 44 3.8 261.1 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q98 249 280 17 11.9 83.8 1.0X
+q98 257 297 48 11.6 86.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q99 237 252 24 6.4 156.4 1.0X
+q99 240 259 24 6.3 158.5 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q5a-v2.7 1161 1178 25 4.8 206.3 1.0X
+q5a-v2.7 968 1233 375 5.8 172.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q6-v2.7 922 943 18 3.4 295.4 1.0X
+q6-v2.7 917 940 33 3.4 294.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q10a-v2.7 1669 1693 33 1.2 806.1 1.0X
+q10a-v2.7 1654 1690 51 1.3 798.9 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q11-v2.7 1430 1874 628 2.6 379.3 1.0X
+q11-v2.7 1472 1902 607 2.6 390.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q12-v2.7 121 134 16 6.7 148.9 1.0X
+q12-v2.7 124 139 21 6.5 153.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q14-v2.7 3332 3509 250 1.5 649.6 1.0X
+q14-v2.7 3734 3804 99 1.4 728.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q14a-v2.7 6515 6621 150 0.8 1270.0 1.0X
+q14a-v2.7 7026 7251 319 0.7 1369.6 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q18a-v2.7 1807 1987 254 2.0 501.8 1.0X
+q18a-v2.7 1874 2095 312 1.9 520.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q20-v2.7 155 172 21 9.9 101.0 1.0X
+q20-v2.7 150 170 25 10.2 98.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q22-v2.7 12795 12851 80 0.9 1081.0 1.0X
+q22-v2.7 12490 12574 120 0.9 1055.2 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q22a-v2.7 1853 1888 49 6.4 156.6 1.0X
+q22a-v2.7 1930 1938 12 6.1 163.0 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
TPCDS: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-q24-v2.7 212 254 35 15.7 63.5 1.0X
+q24-v2.7 101 230 75 33.2 30.2 1.0X
Review Comment:
The time is too small to say something.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535000904
##########
sql/core/benchmarks/FilterPushdownBenchmark-jdk21-results.txt:
##########
@@ -2,733 +2,733 @@
Pushdown for many distinct value case
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6598 6767 128 2.4 419.5 1.0X
-Parquet Vectorized (Pushdown) 292 304 14 53.8 18.6 22.6X
-Native ORC Vectorized 7341 7411 88 2.1 466.7 0.9X
-Native ORC Vectorized (Pushdown) 282 291 10 55.7 18.0 23.4X
+Parquet Vectorized 6365 6420 67 2.5 404.7 1.0X
+Parquet Vectorized (Pushdown) 315 341 24 49.9 20.0 20.2X
+Native ORC Vectorized 4984 5073 69 3.2 316.9 1.3X
+Native ORC Vectorized (Pushdown) 311 321 11 50.5 19.8 20.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6631 6653 20 2.4 421.6 1.0X
-Parquet Vectorized (Pushdown) 288 299 15 54.7 18.3 23.1X
-Native ORC Vectorized 7453 7468 19 2.1 473.8 0.9X
-Native ORC Vectorized (Pushdown) 280 287 9 56.2 17.8 23.7X
+Parquet Vectorized 6261 6292 25 2.5 398.1 1.0X
+Parquet Vectorized (Pushdown) 281 298 12 56.1 17.8 22.3X
+Native ORC Vectorized 5053 5078 22 3.1 321.3 1.2X
+Native ORC Vectorized (Pushdown) 300 328 35 52.4 19.1 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6635 6654 17 2.4 421.9 1.0X
-Parquet Vectorized (Pushdown) 271 282 9 58.1 17.2 24.5X
-Native ORC Vectorized 7482 7512 35 2.1 475.7 0.9X
-Native ORC Vectorized (Pushdown) 268 277 4 58.6 17.1 24.7X
+Parquet Vectorized 6294 6356 90 2.5 400.1 1.0X
+Parquet Vectorized (Pushdown) 270 283 14 58.3 17.1 23.3X
+Native ORC Vectorized 5057 5086 20 3.1 321.5 1.2X
+Native ORC Vectorized (Pushdown) 289 298 8 54.4 18.4 21.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6622 6633 10 2.4 421.0 1.0X
-Parquet Vectorized (Pushdown) 262 270 9 60.1 16.6 25.3X
-Native ORC Vectorized 7413 7429 15 2.1 471.3 0.9X
-Native ORC Vectorized (Pushdown) 261 268 6 60.3 16.6 25.4X
+Parquet Vectorized 6252 6274 17 2.5 397.5 1.0X
+Parquet Vectorized (Pushdown) 256 272 15 61.4 16.3 24.4X
+Native ORC Vectorized 5036 5054 12 3.1 320.2 1.2X
+Native ORC Vectorized (Pushdown) 275 291 8 57.1 17.5 22.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6597 6632 34 2.4 419.4 1.0X
-Parquet Vectorized (Pushdown) 260 268 7 60.5 16.5 25.4X
-Native ORC Vectorized 7453 7467 11 2.1 473.9 0.9X
-Native ORC Vectorized (Pushdown) 261 270 7 60.3 16.6 25.3X
+Parquet Vectorized 6241 6259 11 2.5 396.8 1.0X
+Parquet Vectorized (Pushdown) 257 266 12 61.3 16.3 24.3X
+Native ORC Vectorized 5038 5055 20 3.1 320.3 1.2X
+Native ORC Vectorized (Pushdown) 277 290 10 56.8 17.6 22.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 12805 12872 92 1.2 814.1 1.0X
-Parquet Vectorized (Pushdown) 12833 12851 14 1.2 815.9 1.0X
-Native ORC Vectorized 13594 13615 16 1.2 864.3 0.9X
-Native ORC Vectorized (Pushdown) 13626 13637 11 1.2 866.3 0.9X
+Parquet Vectorized 12335 12564 207 1.3 784.2 1.0X
+Parquet Vectorized (Pushdown) 12561 12587 20 1.3 798.6 1.0X
+Native ORC Vectorized 11278 11295 12 1.4 717.0 1.1X
+Native ORC Vectorized (Pushdown) 11398 11468 98 1.4 724.7 1.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6401 6574 131 2.5 407.0 1.0X
-Parquet Vectorized (Pushdown) 240 248 7 65.6 15.2 26.7X
-Native ORC Vectorized 6666 6703 34 2.4 423.8 1.0X
-Native ORC Vectorized (Pushdown) 262 269 10 60.0 16.7 24.4X
+Parquet Vectorized 6150 6175 26 2.6 391.0 1.0X
+Parquet Vectorized (Pushdown) 252 276 25 62.4 16.0 24.4X
+Native ORC Vectorized 4484 4503 12 3.5 285.1 1.4X
+Native ORC Vectorized (Pushdown) 276 290 10 57.0 17.5 22.3X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6299 6330 35 2.5 400.5 1.0X
-Parquet Vectorized (Pushdown) 238 251 9 66.0 15.2 26.4X
-Native ORC Vectorized 6662 6673 13 2.4 423.6 0.9X
-Native ORC Vectorized (Pushdown) 256 268 9 61.3 16.3 24.6X
+Parquet Vectorized 5983 5997 10 2.6 380.4 1.0X
+Parquet Vectorized (Pushdown) 258 274 18 61.1 16.4 23.2X
+Native ORC Vectorized 4470 4481 9 3.5 284.2 1.3X
+Native ORC Vectorized (Pushdown) 284 289 6 55.3 18.1 21.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6374 6395 20 2.5 405.3 1.0X
-Parquet Vectorized (Pushdown) 239 244 4 65.7 15.2 26.6X
-Native ORC Vectorized 6699 6745 40 2.3 425.9 1.0X
-Native ORC Vectorized (Pushdown) 255 262 7 61.6 16.2 25.0X
+Parquet Vectorized 6050 6074 27 2.6 384.6 1.0X
+Parquet Vectorized (Pushdown) 251 262 15 62.7 16.0 24.1X
+Native ORC Vectorized 4539 4568 29 3.5 288.6 1.3X
+Native ORC Vectorized (Pushdown) 270 286 11 58.4 17.1 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6363 6385 26 2.5 404.6 1.0X
-Parquet Vectorized (Pushdown) 234 241 4 67.1 14.9 27.1X
-Native ORC Vectorized 6725 6750 22 2.3 427.5 0.9X
-Native ORC Vectorized (Pushdown) 265 273 14 59.3 16.9 24.0X
+Parquet Vectorized 5983 6015 26 2.6 380.4 1.0X
+Parquet Vectorized (Pushdown) 242 247 4 65.0 15.4 24.7X
+Native ORC Vectorized 4502 4529 34 3.5 286.2 1.3X
+Native ORC Vectorized (Pushdown) 267 276 6 58.8 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6363 6399 37 2.5 404.5 1.0X
-Parquet Vectorized (Pushdown) 236 241 5 66.7 15.0 27.0X
-Native ORC Vectorized 6762 6771 14 2.3 429.9 0.9X
-Native ORC Vectorized (Pushdown) 246 256 4 63.9 15.7 25.8X
+Parquet Vectorized 5978 6000 14 2.6 380.1 1.0X
+Parquet Vectorized (Pushdown) 243 254 12 64.8 15.4 24.6X
+Native ORC Vectorized 4520 4532 12 3.5 287.4 1.3X
+Native ORC Vectorized (Pushdown) 267 280 11 58.9 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6365 6401 38 2.5 404.7 1.0X
-Parquet Vectorized (Pushdown) 236 240 5 66.8 15.0 27.0X
-Native ORC Vectorized 6734 6775 46 2.3 428.2 0.9X
-Native ORC Vectorized (Pushdown) 250 255 4 62.8 15.9 25.4X
+Parquet Vectorized 5992 6010 17 2.6 381.0 1.0X
+Parquet Vectorized (Pushdown) 250 257 9 63.0 15.9 24.0X
+Native ORC Vectorized 4525 4536 12 3.5 287.7 1.3X
+Native ORC Vectorized (Pushdown) 267 276 7 58.9 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6968 6990 14 2.3 443.0 1.0X
-Parquet Vectorized (Pushdown) 1456 1487 42 10.8 92.6 4.8X
-Native ORC Vectorized 7284 7290 5 2.2 463.1 1.0X
-Native ORC Vectorized (Pushdown) 1488 1497 8 10.6 94.6 4.7X
+Parquet Vectorized 6624 6642 20 2.4 421.1 1.0X
+Parquet Vectorized (Pushdown) 1438 1450 11 10.9 91.4 4.6X
+Native ORC Vectorized 5086 5101 17 3.1 323.4 1.3X
+Native ORC Vectorized (Pushdown) 1293 1303 8 12.2 82.2 5.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 9072 9082 11 1.7 576.8 1.0X
-Parquet Vectorized (Pushdown) 6042 6065 21 2.6 384.1 1.5X
-Native ORC Vectorized 9554 9580 17 1.6 607.4 0.9X
-Native ORC Vectorized (Pushdown) 6387 6400 9 2.5 406.1 1.4X
+Parquet Vectorized 8735 8748 8 1.8 555.3 1.0X
+Parquet Vectorized (Pushdown) 5861 5871 12 2.7 372.7 1.5X
+Native ORC Vectorized 7281 7331 29 2.2 462.9 1.2X
+Native ORC Vectorized (Pushdown) 5242 5250 12 3.0 333.3 1.7X
Review Comment:
Th ratio is slightly reversed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535004974
##########
sql/core/benchmarks/MakeDateTimeBenchmark-jdk21-results.txt:
##########
@@ -1,22 +1,22 @@
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-prepare make_date() 2004 2018 13 49.9 20.0 1.0X
-make_date(2019, 9, 16) 2694 2737 52 37.1 26.9 0.7X
-make_date(*, *, *) 3881 3906 37 25.8 38.8 0.5X
+prepare make_date() 1981 2010 32 50.5 19.8 1.0X
+make_date(2019, 9, 16) 1833 1849 14 54.5 18.3 1.1X
Review Comment:
~`make_date` seems to be improved.~ It seems to be a flaky result. Java 17 result shows the similar result.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun closed pull request #45654: [SPARK-47513][TESTS] Regenerate benchmark results
URL: https://github.com/apache/spark/pull/45654
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535002610
##########
sql/core/benchmarks/FilterPushdownBenchmark-jdk21-results.txt:
##########
@@ -2,733 +2,733 @@
Pushdown for many distinct value case
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6598 6767 128 2.4 419.5 1.0X
-Parquet Vectorized (Pushdown) 292 304 14 53.8 18.6 22.6X
-Native ORC Vectorized 7341 7411 88 2.1 466.7 0.9X
-Native ORC Vectorized (Pushdown) 282 291 10 55.7 18.0 23.4X
+Parquet Vectorized 6365 6420 67 2.5 404.7 1.0X
+Parquet Vectorized (Pushdown) 315 341 24 49.9 20.0 20.2X
+Native ORC Vectorized 4984 5073 69 3.2 316.9 1.3X
+Native ORC Vectorized (Pushdown) 311 321 11 50.5 19.8 20.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6631 6653 20 2.4 421.6 1.0X
-Parquet Vectorized (Pushdown) 288 299 15 54.7 18.3 23.1X
-Native ORC Vectorized 7453 7468 19 2.1 473.8 0.9X
-Native ORC Vectorized (Pushdown) 280 287 9 56.2 17.8 23.7X
+Parquet Vectorized 6261 6292 25 2.5 398.1 1.0X
+Parquet Vectorized (Pushdown) 281 298 12 56.1 17.8 22.3X
+Native ORC Vectorized 5053 5078 22 3.1 321.3 1.2X
+Native ORC Vectorized (Pushdown) 300 328 35 52.4 19.1 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6635 6654 17 2.4 421.9 1.0X
-Parquet Vectorized (Pushdown) 271 282 9 58.1 17.2 24.5X
-Native ORC Vectorized 7482 7512 35 2.1 475.7 0.9X
-Native ORC Vectorized (Pushdown) 268 277 4 58.6 17.1 24.7X
+Parquet Vectorized 6294 6356 90 2.5 400.1 1.0X
+Parquet Vectorized (Pushdown) 270 283 14 58.3 17.1 23.3X
+Native ORC Vectorized 5057 5086 20 3.1 321.5 1.2X
+Native ORC Vectorized (Pushdown) 289 298 8 54.4 18.4 21.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6622 6633 10 2.4 421.0 1.0X
-Parquet Vectorized (Pushdown) 262 270 9 60.1 16.6 25.3X
-Native ORC Vectorized 7413 7429 15 2.1 471.3 0.9X
-Native ORC Vectorized (Pushdown) 261 268 6 60.3 16.6 25.4X
+Parquet Vectorized 6252 6274 17 2.5 397.5 1.0X
+Parquet Vectorized (Pushdown) 256 272 15 61.4 16.3 24.4X
+Native ORC Vectorized 5036 5054 12 3.1 320.2 1.2X
+Native ORC Vectorized (Pushdown) 275 291 8 57.1 17.5 22.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6597 6632 34 2.4 419.4 1.0X
-Parquet Vectorized (Pushdown) 260 268 7 60.5 16.5 25.4X
-Native ORC Vectorized 7453 7467 11 2.1 473.9 0.9X
-Native ORC Vectorized (Pushdown) 261 270 7 60.3 16.6 25.3X
+Parquet Vectorized 6241 6259 11 2.5 396.8 1.0X
+Parquet Vectorized (Pushdown) 257 266 12 61.3 16.3 24.3X
+Native ORC Vectorized 5038 5055 20 3.1 320.3 1.2X
+Native ORC Vectorized (Pushdown) 277 290 10 56.8 17.6 22.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 12805 12872 92 1.2 814.1 1.0X
-Parquet Vectorized (Pushdown) 12833 12851 14 1.2 815.9 1.0X
-Native ORC Vectorized 13594 13615 16 1.2 864.3 0.9X
-Native ORC Vectorized (Pushdown) 13626 13637 11 1.2 866.3 0.9X
+Parquet Vectorized 12335 12564 207 1.3 784.2 1.0X
+Parquet Vectorized (Pushdown) 12561 12587 20 1.3 798.6 1.0X
+Native ORC Vectorized 11278 11295 12 1.4 717.0 1.1X
+Native ORC Vectorized (Pushdown) 11398 11468 98 1.4 724.7 1.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6401 6574 131 2.5 407.0 1.0X
-Parquet Vectorized (Pushdown) 240 248 7 65.6 15.2 26.7X
-Native ORC Vectorized 6666 6703 34 2.4 423.8 1.0X
-Native ORC Vectorized (Pushdown) 262 269 10 60.0 16.7 24.4X
+Parquet Vectorized 6150 6175 26 2.6 391.0 1.0X
+Parquet Vectorized (Pushdown) 252 276 25 62.4 16.0 24.4X
+Native ORC Vectorized 4484 4503 12 3.5 285.1 1.4X
+Native ORC Vectorized (Pushdown) 276 290 10 57.0 17.5 22.3X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6299 6330 35 2.5 400.5 1.0X
-Parquet Vectorized (Pushdown) 238 251 9 66.0 15.2 26.4X
-Native ORC Vectorized 6662 6673 13 2.4 423.6 0.9X
-Native ORC Vectorized (Pushdown) 256 268 9 61.3 16.3 24.6X
+Parquet Vectorized 5983 5997 10 2.6 380.4 1.0X
+Parquet Vectorized (Pushdown) 258 274 18 61.1 16.4 23.2X
+Native ORC Vectorized 4470 4481 9 3.5 284.2 1.3X
+Native ORC Vectorized (Pushdown) 284 289 6 55.3 18.1 21.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6374 6395 20 2.5 405.3 1.0X
-Parquet Vectorized (Pushdown) 239 244 4 65.7 15.2 26.6X
-Native ORC Vectorized 6699 6745 40 2.3 425.9 1.0X
-Native ORC Vectorized (Pushdown) 255 262 7 61.6 16.2 25.0X
+Parquet Vectorized 6050 6074 27 2.6 384.6 1.0X
+Parquet Vectorized (Pushdown) 251 262 15 62.7 16.0 24.1X
+Native ORC Vectorized 4539 4568 29 3.5 288.6 1.3X
+Native ORC Vectorized (Pushdown) 270 286 11 58.4 17.1 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6363 6385 26 2.5 404.6 1.0X
-Parquet Vectorized (Pushdown) 234 241 4 67.1 14.9 27.1X
-Native ORC Vectorized 6725 6750 22 2.3 427.5 0.9X
-Native ORC Vectorized (Pushdown) 265 273 14 59.3 16.9 24.0X
+Parquet Vectorized 5983 6015 26 2.6 380.4 1.0X
+Parquet Vectorized (Pushdown) 242 247 4 65.0 15.4 24.7X
+Native ORC Vectorized 4502 4529 34 3.5 286.2 1.3X
+Native ORC Vectorized (Pushdown) 267 276 6 58.8 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6363 6399 37 2.5 404.5 1.0X
-Parquet Vectorized (Pushdown) 236 241 5 66.7 15.0 27.0X
-Native ORC Vectorized 6762 6771 14 2.3 429.9 0.9X
-Native ORC Vectorized (Pushdown) 246 256 4 63.9 15.7 25.8X
+Parquet Vectorized 5978 6000 14 2.6 380.1 1.0X
+Parquet Vectorized (Pushdown) 243 254 12 64.8 15.4 24.6X
+Native ORC Vectorized 4520 4532 12 3.5 287.4 1.3X
+Native ORC Vectorized (Pushdown) 267 280 11 58.9 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6365 6401 38 2.5 404.7 1.0X
-Parquet Vectorized (Pushdown) 236 240 5 66.8 15.0 27.0X
-Native ORC Vectorized 6734 6775 46 2.3 428.2 0.9X
-Native ORC Vectorized (Pushdown) 250 255 4 62.8 15.9 25.4X
+Parquet Vectorized 5992 6010 17 2.6 381.0 1.0X
+Parquet Vectorized (Pushdown) 250 257 9 63.0 15.9 24.0X
+Native ORC Vectorized 4525 4536 12 3.5 287.7 1.3X
+Native ORC Vectorized (Pushdown) 267 276 7 58.9 17.0 22.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6968 6990 14 2.3 443.0 1.0X
-Parquet Vectorized (Pushdown) 1456 1487 42 10.8 92.6 4.8X
-Native ORC Vectorized 7284 7290 5 2.2 463.1 1.0X
-Native ORC Vectorized (Pushdown) 1488 1497 8 10.6 94.6 4.7X
+Parquet Vectorized 6624 6642 20 2.4 421.1 1.0X
+Parquet Vectorized (Pushdown) 1438 1450 11 10.9 91.4 4.6X
+Native ORC Vectorized 5086 5101 17 3.1 323.4 1.3X
+Native ORC Vectorized (Pushdown) 1293 1303 8 12.2 82.2 5.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 9072 9082 11 1.7 576.8 1.0X
-Parquet Vectorized (Pushdown) 6042 6065 21 2.6 384.1 1.5X
-Native ORC Vectorized 9554 9580 17 1.6 607.4 0.9X
-Native ORC Vectorized (Pushdown) 6387 6400 9 2.5 406.1 1.4X
+Parquet Vectorized 8735 8748 8 1.8 555.3 1.0X
+Parquet Vectorized (Pushdown) 5861 5871 12 2.7 372.7 1.5X
+Native ORC Vectorized 7281 7331 29 2.2 462.9 1.2X
+Native ORC Vectorized (Pushdown) 5242 5250 12 3.0 333.3 1.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 11048 11091 76 1.4 702.4 1.0X
-Parquet Vectorized (Pushdown) 10456 10495 33 1.5 664.8 1.1X
-Native ORC Vectorized 11624 11645 27 1.4 739.0 1.0X
-Native ORC Vectorized (Pushdown) 11056 11072 11 1.4 702.9 1.0X
+Parquet Vectorized 11127 11148 16 1.4 707.5 1.0X
+Parquet Vectorized (Pushdown) 10606 10632 30 1.5 674.3 1.0X
+Native ORC Vectorized 9596 9614 11 1.6 610.1 1.2X
+Native ORC Vectorized (Pushdown) 9248 9257 8 1.7 588.0 1.2X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 11720 11747 45 1.3 745.1 1.0X
-Parquet Vectorized (Pushdown) 11773 11808 35 1.3 748.5 1.0X
-Native ORC Vectorized 12040 12062 31 1.3 765.5 1.0X
-Native ORC Vectorized (Pushdown) 12157 12179 20 1.3 772.9 1.0X
+Parquet Vectorized 11514 11537 32 1.4 732.0 1.0X
+Parquet Vectorized (Pushdown) 11493 11514 17 1.4 730.7 1.0X
+Native ORC Vectorized 10169 10181 11 1.5 646.5 1.1X
+Native ORC Vectorized (Pushdown) 10303 10321 15 1.5 655.1 1.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 11640 11661 14 1.4 740.0 1.0X
-Parquet Vectorized (Pushdown) 11704 11712 12 1.3 744.1 1.0X
-Native ORC Vectorized 12188 12198 15 1.3 774.9 1.0X
-Native ORC Vectorized (Pushdown) 12278 12297 19 1.3 780.6 0.9X
+Parquet Vectorized 11501 11520 21 1.4 731.2 1.0X
+Parquet Vectorized (Pushdown) 11549 11591 40 1.4 734.3 1.0X
+Native ORC Vectorized 10206 10220 15 1.5 648.9 1.1X
+Native ORC Vectorized (Pushdown) 10274 10305 30 1.5 653.2 1.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 11714 11733 34 1.3 744.7 1.0X
-Parquet Vectorized (Pushdown) 11740 11770 32 1.3 746.4 1.0X
-Native ORC Vectorized 12037 12052 21 1.3 765.3 1.0X
-Native ORC Vectorized (Pushdown) 12147 12177 31 1.3 772.3 1.0X
+Parquet Vectorized 11571 11635 49 1.4 735.7 1.0X
+Parquet Vectorized (Pushdown) 11589 11620 31 1.4 736.8 1.0X
+Native ORC Vectorized 10168 10209 45 1.5 646.4 1.1X
+Native ORC Vectorized (Pushdown) 10245 10262 20 1.5 651.4 1.1X
================================================================================================
Pushdown for few distinct value case (use dictionary encoding)
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5614 5679 76 2.8 356.9 1.0X
-Parquet Vectorized (Pushdown) 201 206 4 78.3 12.8 27.9X
-Native ORC Vectorized 8246 8272 28 1.9 524.3 0.7X
-Native ORC Vectorized (Pushdown) 844 855 10 18.6 53.7 6.6X
+Parquet Vectorized 5490 5539 43 2.9 349.0 1.0X
+Parquet Vectorized (Pushdown) 207 222 13 75.9 13.2 26.5X
+Native ORC Vectorized 6053 6083 42 2.6 384.8 0.9X
+Native ORC Vectorized (Pushdown) 886 893 4 17.7 56.3 6.2X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5720 5730 7 2.7 363.7 1.0X
-Parquet Vectorized (Pushdown) 203 206 3 77.7 12.9 28.2X
-Native ORC Vectorized 8400 8420 18 1.9 534.0 0.7X
-Native ORC Vectorized (Pushdown) 843 862 14 18.7 53.6 6.8X
+Parquet Vectorized 5479 5491 18 2.9 348.3 1.0X
+Parquet Vectorized (Pushdown) 208 222 11 75.7 13.2 26.4X
+Native ORC Vectorized 6230 6242 13 2.5 396.1 0.9X
+Native ORC Vectorized (Pushdown) 900 904 7 17.5 57.2 6.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5644 5663 16 2.8 358.8 1.0X
-Parquet Vectorized (Pushdown) 248 257 8 63.5 15.8 22.8X
-Native ORC Vectorized 8364 8388 32 1.9 531.8 0.7X
-Native ORC Vectorized (Pushdown) 898 906 8 17.5 57.1 6.3X
+Parquet Vectorized 5397 5434 67 2.9 343.1 1.0X
+Parquet Vectorized (Pushdown) 251 273 17 62.8 15.9 21.5X
+Native ORC Vectorized 6187 6225 48 2.5 393.3 0.9X
+Native ORC Vectorized (Pushdown) 934 951 16 16.8 59.4 5.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5656 5668 10 2.8 359.6 1.0X
-Parquet Vectorized (Pushdown) 246 250 4 63.9 15.6 23.0X
-Native ORC Vectorized 8336 8349 13 1.9 530.0 0.7X
-Native ORC Vectorized (Pushdown) 879 894 10 17.9 55.9 6.4X
+Parquet Vectorized 5397 5414 10 2.9 343.1 1.0X
+Parquet Vectorized (Pushdown) 271 315 68 58.1 17.2 19.9X
+Native ORC Vectorized 6206 6221 16 2.5 394.6 0.9X
+Native ORC Vectorized (Pushdown) 925 931 3 17.0 58.8 5.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5758 5763 5 2.7 366.1 1.0X
-Parquet Vectorized (Pushdown) 247 252 4 63.6 15.7 23.3X
-Native ORC Vectorized 8398 8442 32 1.9 533.9 0.7X
-Native ORC Vectorized (Pushdown) 896 903 7 17.6 57.0 6.4X
+Parquet Vectorized 5486 5497 12 2.9 348.8 1.0X
+Parquet Vectorized (Pushdown) 254 264 9 62.0 16.1 21.6X
+Native ORC Vectorized 6246 6272 19 2.5 397.1 0.9X
+Native ORC Vectorized (Pushdown) 935 958 29 16.8 59.4 5.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 12870 12960 99 1.2 818.2 1.0X
-Parquet Vectorized (Pushdown) 12923 12937 14 1.2 821.6 1.0X
-Native ORC Vectorized 15635 15671 23 1.0 994.0 0.8X
-Native ORC Vectorized (Pushdown) 15933 15960 23 1.0 1013.0 0.8X
+Parquet Vectorized 11760 11813 38 1.3 747.7 1.0X
+Parquet Vectorized (Pushdown) 11729 11761 49 1.3 745.7 1.0X
+Native ORC Vectorized 13965 14180 169 1.1 887.9 0.8X
+Native ORC Vectorized (Pushdown) 14779 14998 178 1.1 939.6 0.8X
================================================================================================
Pushdown benchmark for StringStartsWith
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 7008 7221 212 2.2 445.5 1.0X
-Parquet Vectorized (Pushdown) 960 977 25 16.4 61.0 7.3X
-Native ORC Vectorized 7499 7570 65 2.1 476.8 0.9X
-Native ORC Vectorized (Pushdown) 7600 7628 37 2.1 483.2 0.9X
+Parquet Vectorized 6784 6853 66 2.3 431.3 1.0X
+Parquet Vectorized (Pushdown) 855 910 57 18.4 54.4 7.9X
+Native ORC Vectorized 5741 5816 64 2.7 365.0 1.2X
+Native ORC Vectorized (Pushdown) 5678 5797 81 2.8 361.0 1.2X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6718 6731 17 2.3 427.1 1.0X
-Parquet Vectorized (Pushdown) 251 259 4 62.6 16.0 26.7X
-Native ORC Vectorized 7306 7323 21 2.2 464.5 0.9X
-Native ORC Vectorized (Pushdown) 7413 7433 17 2.1 471.3 0.9X
+Parquet Vectorized 6516 6533 12 2.4 414.3 1.0X
+Parquet Vectorized (Pushdown) 254 270 17 61.9 16.2 25.6X
+Native ORC Vectorized 5271 5324 40 3.0 335.1 1.2X
+Native ORC Vectorized (Pushdown) 5173 5308 115 3.0 328.9 1.3X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6723 6729 5 2.3 427.4 1.0X
-Parquet Vectorized (Pushdown) 235 255 16 66.9 15.0 28.6X
-Native ORC Vectorized 7301 7326 17 2.2 464.2 0.9X
-Native ORC Vectorized (Pushdown) 7396 7420 30 2.1 470.2 0.9X
+Parquet Vectorized 6412 6431 24 2.5 407.7 1.0X
+Parquet Vectorized (Pushdown) 235 242 5 66.9 14.9 27.3X
+Native ORC Vectorized 5068 5206 157 3.1 322.2 1.3X
+Native ORC Vectorized (Pushdown) 5139 5155 14 3.1 326.7 1.2X
================================================================================================
Pushdown benchmark for StringEndsWith
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringEndsWith filter: (value like '%10'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5893 6058 178 2.7 374.7 1.0X
-Parquet Vectorized (Pushdown) 453 503 63 34.7 28.8 13.0X
-Native ORC Vectorized 8333 8385 76 1.9 529.8 0.7X
-Native ORC Vectorized (Pushdown) 8576 8630 43 1.8 545.3 0.7X
+Parquet Vectorized 5669 5828 139 2.8 360.4 1.0X
+Parquet Vectorized (Pushdown) 395 414 18 39.8 25.1 14.4X
+Native ORC Vectorized 6255 6272 19 2.5 397.7 0.9X
+Native ORC Vectorized (Pushdown) 6397 6410 12 2.5 406.7 0.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringEndsWith filter: (value like '%1000'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5719 5754 29 2.8 363.6 1.0X
-Parquet Vectorized (Pushdown) 251 267 15 62.7 15.9 22.8X
-Native ORC Vectorized 8256 8276 16 1.9 524.9 0.7X
-Native ORC Vectorized (Pushdown) 8540 8576 29 1.8 542.9 0.7X
+Parquet Vectorized 5419 5429 9 2.9 344.5 1.0X
+Parquet Vectorized (Pushdown) 260 276 14 60.5 16.5 20.8X
+Native ORC Vectorized 6195 6223 35 2.5 393.8 0.9X
+Native ORC Vectorized (Pushdown) 6519 6706 118 2.4 414.4 0.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringEndsWith filter: (value like '%786432'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5666 5698 22 2.8 360.2 1.0X
-Parquet Vectorized (Pushdown) 253 270 20 62.1 16.1 22.4X
-Native ORC Vectorized 8236 8261 21 1.9 523.6 0.7X
-Native ORC Vectorized (Pushdown) 8600 8616 22 1.8 546.8 0.7X
+Parquet Vectorized 5401 5413 8 2.9 343.4 1.0X
+Parquet Vectorized (Pushdown) 249 268 23 63.3 15.8 21.7X
+Native ORC Vectorized 6177 6183 7 2.5 392.7 0.9X
+Native ORC Vectorized (Pushdown) 7467 7553 141 2.1 474.7 0.7X
================================================================================================
Pushdown benchmark for StringContains
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringContains filter: (value like '%10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6068 6240 126 2.6 385.8 1.0X
-Parquet Vectorized (Pushdown) 877 910 37 17.9 55.8 6.9X
-Native ORC Vectorized 8457 8509 44 1.9 537.7 0.7X
-Native ORC Vectorized (Pushdown) 8721 8783 44 1.8 554.5 0.7X
+Parquet Vectorized 5852 6100 222 2.7 372.1 1.0X
+Parquet Vectorized (Pushdown) 839 899 53 18.8 53.3 7.0X
+Native ORC Vectorized 7383 7538 125 2.1 469.4 0.8X
+Native ORC Vectorized (Pushdown) 7667 7872 159 2.1 487.5 0.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringContains filter: (value like '%1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5705 5762 50 2.8 362.7 1.0X
-Parquet Vectorized (Pushdown) 243 276 23 64.8 15.4 23.5X
-Native ORC Vectorized 8189 8238 53 1.9 520.7 0.7X
-Native ORC Vectorized (Pushdown) 8491 8531 36 1.9 539.8 0.7X
+Parquet Vectorized 5501 5540 27 2.9 349.7 1.0X
+Parquet Vectorized (Pushdown) 268 286 16 58.6 17.1 20.5X
+Native ORC Vectorized 7027 7112 58 2.2 446.7 0.8X
+Native ORC Vectorized (Pushdown) 6321 6345 26 2.5 401.8 0.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
StringContains filter: (value like '%786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5657 5683 17 2.8 359.7 1.0X
-Parquet Vectorized (Pushdown) 242 253 6 64.9 15.4 23.4X
-Native ORC Vectorized 8180 8201 18 1.9 520.1 0.7X
-Native ORC Vectorized (Pushdown) 8544 8562 24 1.8 543.2 0.7X
+Parquet Vectorized 5390 5439 56 2.9 342.7 1.0X
+Parquet Vectorized (Pushdown) 250 277 27 62.9 15.9 21.5X
+Native ORC Vectorized 6128 6157 28 2.6 389.6 0.9X
+Native ORC Vectorized (Pushdown) 6298 6322 24 2.5 400.4 0.9X
================================================================================================
Pushdown benchmark for decimal
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 2464 2482 18 6.4 156.7 1.0X
-Parquet Vectorized (Pushdown) 68 88 17 230.1 4.3 36.0X
-Native ORC Vectorized 3692 3718 25 4.3 234.7 0.7X
-Native ORC Vectorized (Pushdown) 61 69 8 257.5 3.9 40.3X
+Parquet Vectorized 2399 2430 24 6.6 152.5 1.0X
+Parquet Vectorized (Pushdown) 66 82 17 240.1 4.2 36.6X
+Native ORC Vectorized 3131 3149 25 5.0 199.0 0.8X
+Native ORC Vectorized (Pushdown) 58 66 7 273.1 3.7 41.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 3602 3616 11 4.4 229.0 1.0X
-Parquet Vectorized (Pushdown) 1643 1658 9 9.6 104.5 2.2X
-Native ORC Vectorized 5031 5040 12 3.1 319.9 0.7X
-Native ORC Vectorized (Pushdown) 2080 2094 10 7.6 132.2 1.7X
+Parquet Vectorized 3517 3562 46 4.5 223.6 1.0X
+Parquet Vectorized (Pushdown) 1638 1653 14 9.6 104.1 2.1X
+Native ORC Vectorized 4376 4397 30 3.6 278.2 0.8X
+Native ORC Vectorized (Pushdown) 1913 1927 20 8.2 121.6 1.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 7284 7316 28 2.2 463.1 1.0X
-Parquet Vectorized (Pushdown) 6977 6988 12 2.3 443.6 1.0X
-Native ORC Vectorized 9436 9480 50 1.7 599.9 0.8X
-Native ORC Vectorized (Pushdown) 8932 8962 31 1.8 567.9 0.8X
+Parquet Vectorized 7145 7165 18 2.2 454.3 1.0X
+Parquet Vectorized (Pushdown) 6858 6878 17 2.3 436.0 1.0X
+Native ORC Vectorized 8642 8697 98 1.8 549.5 0.8X
+Native ORC Vectorized (Pushdown) 8334 8351 17 1.9 529.9 0.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 8297 8307 11 1.9 527.5 1.0X
-Parquet Vectorized (Pushdown) 8340 8355 14 1.9 530.2 1.0X
-Native ORC Vectorized 10148 10214 43 1.5 645.2 0.8X
-Native ORC Vectorized (Pushdown) 10163 10210 61 1.5 646.1 0.8X
+Parquet Vectorized 8037 8063 24 2.0 511.0 1.0X
+Parquet Vectorized (Pushdown) 8067 8094 30 1.9 512.9 1.0X
+Native ORC Vectorized 9665 9685 16 1.6 614.5 0.8X
+Native ORC Vectorized (Pushdown) 9798 9849 41 1.6 623.0 0.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 2629 2642 9 6.0 167.2 1.0X
-Parquet Vectorized (Pushdown) 63 72 13 251.3 4.0 42.0X
-Native ORC Vectorized 3751 3775 34 4.2 238.5 0.7X
-Native ORC Vectorized (Pushdown) 57 65 8 277.9 3.6 46.5X
+Parquet Vectorized 2650 2672 27 5.9 168.5 1.0X
+Parquet Vectorized (Pushdown) 62 70 10 253.1 4.0 42.6X
+Native ORC Vectorized 3181 3202 26 4.9 202.2 0.8X
+Native ORC Vectorized (Pushdown) 55 63 6 287.6 3.5 48.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 3244 3279 54 4.8 206.3 1.0X
-Parquet Vectorized (Pushdown) 909 932 22 17.3 57.8 3.6X
-Native ORC Vectorized 4391 4412 17 3.6 279.2 0.7X
-Native ORC Vectorized (Pushdown) 1056 1067 11 14.9 67.1 3.1X
+Parquet Vectorized 3254 3305 73 4.8 206.9 1.0X
+Parquet Vectorized (Pushdown) 931 945 12 16.9 59.2 3.5X
+Native ORC Vectorized 3783 3803 19 4.2 240.5 0.9X
+Native ORC Vectorized (Pushdown) 954 975 24 16.5 60.7 3.4X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 5593 5602 6 2.8 355.6 1.0X
-Parquet Vectorized (Pushdown) 4337 4354 17 3.6 275.8 1.3X
-Native ORC Vectorized 6914 6923 9 2.3 439.6 0.8X
-Native ORC Vectorized (Pushdown) 5069 5090 26 3.1 322.3 1.1X
+Parquet Vectorized 5649 5660 6 2.8 359.2 1.0X
+Parquet Vectorized (Pushdown) 4392 4412 21 3.6 279.3 1.3X
+Native ORC Vectorized 6152 6161 6 2.6 391.1 0.9X
+Native ORC Vectorized (Pushdown) 4552 4568 19 3.5 289.4 1.2X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 7837 7855 34 2.0 498.3 1.0X
-Parquet Vectorized (Pushdown) 7559 7612 49 2.1 480.6 1.0X
-Native ORC Vectorized 9464 9474 15 1.7 601.7 0.8X
-Native ORC Vectorized (Pushdown) 9134 9202 119 1.7 580.7 0.9X
+Parquet Vectorized 7937 7962 40 2.0 504.6 1.0X
+Parquet Vectorized (Pushdown) 7661 7697 46 2.1 487.1 1.0X
+Native ORC Vectorized 8633 8665 25 1.8 548.9 0.9X
+Native ORC Vectorized (Pushdown) 8296 8311 14 1.9 527.4 1.0X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 3799 3823 28 4.1 241.5 1.0X
-Parquet Vectorized (Pushdown) 68 71 5 232.0 4.3 56.0X
-Native ORC Vectorized 3709 3721 9 4.2 235.8 1.0X
-Native ORC Vectorized (Pushdown) 54 60 6 288.9 3.5 69.8X
+Parquet Vectorized 3699 3713 14 4.3 235.2 1.0X
+Parquet Vectorized (Pushdown) 67 71 7 234.7 4.3 55.2X
+Native ORC Vectorized 3177 3192 19 5.0 202.0 1.2X
+Native ORC Vectorized (Pushdown) 53 57 5 296.0 3.4 69.6X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 4714 4767 68 3.3 299.7 1.0X
-Parquet Vectorized (Pushdown) 1255 1274 15 12.5 79.8 3.8X
-Native ORC Vectorized 4555 4564 6 3.5 289.6 1.0X
-Native ORC Vectorized (Pushdown) 1205 1219 15 13.1 76.6 3.9X
+Parquet Vectorized 4523 4568 83 3.5 287.6 1.0X
+Parquet Vectorized (Pushdown) 1226 1235 7 12.8 78.0 3.7X
+Native ORC Vectorized 3929 3956 38 4.0 249.8 1.2X
+Native ORC Vectorized (Pushdown) 1098 1106 6 14.3 69.8 4.1X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 7818 7851 33 2.0 497.0 1.0X
-Parquet Vectorized (Pushdown) 5988 6007 18 2.6 380.7 1.3X
-Native ORC Vectorized 7704 7733 22 2.0 489.8 1.0X
-Native ORC Vectorized (Pushdown) 5832 5840 6 2.7 370.8 1.3X
+Parquet Vectorized 7733 7741 5 2.0 491.6 1.0X
+Parquet Vectorized (Pushdown) 5937 5959 23 2.6 377.4 1.3X
+Native ORC Vectorized 6909 6913 4 2.3 439.2 1.1X
+Native ORC Vectorized (Pushdown) 5286 5293 8 3.0 336.1 1.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 10998 11020 27 1.4 699.2 1.0X
-Parquet Vectorized (Pushdown) 10657 10675 26 1.5 677.6 1.0X
-Native ORC Vectorized 10900 10917 12 1.4 693.0 1.0X
-Native ORC Vectorized (Pushdown) 10551 10654 141 1.5 670.8 1.0X
+Parquet Vectorized 10916 10947 34 1.4 694.0 1.0X
+Parquet Vectorized (Pushdown) 10577 10588 8 1.5 672.5 1.0X
+Native ORC Vectorized 9997 10028 33 1.6 635.6 1.1X
+Native ORC Vectorized (Pushdown) 9623 9637 9 1.6 611.8 1.1X
================================================================================================
Pushdown benchmark for InSet -> InFilters
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6434 6488 65 2.4 409.0 1.0X
-Parquet Vectorized (Pushdown) 253 260 5 62.1 16.1 25.4X
-Native ORC Vectorized 6805 6857 47 2.3 432.6 0.9X
-Native ORC Vectorized (Pushdown) 291 311 29 54.0 18.5 22.1X
+Parquet Vectorized 6258 6286 27 2.5 397.8 1.0X
+Parquet Vectorized (Pushdown) 251 281 26 62.6 16.0 24.9X
+Native ORC Vectorized 4559 4669 109 3.4 289.9 1.4X
+Native ORC Vectorized (Pushdown) 282 302 21 55.9 17.9 22.2X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6435 6458 25 2.4 409.1 1.0X
-Parquet Vectorized (Pushdown) 249 254 3 63.2 15.8 25.9X
-Native ORC Vectorized 6793 6827 22 2.3 431.9 0.9X
-Native ORC Vectorized (Pushdown) 274 282 5 57.4 17.4 23.5X
+Parquet Vectorized 6098 6113 15 2.6 387.7 1.0X
+Parquet Vectorized (Pushdown) 246 253 4 63.9 15.6 24.8X
+Native ORC Vectorized 4549 4575 23 3.5 289.2 1.3X
+Native ORC Vectorized (Pushdown) 291 300 8 54.1 18.5 21.0X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6419 6435 11 2.5 408.1 1.0X
-Parquet Vectorized (Pushdown) 249 254 5 63.2 15.8 25.8X
-Native ORC Vectorized 6772 6788 13 2.3 430.5 0.9X
-Native ORC Vectorized (Pushdown) 275 283 7 57.2 17.5 23.3X
+Parquet Vectorized 6089 6112 14 2.6 387.1 1.0X
+Parquet Vectorized (Pushdown) 249 254 3 63.1 15.9 24.4X
+Native ORC Vectorized 4540 4550 7 3.5 288.7 1.3X
+Native ORC Vectorized (Pushdown) 279 294 11 56.4 17.7 21.8X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6414 6431 11 2.5 407.8 1.0X
-Parquet Vectorized (Pushdown) 265 271 5 59.4 16.8 24.2X
-Native ORC Vectorized 6773 6794 32 2.3 430.6 0.9X
-Native ORC Vectorized (Pushdown) 298 301 2 52.8 18.9 21.5X
+Parquet Vectorized 6096 6122 17 2.6 387.5 1.0X
+Parquet Vectorized (Pushdown) 266 271 4 59.2 16.9 22.9X
+Native ORC Vectorized 4567 4578 15 3.4 290.3 1.3X
+Native ORC Vectorized (Pushdown) 295 303 7 53.4 18.7 20.7X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6448 6468 22 2.4 409.9 1.0X
-Parquet Vectorized (Pushdown) 266 270 3 59.2 16.9 24.3X
-Native ORC Vectorized 6780 6790 10 2.3 431.1 1.0X
-Native ORC Vectorized (Pushdown) 304 307 2 51.7 19.3 21.2X
+Parquet Vectorized 6103 6131 26 2.6 388.0 1.0X
+Parquet Vectorized (Pushdown) 280 282 1 56.1 17.8 21.8X
+Native ORC Vectorized 4575 4589 9 3.4 290.9 1.3X
+Native ORC Vectorized (Pushdown) 292 300 6 53.9 18.6 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6440 6458 19 2.4 409.4 1.0X
-Parquet Vectorized (Pushdown) 273 275 3 57.7 17.3 23.6X
-Native ORC Vectorized 6784 6807 18 2.3 431.3 0.9X
-Native ORC Vectorized (Pushdown) 303 306 2 51.8 19.3 21.2X
+Parquet Vectorized 6107 6115 9 2.6 388.3 1.0X
+Parquet Vectorized (Pushdown) 266 270 3 59.2 16.9 23.0X
+Native ORC Vectorized 4573 4583 12 3.4 290.7 1.3X
+Native ORC Vectorized (Pushdown) 293 301 7 53.8 18.6 20.9X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6621 6642 26 2.4 421.0 1.0X
-Parquet Vectorized (Pushdown) 854 858 5 18.4 54.3 7.8X
-Native ORC Vectorized 6976 6989 13 2.3 443.5 0.9X
-Native ORC Vectorized (Pushdown) 453 458 3 34.7 28.8 14.6X
+Parquet Vectorized 6297 6319 15 2.5 400.4 1.0X
+Parquet Vectorized (Pushdown) 844 847 2 18.6 53.6 7.5X
+Native ORC Vectorized 4761 4767 6 3.3 302.7 1.3X
+Native ORC Vectorized (Pushdown) 382 387 4 41.1 24.3 16.5X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6616 6630 19 2.4 420.6 1.0X
-Parquet Vectorized (Pushdown) 3434 3441 12 4.6 218.3 1.9X
-Native ORC Vectorized 6992 6996 4 2.2 444.6 0.9X
-Native ORC Vectorized (Pushdown) 497 501 3 31.7 31.6 13.3X
+Parquet Vectorized 6293 6309 11 2.5 400.1 1.0X
+Parquet Vectorized (Pushdown) 3247 3256 8 4.8 206.4 1.9X
+Native ORC Vectorized 4785 4797 12 3.3 304.2 1.3X
+Native ORC Vectorized (Pushdown) 414 420 6 38.0 26.3 15.2X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6601 6633 26 2.4 419.7 1.0X
-Parquet Vectorized (Pushdown) 5923 5947 16 2.7 376.6 1.1X
-Native ORC Vectorized 6976 6984 5 2.3 443.5 0.9X
-Native ORC Vectorized (Pushdown) 513 515 3 30.7 32.6 12.9X
+Parquet Vectorized 6304 6314 6 2.5 400.8 1.0X
+Parquet Vectorized (Pushdown) 5548 5564 13 2.8 352.7 1.1X
+Native ORC Vectorized 4768 4785 31 3.3 303.1 1.3X
+Native ORC Vectorized (Pushdown) 419 421 2 37.5 26.7 15.0X
-OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
-Parquet Vectorized 6568 6590 35 2.4 417.6 1.0X
-Parquet Vectorized (Pushdown) 871 875 3 18.1 55.4 7.5X
-Native ORC Vectorized 6956 6967 11 2.3 442.3 0.9X
-Native ORC Vectorized (Pushdown) 616 624 7 25.5 39.2 10.7X
+Parquet Vectorized 6275 6286 8 2.5 398.9 1.0X
+Parquet Vectorized (Pushdown) 839 843 3 18.8 53.3 7.5X
+Native ORC Vectorized 4747 4763 17 3.3 301.8 1.3X
+Native ORC Vectorized (Pushdown) 474 479 5 33.2 30.1 13.2X
Review Comment:
InFilters seems to be improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1535004974
##########
sql/core/benchmarks/MakeDateTimeBenchmark-jdk21-results.txt:
##########
@@ -1,22 +1,22 @@
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-prepare make_date() 2004 2018 13 49.9 20.0 1.0X
-make_date(2019, 9, 16) 2694 2737 52 37.1 26.9 0.7X
-make_date(*, *, *) 3881 3906 37 25.8 38.8 0.5X
+prepare make_date() 1981 2010 32 50.5 19.8 1.0X
+make_date(2019, 9, 16) 1833 1849 14 54.5 18.3 1.1X
Review Comment:
`make_date` seems to be improved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47513][TESTS] Regenerate benchmark results [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on code in PR #45654:
URL: https://github.com/apache/spark/pull/45654#discussion_r1534947765
##########
sql/hive/benchmarks/OrcReadBenchmark-jdk21-results.txt:
##########
@@ -2,221 +2,221 @@
SQL Single Numeric Column Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 640 693 75 24.6 40.7 1.0X
-Native ORC MR 719 733 24 21.9 45.7 0.9X
-Native ORC Vectorized 90 112 15 175.3 5.7 7.1X
+Hive built-in ORC 662 691 46 23.8 42.1 1.0X
+Native ORC MR 784 812 28 20.1 49.9 0.8X
+Native ORC Vectorized 92 120 35 171.5 5.8 7.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 633 698 79 24.9 40.2 1.0X
-Native ORC MR 726 757 32 21.7 46.1 0.9X
-Native ORC Vectorized 74 91 12 212.5 4.7 8.5X
+Hive built-in ORC 692 724 31 22.7 44.0 1.0X
+Native ORC MR 789 803 15 19.9 50.1 0.9X
+Native ORC Vectorized 73 94 17 214.7 4.7 9.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 732 737 5 21.5 46.5 1.0X
-Native ORC MR 832 872 38 18.9 52.9 0.9X
-Native ORC Vectorized 94 116 29 168.0 6.0 7.8X
+Hive built-in ORC 685 708 21 23.0 43.5 1.0X
+Native ORC MR 811 854 40 19.4 51.5 0.8X
+Native ORC Vectorized 79 94 18 199.8 5.0 8.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 763 778 18 20.6 48.5 1.0X
-Native ORC MR 844 858 14 18.6 53.7 0.9X
-Native ORC Vectorized 110 134 26 143.5 7.0 7.0X
+Hive built-in ORC 733 771 39 21.5 46.6 1.0X
+Native ORC MR 803 819 15 19.6 51.1 0.9X
+Native ORC Vectorized 113 128 16 138.8 7.2 6.5X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 852 871 16 18.5 54.2 1.0X
-Native ORC MR 848 853 4 18.6 53.9 1.0X
-Native ORC Vectorized 163 178 24 96.6 10.4 5.2X
+Hive built-in ORC 804 815 15 19.6 51.1 1.0X
+Native ORC MR 873 904 27 18.0 55.5 0.9X
+Native ORC Vectorized 138 169 29 114.2 8.8 5.8X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 860 885 27 18.3 54.7 1.0X
-Native ORC MR 948 968 31 16.6 60.3 0.9X
-Native ORC Vectorized 242 258 15 65.0 15.4 3.6X
+Hive built-in ORC 812 825 12 19.4 51.6 1.0X
+Native ORC MR 934 943 13 16.8 59.4 0.9X
+Native ORC Vectorized 188 213 24 83.6 12.0 4.3X
================================================================================================
Int and String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1814 1836 31 5.8 173.0 1.0X
-Native ORC MR 1573 1633 84 6.7 150.0 1.2X
-Native ORC Vectorized 763 775 10 13.7 72.8 2.4X
+Hive built-in ORC 1547 1557 15 6.8 147.5 1.0X
+Native ORC MR 1469 1478 13 7.1 140.1 1.1X
+Native ORC Vectorized 573 601 32 18.3 54.6 2.7X
================================================================================================
Partitioned Table Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Data column - Hive built-in ORC 1028 1035 9 15.3 65.4 1.0X
-Data column - Native ORC MR 1016 1023 10 15.5 64.6 1.0X
-Data column - Native ORC Vectorized 110 135 11 143.4 7.0 9.4X
-Partition column - Hive built-in ORC 665 677 19 23.7 42.3 1.5X
-Partition column - Native ORC MR 553 573 23 28.4 35.2 1.9X
-Partition column - Native ORC Vectorized 32 43 8 491.4 2.0 32.1X
-Both columns - Hive built-in ORC 919 939 33 17.1 58.4 1.1X
-Both columns - Native ORC MR 1032 1040 12 15.2 65.6 1.0X
-Both columns - Native ORC Vectorized 121 144 21 129.8 7.7 8.5X
+Data column - Hive built-in ORC 827 859 48 19.0 52.6 1.0X
+Data column - Native ORC MR 977 1025 77 16.1 62.1 0.8X
+Data column - Native ORC Vectorized 109 124 15 144.3 6.9 7.6X
+Partition column - Hive built-in ORC 702 715 12 22.4 44.6 1.2X
+Partition column - Native ORC MR 556 562 9 28.3 35.3 1.5X
+Partition column - Native ORC Vectorized 31 41 8 510.7 2.0 26.8X
+Both columns - Hive built-in ORC 888 933 40 17.7 56.5 0.9X
+Both columns - Native ORC MR 1076 1083 10 14.6 68.4 0.8X
+Both columns - Native ORC Vectorized 126 144 17 125.3 8.0 6.6X
================================================================================================
Repeated String Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 873 890 21 12.0 83.3 1.0X
-Native ORC MR 789 858 75 13.3 75.3 1.1X
-Native ORC Vectorized 121 134 16 86.8 11.5 7.2X
+Hive built-in ORC 832 886 48 12.6 79.3 1.0X
+Native ORC MR 821 825 6 12.8 78.3 1.0X
+Native ORC Vectorized 173 189 14 60.7 16.5 4.8X
================================================================================================
String with Nulls Scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1723 1732 13 6.1 164.3 1.0X
-Native ORC MR 1311 1327 23 8.0 125.0 1.3X
-Native ORC Vectorized 370 377 6 28.4 35.3 4.7X
+Hive built-in ORC 1421 1433 16 7.4 135.6 1.0X
+Native ORC MR 1205 1215 14 8.7 114.9 1.2X
+Native ORC Vectorized 285 314 29 36.8 27.2 5.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1297 1327 43 8.1 123.7 1.0X
-Native ORC MR 1145 1156 15 9.2 109.2 1.1X
-Native ORC Vectorized 391 419 19 26.8 37.3 3.3X
+Hive built-in ORC 1261 1273 17 8.3 120.3 1.0X
+Native ORC MR 1121 1131 14 9.4 106.9 1.1X
+Native ORC Vectorized 341 357 13 30.8 32.5 3.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 741 766 21 14.1 70.7 1.0X
-Native ORC MR 743 751 8 14.1 70.9 1.0X
-Native ORC Vectorized 154 175 20 67.9 14.7 4.8X
+Hive built-in ORC 840 842 2 12.5 80.1 1.0X
+Native ORC MR 750 751 1 14.0 71.5 1.1X
+Native ORC Vectorized 144 160 9 72.7 13.8 5.8X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 571 611 43 1.8 544.5 1.0X
-Native ORC MR 91 102 8 11.5 86.8 6.3X
-Native ORC Vectorized 39 48 6 27.0 37.0 14.7X
+Hive built-in ORC 669 688 23 1.6 638.3 1.0X
+Native ORC MR 85 100 13 12.3 81.4 7.8X
+Native ORC Vectorized 36 46 9 29.3 34.1 18.7X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1066 1076 15 1.0 1016.6 1.0X
-Native ORC MR 102 114 9 10.3 96.9 10.5X
-Native ORC Vectorized 50 63 8 21.0 47.7 21.3X
+Hive built-in ORC 1221 1230 13 0.9 1164.4 1.0X
+Native ORC MR 100 111 12 10.5 95.7 12.2X
+Native ORC Vectorized 50 68 11 20.9 47.8 24.4X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 1532 1562 42 0.7 1461.1 1.0X
-Native ORC MR 114 124 7 9.2 109.0 13.4X
-Native ORC Vectorized 62 72 9 17.0 59.0 24.8X
+Hive built-in ORC 1834 1884 70 0.6 1749.1 1.0X
+Native ORC MR 112 135 23 9.3 107.2 16.3X
+Native ORC Vectorized 61 70 8 17.3 58.0 30.2X
================================================================================================
Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 447 499 32 2.3 425.8 1.0X
-Native ORC MR 224 267 41 4.7 213.7 2.0X
-Native ORC Vectorized 99 115 21 10.6 94.5 4.5X
+Hive built-in ORC 279 338 41 3.8 266.0 1.0X
+Native ORC MR 220 268 44 4.8 209.8 1.3X
+Native ORC Vectorized 97 115 18 10.8 92.5 2.9X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 100 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3468 3546 110 0.3 3307.7 1.0X
-Native ORC MR 1623 1655 47 0.6 1547.4 2.1X
-Native ORC Vectorized 795 868 85 1.3 757.8 4.4X
+Hive built-in ORC 1869 1890 29 0.6 1782.7 1.0X
+Native ORC MR 1684 1729 64 0.6 1606.4 1.1X
+Native ORC Vectorized 869 913 56 1.2 828.5 2.2X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 300 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9046 9092 66 0.1 8626.7 1.0X
-Native ORC MR 6233 6397 232 0.2 5944.5 1.5X
-Native ORC Vectorized 5378 5407 41 0.2 5129.1 1.7X
+Hive built-in ORC 5329 5433 148 0.2 5082.1 1.0X
+Native ORC MR 5514 5545 43 0.2 5259.0 1.0X
+Native ORC Vectorized 5450 5502 74 0.2 5197.3 1.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Single Struct Column Scan with 600 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 22437 22692 361 0.0 21397.7 1.0X
-Native ORC MR 12624 12694 99 0.1 12039.1 1.8X
-Native ORC Vectorized 12680 12860 255 0.1 12092.1 1.8X
+Hive built-in ORC 11352 11377 36 0.1 10826.0 1.0X
+Native ORC MR 12781 12796 22 0.1 12188.7 0.9X
+Native ORC Vectorized 12673 12779 151 0.1 12085.7 0.9X
================================================================================================
Nested Struct scan
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 3599 3644 64 0.3 3432.4 1.0X
-Native ORC MR 1912 1953 58 0.5 1823.8 1.9X
-Native ORC Vectorized 603 629 35 1.7 574.7 6.0X
+Hive built-in ORC 1793 1818 36 0.6 1710.3 1.0X
+Native ORC MR 2053 2069 22 0.5 1958.2 0.9X
+Native ORC Vectorized 539 569 37 1.9 513.7 3.3X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 30 Elements, 10 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9213 9334 171 0.1 8786.1 1.0X
-Native ORC MR 4514 4529 20 0.2 4305.0 2.0X
-Native ORC Vectorized 1521 1550 41 0.7 1450.8 6.1X
+Hive built-in ORC 4477 4533 78 0.2 4270.0 1.0X
+Native ORC MR 4467 4484 25 0.2 4259.6 1.0X
+Native ORC Vectorized 1470 1490 29 0.7 1402.0 3.0X
-OpenJDK 64-Bit Server VM 21.0.1+12-LTS on Linux 5.15.0-1053-azure
+OpenJDK 64-Bit Server VM 21.0.2+13-LTS on Linux 6.5.0-1016-azure
AMD EPYC 7763 64-Core Processor
Nested Struct Scan with 10 Elements, 30 Fields: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
-Hive built-in ORC 9739 9740 2 0.1 9287.4 1.0X
-Native ORC MR 5553 5613 84 0.2 5296.0 1.8X
-Native ORC Vectorized 2090 2108 26 0.5 1993.1 4.7X
+Hive built-in ORC 4417 4430 19 0.2 4212.1 1.0X
+Native ORC MR 5039 5069 42 0.2 4805.9 0.9X
+Native ORC Vectorized 1726 1737 16 0.6 1645.8 2.6X
Review Comment:
The new ratio shows that all performance improved in nested struct scan. `Hive built-in ORC` is the most improved one.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org