You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zclllyybb (via GitHub)" <gi...@apache.org> on 2025/12/03 11:37:06 UTC
[PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
zclllyybb opened a new pull request, #58691:
URL: https://github.com/apache/doris/pull/58691
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb merged PR #58691:
URL: https://github.com/apache/doris/pull/58691
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606442161
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606582787
<details>
<summary>TPC-H: <b>Total hot run time: 34818 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e0fe4417394ad09e3a8a7416ad748f54a89d9c02, data reload: false
------ Round 1 ----------------------------------
q1 17638 5097 4961 4961
q2 2040 321 201 201
q3 10248 1325 761 761
q4 10211 800 329 329
q5 7538 2458 2167 2167
q6 195 174 142 142
q7 970 794 642 642
q8 9353 1436 1195 1195
q9 7013 5370 5388 5370
q10 6849 2181 1765 1765
q11 521 314 275 275
q12 342 375 230 230
q13 18447 3684 3135 3135
q14 240 247 234 234
q15 592 520 508 508
q16 903 872 824 824
q17 713 878 502 502
q18 7671 7222 7124 7124
q19 1206 973 638 638
q20 379 360 245 245
q21 4122 3769 2620 2620
q22 1033 1024 950 950
Total cold run time: 108224 ms
Total hot run time: 34818 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5087 4981 4981 4981
q2 334 384 312 312
q3 2189 2713 2332 2332
q4 1336 1724 1283 1283
q5 4354 4573 4558 4558
q6 225 180 136 136
q7 2037 1957 1833 1833
q8 2774 2522 2610 2522
q9 7554 7489 7384 7384
q10 3125 3213 2854 2854
q11 604 528 499 499
q12 689 767 608 608
q13 3602 3936 3306 3306
q14 282 321 288 288
q15 554 508 514 508
q16 909 932 889 889
q17 1236 1428 1460 1428
q18 8040 7562 7643 7562
q19 895 872 871 871
q20 1901 1946 1824 1824
q21 4757 4267 4165 4165
q22 1138 1028 954 954
Total cold run time: 53622 ms
Total hot run time: 51097 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606442055
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606642174
<details>
<summary>ClickBench: <b>Total hot run time: 27.12 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e0fe4417394ad09e3a8a7416ad748f54a89d9c02, data reload: false
query1 0.06 0.05 0.04
query2 0.10 0.06 0.05
query3 0.26 0.09 0.08
query4 1.61 0.11 0.10
query5 0.29 0.27 0.26
query6 1.16 0.64 0.64
query7 0.04 0.03 0.03
query8 0.05 0.04 0.04
query9 0.57 0.49 0.51
query10 0.56 0.55 0.55
query11 0.17 0.11 0.11
query12 0.14 0.11 0.11
query13 0.63 0.61 0.60
query14 1.00 0.98 0.98
query15 0.83 0.81 0.80
query16 0.41 0.39 0.39
query17 1.08 1.04 0.99
query18 0.24 0.21 0.22
query19 1.90 1.81 1.79
query20 0.02 0.01 0.01
query21 15.47 0.29 0.13
query22 4.86 0.05 0.05
query23 15.94 0.30 0.10
query24 1.21 0.24 0.19
query25 0.08 0.05 0.06
query26 0.15 0.13 0.13
query27 0.08 0.05 0.04
query28 3.44 1.22 1.02
query29 12.60 3.98 3.20
query30 0.27 0.14 0.11
query31 2.81 0.62 0.39
query32 3.25 0.56 0.48
query33 3.05 3.02 3.13
query34 16.69 5.19 4.55
query35 4.53 4.59 4.55
query36 0.68 0.50 0.51
query37 0.10 0.07 0.06
query38 0.07 0.04 0.04
query39 0.05 0.03 0.03
query40 0.18 0.14 0.13
query41 0.08 0.04 0.03
query42 0.04 0.03 0.02
query43 0.04 0.03 0.03
Total cold run time: 96.79 s
Total hot run time: 27.12 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606624476
<details>
<summary>TPC-DS: <b>Total hot run time: 181605 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e0fe4417394ad09e3a8a7416ad748f54a89d9c02, data reload: false
query5 4979 666 508 508
query6 342 252 224 224
query7 4652 534 312 312
query8 305 284 254 254
query9 8717 2664 2687 2664
query10 561 377 325 325
query11 15570 15225 15000 15000
query12 191 117 113 113
query13 1684 572 432 432
query14 6469 3329 3041 3041
query14_1 2913 2920 2893 2893
query15 212 200 184 184
query16 7662 700 537 537
query17 1216 789 673 673
query18 2032 424 333 333
query19 208 204 176 176
query20 134 124 121 121
query21 220 133 112 112
query22 4048 4125 3949 3949
query23 16573 15963 15782 15782
query23_1 16148 15883 15897 15883
query24 6824 1639 1187 1187
query24_1 1219 1202 1218 1202
query25 594 521 488 488
query26 1247 286 163 163
query27 2756 519 345 345
query28 4350 2211 2180 2180
query29 779 634 517 517
query30 320 248 213 213
query31 856 717 641 641
query32 84 78 80 78
query33 612 400 341 341
query34 845 879 543 543
query35 819 840 732 732
query36 900 920 841 841
query37 127 126 107 107
query38 3825 3846 3788 3788
query39 754 750 738 738
query39_1 713 719 706 706
query40 230 135 123 123
query41 71 70 67 67
query42 132 116 114 114
query43 453 456 428 428
query44 1402 769 775 769
query45 201 197 187 187
query46 925 1043 668 668
query47 1683 1721 1649 1649
query48 402 443 334 334
query49 796 517 444 444
query50 730 720 414 414
query51 3978 3924 3838 3838
query52 124 120 108 108
query53 259 271 200 200
query54 330 315 295 295
query55 101 102 92 92
query56 354 361 344 344
query57 1150 1144 1084 1084
query58 306 285 273 273
query59 2357 2350 2254 2254
query60 367 369 354 354
query61 194 182 178 178
query62 822 732 678 678
query63 249 203 196 196
query64 4544 1306 885 885
query65 4121 4007 3993 3993
query66 1103 446 333 333
query67 15141 14921 14687 14687
query68 8361 1063 644 644
query69 515 353 306 306
query70 1114 1054 1029 1029
query71 492 342 328 328
query72 5787 4896 4867 4867
query73 707 596 340 340
query74 8823 8804 8725 8725
query75 3691 3039 2575 2575
query76 3843 1197 780 780
query77 815 451 323 323
query78 9499 9698 8825 8825
query79 1750 873 595 595
query80 639 574 475 475
query81 493 269 236 236
query82 455 144 109 109
query83 270 272 251 251
query84 258 123 100 100
query85 900 502 431 431
query86 342 286 296 286
query87 4003 4096 3979 3979
query88 3239 2259 2265 2259
query89 392 339 299 299
query90 1984 222 217 217
query91 168 176 140 140
query92 88 70 70 70
query93 1202 1034 680 680
query94 739 449 324 324
query95 504 406 407 406
query96 547 562 279 279
query97 2623 2649 2576 2576
query98 237 220 212 212
query99 1325 1352 1283 1283
Total cold run time: 270505 ms
Total hot run time: 181605 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606764519
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [chore](tools) split TPC-DS' multi sql in one file [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58691:
URL: https://github.com/apache/doris/pull/58691#issuecomment-3606764787
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org