You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "xiedeyantu (via GitHub)" <gi...@apache.org> on 2025/05/18 13:52:00 UTC
[PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
xiedeyantu opened a new pull request, #50998:
URL: https://github.com/apache/doris/pull/50998
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2889327550
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2892688448
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2889386587
<details>
<summary>ClickBench: <b>Total hot run time: 28.66 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8a09790e7c0484ea20470b1d8f32572e7425e5f6, data reload: false
query1 0.04 0.04 0.04
query2 0.13 0.11 0.10
query3 0.24 0.19 0.20
query4 1.59 0.20 0.20
query5 0.45 0.47 0.46
query6 1.19 0.68 0.65
query7 0.02 0.01 0.02
query8 0.04 0.03 0.04
query9 0.58 0.50 0.53
query10 0.56 0.58 0.55
query11 0.15 0.11 0.10
query12 0.15 0.11 0.11
query13 0.62 0.59 0.60
query14 0.80 0.82 0.81
query15 0.88 0.84 0.87
query16 0.39 0.38 0.38
query17 1.08 1.04 1.01
query18 0.22 0.21 0.21
query19 1.93 1.77 1.81
query20 0.01 0.01 0.01
query21 15.40 0.88 0.52
query22 0.76 1.36 0.76
query23 14.80 1.41 0.59
query24 6.74 1.50 0.50
query25 0.53 0.24 0.08
query26 0.57 0.16 0.13
query27 0.05 0.05 0.06
query28 9.66 0.95 0.47
query29 12.57 3.94 3.28
query30 0.25 0.09 0.07
query31 2.82 0.59 0.39
query32 3.23 0.55 0.47
query33 3.04 3.11 3.04
query34 15.81 5.16 4.46
query35 4.49 4.58 4.50
query36 0.67 0.49 0.48
query37 0.08 0.07 0.06
query38 0.05 0.04 0.03
query39 0.03 0.02 0.03
query40 0.16 0.15 0.13
query41 0.09 0.03 0.02
query42 0.04 0.03 0.02
query43 0.03 0.03 0.03
Total cold run time: 102.94 s
Total hot run time: 28.66 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 merged PR #50998:
URL: https://github.com/apache/doris/pull/50998
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2889248899
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2889367704
<details>
<summary>TPC-H: <b>Total hot run time: 33887 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8a09790e7c0484ea20470b1d8f32572e7425e5f6, data reload: false
------ Round 1 ----------------------------------
q1 26066 5122 4990 4990
q2 2058 261 176 176
q3 10412 1205 661 661
q4 10220 977 534 534
q5 7539 2296 2324 2296
q6 180 165 135 135
q7 890 773 623 623
q8 9303 1266 1048 1048
q9 6808 5105 5028 5028
q10 6854 2303 1893 1893
q11 481 284 266 266
q12 339 346 204 204
q13 17765 3638 3237 3237
q14 239 247 222 222
q15 538 490 485 485
q16 432 456 384 384
q17 593 858 363 363
q18 7721 7213 7288 7213
q19 1505 957 559 559
q20 353 344 234 234
q21 4194 3210 2369 2369
q22 1018 982 967 967
Total cold run time: 115508 ms
Total hot run time: 33887 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5123 5062 5062 5062
q2 225 318 229 229
q3 2102 2635 2291 2291
q4 1348 1771 1344 1344
q5 4448 4343 4396 4343
q6 219 165 127 127
q7 2012 1926 1746 1746
q8 2554 2593 2526 2526
q9 7206 7171 6969 6969
q10 2983 3168 2745 2745
q11 577 510 507 507
q12 713 733 594 594
q13 3511 3873 3278 3278
q14 284 296 287 287
q15 547 511 499 499
q16 453 492 434 434
q17 1147 1518 1422 1422
q18 7714 7403 7443 7403
q19 770 776 919 776
q20 1995 2029 1856 1856
q21 4753 4534 4325 4325
q22 1058 1049 1055 1049
Total cold run time: 51742 ms
Total hot run time: 49812 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2892742188
<details>
<summary>TPC-H: <b>Total hot run time: 33354 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c6a0c76f4c278e33f2115dfbeeaeecd3e58834d, data reload: false
------ Round 1 ----------------------------------
q1 26379 5017 4965 4965
q2 2072 268 180 180
q3 10406 1220 676 676
q4 10226 974 524 524
q5 7531 2304 2325 2304
q6 174 159 131 131
q7 909 718 605 605
q8 9322 1284 1048 1048
q9 6942 5054 5051 5051
q10 6862 2323 1895 1895
q11 481 287 270 270
q12 342 355 207 207
q13 17773 3676 3066 3066
q14 232 236 212 212
q15 529 480 495 480
q16 411 437 372 372
q17 599 845 352 352
q18 7439 7062 6995 6995
q19 1555 943 550 550
q20 352 348 221 221
q21 3658 2600 2302 2302
q22 1049 1023 948 948
Total cold run time: 115243 ms
Total hot run time: 33354 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5162 5058 5421 5058
q2 240 348 245 245
q3 2153 2678 2337 2337
q4 1396 1828 1370 1370
q5 4350 4355 4375 4355
q6 213 190 131 131
q7 2027 1886 1806 1806
q8 2605 2529 2465 2465
q9 7272 7155 6949 6949
q10 3049 3185 2760 2760
q11 583 509 500 500
q12 692 759 609 609
q13 3507 3889 3321 3321
q14 285 305 280 280
q15 544 488 468 468
q16 442 494 426 426
q17 1135 1462 1403 1403
q18 7707 7567 7445 7445
q19 781 826 867 826
q20 2025 1979 1843 1843
q21 4809 4435 4456 4435
q22 1098 1038 1018 1018
Total cold run time: 52075 ms
Total hot run time: 50050 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2893082004
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2892757041
<details>
<summary>TPC-DS: <b>Total hot run time: 190627 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c6a0c76f4c278e33f2115dfbeeaeecd3e58834d, data reload: false
query1 1389 1119 1063 1063
query2 6423 1787 1827 1787
query3 10969 4585 4434 4434
query4 53666 25703 23003 23003
query5 5099 571 468 468
query6 342 194 189 189
query7 4879 518 296 296
query8 313 256 240 240
query9 5500 2654 2634 2634
query10 475 347 288 288
query11 15188 15005 14810 14810
query12 174 106 103 103
query13 1016 528 395 395
query14 10207 6343 6303 6303
query15 193 203 175 175
query16 7026 654 528 528
query17 1120 764 614 614
query18 1582 426 329 329
query19 211 216 180 180
query20 128 130 135 130
query21 224 130 118 118
query22 4301 4439 4442 4439
query23 34332 33709 33887 33709
query24 6598 2509 2529 2509
query25 476 491 408 408
query26 738 283 154 154
query27 2426 508 353 353
query28 2913 2121 2121 2121
query29 581 596 448 448
query30 286 224 194 194
query31 862 842 766 766
query32 71 68 67 67
query33 480 362 312 312
query34 805 867 568 568
query35 782 844 744 744
query36 987 980 913 913
query37 115 103 72 72
query38 4219 4259 4302 4259
query39 1515 1453 1442 1442
query40 211 131 115 115
query41 58 57 52 52
query42 140 112 110 110
query43 509 506 483 483
query44 1384 858 864 858
query45 179 180 167 167
query46 872 1084 643 643
query47 1841 1850 1794 1794
query48 410 475 326 326
query49 720 515 478 478
query50 686 708 422 422
query51 4253 4250 4268 4250
query52 114 111 103 103
query53 236 274 188 188
query54 607 609 520 520
query55 94 89 89 89
query56 296 296 308 296
query57 1190 1200 1131 1131
query58 261 276 274 274
query59 2676 2788 2526 2526
query60 378 328 323 323
query61 142 126 125 125
query62 741 752 678 678
query63 229 192 201 192
query64 2060 1046 700 700
query65 4296 4236 4264 4236
query66 786 392 319 319
query67 16317 15567 15626 15567
query68 7304 896 531 531
query69 535 372 277 277
query70 1202 1155 1103 1103
query71 511 319 308 308
query72 5887 2347 5109 2347
query73 1569 764 361 361
query74 8969 9106 8970 8970
query75 3979 3219 2669 2669
query76 4192 1195 765 765
query77 692 362 276 276
query78 10295 10099 9331 9331
query79 2601 857 594 594
query80 690 511 452 452
query81 491 258 225 225
query82 539 130 99 99
query83 250 250 240 240
query84 296 115 88 88
query85 798 367 313 313
query86 364 298 295 295
query87 4466 4425 4275 4275
query88 3507 2306 2304 2304
query89 409 330 284 284
query90 1800 212 209 209
query91 146 141 113 113
query92 75 66 57 57
query93 2227 945 585 585
query94 670 419 303 303
query95 379 300 292 292
query96 497 572 279 279
query97 2717 2802 2655 2655
query98 234 202 193 193
query99 1578 1408 1304 1304
Total cold run time: 300166 ms
Total hot run time: 190627 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2893082305
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2892763509
<details>
<summary>ClickBench: <b>Total hot run time: 28.84 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c6a0c76f4c278e33f2115dfbeeaeecd3e58834d, data reload: false
query1 0.04 0.03 0.03
query2 0.14 0.11 0.11
query3 0.25 0.19 0.20
query4 1.59 0.20 0.18
query5 0.45 0.43 0.44
query6 1.17 0.66 0.65
query7 0.02 0.01 0.02
query8 0.04 0.03 0.03
query9 0.58 0.51 0.54
query10 0.56 0.57 0.57
query11 0.15 0.11 0.11
query12 0.15 0.12 0.12
query13 0.63 0.60 0.59
query14 0.78 0.78 0.82
query15 0.87 0.86 0.86
query16 0.38 0.38 0.39
query17 1.04 1.00 1.04
query18 0.22 0.21 0.20
query19 1.88 1.84 1.92
query20 0.02 0.01 0.01
query21 15.39 0.89 0.57
query22 0.78 1.16 0.78
query23 14.79 1.41 0.63
query24 7.11 0.87 0.48
query25 0.46 0.22 0.07
query26 0.58 0.17 0.15
query27 0.05 0.06 0.05
query28 9.49 0.93 0.42
query29 12.58 4.03 3.31
query30 0.26 0.10 0.06
query31 2.81 0.59 0.38
query32 3.24 0.55 0.46
query33 3.06 3.09 3.13
query34 15.81 5.05 4.52
query35 4.53 4.54 4.47
query36 0.66 0.48 0.48
query37 0.09 0.07 0.06
query38 0.06 0.04 0.04
query39 0.03 0.02 0.02
query40 0.16 0.13 0.12
query41 0.08 0.03 0.03
query42 0.03 0.03 0.02
query43 0.04 0.03 0.03
Total cold run time: 103.05 s
Total hot run time: 28.84 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2891035986
<details>
<summary>TPC-DS: <b>Total hot run time: 192979 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0f4fd65f0c93992e0556cc2a41a2083d6d090e1a, data reload: false
query1 1382 1103 1100 1100
query2 6199 1927 1925 1925
query3 11008 4551 4475 4475
query4 54429 25978 22977 22977
query5 5214 516 462 462
query6 386 194 198 194
query7 5040 511 291 291
query8 306 251 232 232
query9 6483 2646 2657 2646
query10 442 333 273 273
query11 15054 15121 14953 14953
query12 156 117 111 111
query13 1149 527 435 435
query14 10199 6354 6382 6354
query15 210 200 184 184
query16 7090 647 489 489
query17 1091 734 606 606
query18 1532 421 315 315
query19 212 193 192 192
query20 136 129 119 119
query21 208 130 111 111
query22 4444 4452 4409 4409
query23 34406 33509 33339 33339
query24 6693 2407 2445 2407
query25 508 468 428 428
query26 675 274 148 148
query27 2188 523 349 349
query28 3217 2187 2151 2151
query29 595 559 430 430
query30 276 218 189 189
query31 862 890 800 800
query32 75 67 61 61
query33 455 374 336 336
query34 937 857 552 552
query35 821 853 770 770
query36 985 1007 932 932
query37 112 105 81 81
query38 4273 4267 4275 4267
query39 1523 1489 1451 1451
query40 220 124 115 115
query41 59 52 55 52
query42 139 108 118 108
query43 527 530 496 496
query44 1354 857 856 856
query45 187 170 164 164
query46 868 1039 669 669
query47 1886 1883 1815 1815
query48 412 460 330 330
query49 713 535 438 438
query50 656 697 407 407
query51 4265 4396 4244 4244
query52 120 120 103 103
query53 231 257 193 193
query54 595 595 535 535
query55 88 90 91 90
query56 354 327 298 298
query57 1178 1188 1121 1121
query58 278 262 260 260
query59 2830 2881 2784 2784
query60 338 325 310 310
query61 125 121 126 121
query62 752 740 696 696
query63 238 196 192 192
query64 1512 1024 678 678
query65 4348 4225 4201 4201
query66 709 403 306 306
query67 15943 15535 15408 15408
query68 7218 896 529 529
query69 543 306 271 271
query70 1216 1103 1100 1100
query71 516 325 304 304
query72 5972 4844 5021 4844
query73 1350 682 359 359
query74 8948 9078 8616 8616
query75 3817 3183 2657 2657
query76 4182 1187 754 754
query77 642 379 283 283
query78 10090 10208 9365 9365
query79 2494 844 679 679
query80 678 503 447 447
query81 470 262 217 217
query82 429 122 90 90
query83 249 240 236 236
query84 301 102 83 83
query85 781 345 311 311
query86 398 312 293 293
query87 4478 4469 4391 4391
query88 3316 2407 2382 2382
query89 402 320 292 292
query90 1782 213 207 207
query91 135 138 115 115
query92 78 59 57 57
query93 2188 945 583 583
query94 661 414 291 291
query95 379 304 290 290
query96 510 591 297 297
query97 2731 2752 2592 2592
query98 235 216 204 204
query99 1635 1388 1306 1306
Total cold run time: 300720 ms
Total hot run time: 192979 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2889380820
<details>
<summary>TPC-DS: <b>Total hot run time: 193249 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8a09790e7c0484ea20470b1d8f32572e7425e5f6, data reload: false
query1 1424 1104 1074 1074
query2 6354 1829 1847 1829
query3 10972 4573 4407 4407
query4 54687 25480 23038 23038
query5 5023 611 481 481
query6 351 226 203 203
query7 4886 511 293 293
query8 318 261 250 250
query9 5476 2671 2690 2671
query10 474 347 278 278
query11 15011 15003 14875 14875
query12 161 113 114 113
query13 1035 527 434 434
query14 10244 6641 6508 6508
query15 214 198 175 175
query16 7052 659 500 500
query17 1091 766 636 636
query18 1587 389 302 302
query19 199 188 172 172
query20 133 141 123 123
query21 206 131 109 109
query22 4452 4498 4296 4296
query23 34410 33686 33639 33639
query24 6543 2465 2463 2463
query25 507 481 414 414
query26 733 275 155 155
query27 2468 513 361 361
query28 3137 2180 2171 2171
query29 581 577 452 452
query30 275 210 198 198
query31 871 837 779 779
query32 73 62 65 62
query33 467 412 331 331
query34 800 873 531 531
query35 788 834 782 782
query36 973 1011 921 921
query37 110 104 78 78
query38 4207 4294 4189 4189
query39 1533 1476 1456 1456
query40 211 129 112 112
query41 56 53 50 50
query42 128 121 114 114
query43 511 529 496 496
query44 1412 862 863 862
query45 180 177 168 168
query46 848 1045 658 658
query47 1820 1849 1800 1800
query48 409 438 345 345
query49 695 546 433 433
query50 697 720 424 424
query51 4219 4307 4292 4292
query52 113 118 106 106
query53 240 267 195 195
query54 610 611 539 539
query55 92 88 88 88
query56 311 319 313 313
query57 1212 1183 1138 1138
query58 285 278 265 265
query59 2684 2846 2670 2670
query60 348 346 341 341
query61 129 124 126 124
query62 768 765 696 696
query63 239 204 198 198
query64 1914 1041 733 733
query65 4306 4220 4251 4220
query66 740 418 301 301
query67 15981 15563 15380 15380
query68 6823 899 550 550
query69 548 322 276 276
query70 1178 1117 1123 1117
query71 509 325 297 297
query72 5957 4646 4761 4646
query73 1259 626 372 372
query74 9015 9107 8689 8689
query75 4004 3230 2708 2708
query76 4125 1193 778 778
query77 717 380 291 291
query78 10228 10182 9299 9299
query79 2750 879 615 615
query80 662 581 470 470
query81 478 253 230 230
query82 416 132 101 101
query83 270 265 240 240
query84 299 105 85 85
query85 782 358 330 330
query86 363 288 286 286
query87 4428 4492 4351 4351
query88 3671 2396 2381 2381
query89 420 330 296 296
query90 1804 224 224 224
query91 146 163 114 114
query92 78 64 59 59
query93 2393 968 587 587
query94 645 410 302 302
query95 372 300 288 288
query96 522 582 290 290
query97 2744 2772 2699 2699
query98 244 209 213 209
query99 1388 1406 1259 1259
Total cold run time: 300222 ms
Total hot run time: 193249 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2890996789
<details>
<summary>TPC-H: <b>Total hot run time: 33839 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0f4fd65f0c93992e0556cc2a41a2083d6d090e1a, data reload: false
------ Round 1 ----------------------------------
q1 25721 5042 5006 5006
q2 2055 269 180 180
q3 10401 1222 737 737
q4 10232 1012 527 527
q5 7538 2363 2318 2318
q6 176 161 134 134
q7 927 740 616 616
q8 9314 1297 1091 1091
q9 6831 5055 5059 5055
q10 6871 2313 1905 1905
q11 488 296 276 276
q12 359 354 217 217
q13 17777 3743 3088 3088
q14 218 230 210 210
q15 516 478 494 478
q16 425 437 387 387
q17 606 847 360 360
q18 7517 7338 7142 7142
q19 2768 1510 583 583
q20 333 331 222 222
q21 3735 2541 2348 2348
q22 1009 966 959 959
Total cold run time: 115817 ms
Total hot run time: 33839 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5306 5082 5066 5066
q2 246 321 226 226
q3 2184 2604 2260 2260
q4 1323 1762 1327 1327
q5 4475 4558 4371 4371
q6 219 173 125 125
q7 1999 1928 1773 1773
q8 2619 2602 2486 2486
q9 7154 7107 6868 6868
q10 3039 3188 2808 2808
q11 573 520 483 483
q12 688 767 609 609
q13 3528 3875 3250 3250
q14 277 281 285 281
q15 517 470 481 470
q16 449 482 429 429
q17 1178 1547 1379 1379
q18 7751 7674 7569 7569
q19 850 817 867 817
q20 2007 1975 1828 1828
q21 4870 4486 4336 4336
q22 1101 1031 1016 1016
Total cold run time: 52353 ms
Total hot run time: 49777 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2891053280
<details>
<summary>ClickBench: <b>Total hot run time: 29.59 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0f4fd65f0c93992e0556cc2a41a2083d6d090e1a, data reload: false
query1 0.04 0.04 0.03
query2 0.12 0.10 0.11
query3 0.24 0.19 0.20
query4 1.60 0.18 0.20
query5 0.45 0.44 0.43
query6 1.54 0.67 0.67
query7 0.02 0.02 0.01
query8 0.05 0.03 0.03
query9 0.57 0.52 0.50
query10 0.57 0.57 0.56
query11 0.17 0.11 0.10
query12 0.14 0.12 0.11
query13 0.62 0.60 0.60
query14 0.81 0.80 0.80
query15 0.87 0.84 0.84
query16 0.40 0.39 0.38
query17 1.01 1.07 1.06
query18 0.22 0.21 0.22
query19 1.90 1.80 1.82
query20 0.02 0.01 0.01
query21 15.40 0.87 0.54
query22 0.74 1.33 0.98
query23 14.70 1.40 0.66
query24 6.98 1.63 1.06
query25 0.55 0.14 0.24
query26 0.65 0.16 0.14
query27 0.05 0.05 0.06
query28 9.90 0.89 0.43
query29 12.90 4.00 3.29
query30 0.24 0.09 0.07
query31 2.82 0.61 0.38
query32 3.23 0.56 0.46
query33 3.01 3.03 3.08
query34 15.55 5.13 4.48
query35 4.53 4.51 4.50
query36 0.67 0.49 0.47
query37 0.08 0.06 0.06
query38 0.05 0.03 0.04
query39 0.03 0.03 0.02
query40 0.17 0.14 0.12
query41 0.08 0.03 0.02
query42 0.03 0.03 0.02
query43 0.03 0.04 0.03
Total cold run time: 103.75 s
Total hot run time: 29.59 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2889003706
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2890853940
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 commented on code in PR #50998:
URL: https://github.com/apache/doris/pull/50998#discussion_r2096711626
##########
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowQueryStatsCommand.java:
##########
@@ -0,0 +1,211 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands;
+
+import org.apache.doris.catalog.Column;
+import org.apache.doris.catalog.DatabaseIf;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.ScalarType;
+import org.apache.doris.common.ErrorCode;
+import org.apache.doris.common.ErrorReport;
+import org.apache.doris.common.UserException;
+import org.apache.doris.common.util.Util;
+import org.apache.doris.mysql.privilege.PrivPredicate;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.nereids.trees.plans.commands.info.TableNameInfo;
+import org.apache.doris.nereids.trees.plans.visitor.PlanVisitor;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.ShowResultSet;
+import org.apache.doris.qe.ShowResultSetMetaData;
+import org.apache.doris.qe.StmtExecutor;
+import org.apache.doris.statistics.query.QueryStatsUtil;
+
+import com.google.common.base.Preconditions;
+import com.google.common.base.Strings;
+import org.apache.commons.lang3.StringUtils;
+
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.List;
+import java.util.Map;
+
+/**
+ * The command for show query stats
+ */
+public class ShowQueryStatsCommand extends ShowCommand {
+ private static final ShowResultSetMetaData SHOW_QUERY_STATS_CATALOG_META_DATA = ShowResultSetMetaData.builder()
+ .addColumn(new Column("Database", ScalarType.createVarchar(20)))
+ .addColumn(new Column("QueryCount", ScalarType.createVarchar(30))).build();
+ private static final ShowResultSetMetaData SHOW_QUERY_STATS_DATABASE_META_DATA = ShowResultSetMetaData.builder()
+ .addColumn(new Column("TableName", ScalarType.createVarchar(20)))
+ .addColumn(new Column("QueryCount", ScalarType.createVarchar(30))).build();
+ private static final ShowResultSetMetaData SHOW_QUERY_STATS_TABLE_META_DATA = ShowResultSetMetaData.builder()
+ .addColumn(new Column("Field", ScalarType.createVarchar(20)))
+ .addColumn(new Column("QueryCount", ScalarType.createVarchar(30)))
+ .addColumn(new Column("FilterCount", ScalarType.createVarchar(30))).build();
+ private static final ShowResultSetMetaData SHOW_QUERY_STATS_TABLE_ALL_META_DATA = ShowResultSetMetaData.builder()
+ .addColumn(new Column("IndexName", ScalarType.createVarchar(20)))
+ .addColumn(new Column("QueryCount", ScalarType.createVarchar(30))).build();
+ private static final ShowResultSetMetaData SHOW_QUERY_STATS_TABLE_ALL_VERBOSE_META_DATA
+ = ShowResultSetMetaData.builder().addColumn(new Column("IndexName", ScalarType.createVarchar(20)))
+ .addColumn(new Column("Field", ScalarType.createVarchar(20)))
+ .addColumn(new Column("QueryCount", ScalarType.createVarchar(30)))
+ .addColumn(new Column("FilterCount", ScalarType.createVarchar(30))).build();
+
+ TableNameInfo tableNameInfo;
+ String dbName;
+ boolean all;
+ boolean verbose;
+ List<List<String>> totalRows = new ArrayList<>();
+ ShowQueryStatsType type;
+
+ public ShowQueryStatsCommand(String dbName, TableNameInfo tableNameInfo, boolean all, boolean verbose) {
+ super(PlanType.SHOW_QUERY_STATS_COMMAND);
+ this.dbName = dbName;
+ this.tableNameInfo = tableNameInfo;
+ this.all = all;
+ this.verbose = verbose;
+ }
+
+ /**
+ * validate
+ */
+ public void validate(ConnectContext ctx) throws UserException {
+ if (StringUtils.isEmpty(dbName)) {
+ dbName = ctx.getDatabase();
+ type = ShowQueryStatsType.DATABASE;
+ }
+ if (Strings.isNullOrEmpty(dbName)) {
Review Comment:
```suggestion
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Feat](nereids) support ShowQueryStatsCommand [doris]
Posted by "xiedeyantu (via GitHub)" <gi...@apache.org>.
xiedeyantu commented on PR #50998:
URL: https://github.com/apache/doris/pull/50998#issuecomment-2892683285
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org