You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2025/04/01 03:23:31 UTC
[PR] [opt](nereids) remove const join condition [doris]
englefly opened a new pull request, #49730:
URL: https://github.com/apache/doris/pull/49730
### What problem does this PR solve?
The follow plan fragment:
T1 join T2 on T1.a=T2.a and T1.b=T2.b and T1.a=1 and T2.a=1
can be simplified by removing the join condition `T1.a=T2.a` , because both T1.a and T2.a are const 1 or empty. it is equivalent to
T1 join T2 on T1.b=T2.b and T1.a=1 and T2.a=1
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2767972051
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2827086246
<details>
<summary>ClickBench: <b>Total hot run time: 29.8 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 07e9ac1d992b98bcf5d072739c0464a042c3a1d6, data reload: false
query1 0.04 0.04 0.02
query2 0.14 0.10 0.11
query3 0.25 0.19 0.19
query4 1.59 0.19 0.19
query5 0.57 0.56 0.55
query6 1.21 0.71 0.71
query7 0.02 0.02 0.02
query8 0.04 0.03 0.04
query9 0.57 0.52 0.51
query10 0.56 0.56 0.57
query11 0.15 0.10 0.11
query12 0.15 0.11 0.12
query13 0.62 0.61 0.59
query14 1.19 1.17 1.16
query15 0.87 0.85 0.85
query16 0.37 0.38 0.38
query17 1.01 1.03 1.07
query18 0.21 0.19 0.20
query19 1.91 1.83 1.85
query20 0.01 0.01 0.01
query21 15.47 0.94 0.57
query22 0.74 1.30 0.68
query23 14.80 1.38 0.64
query24 6.63 1.12 1.35
query25 0.52 0.26 0.08
query26 0.55 0.16 0.13
query27 0.05 0.05 0.05
query28 10.00 0.85 0.44
query29 12.60 3.99 3.31
query30 0.26 0.09 0.06
query31 2.83 0.60 0.38
query32 3.23 0.54 0.47
query33 3.06 3.01 3.01
query34 15.69 5.00 4.46
query35 4.51 4.48 4.49
query36 0.66 0.48 0.50
query37 0.09 0.06 0.07
query38 0.05 0.04 0.03
query39 0.03 0.02 0.02
query40 0.17 0.14 0.13
query41 0.08 0.02 0.02
query42 0.04 0.02 0.02
query43 0.03 0.03 0.03
Total cold run time: 103.57 s
Total hot run time: 29.8 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2826466055
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on code in PR #49730:
URL: https://github.com/apache/doris/pull/49730#discussion_r2043341102
##########
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/MaterializedViewUtils.java:
##########
@@ -262,7 +262,8 @@ public static Plan rewriteByRules(
.getSessionVariable()
.getDisableNereidsRuleNames();
rewrittenPlanContext.getStatementContext().getConnectContext().getSessionVariable()
- .setDisableNereidsRules(String.join(",", ImmutableSet.of(RuleType.ADD_DEFAULT_LIMIT.name())));
+ .setDisableNereidsRules(String.join(",", ImmutableSet.of(RuleType.ADD_DEFAULT_LIMIT.name(),
+ RuleType.ELIMINATE_CONST_JOIN_CONDITION.name())));
Review Comment:
this should not add ELIMINATE_CONST_JOIN_CONDITION disable rule.
it is enough which is disable by` MTMVPlanUtil.java`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2791536135
<details>
<summary>ClickBench: <b>Total hot run time: 31.5 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0077dae60c783fdc617e0e55cf82853ece1cf0c4, data reload: false
query1 0.05 0.04 0.02
query2 0.13 0.11 0.11
query3 0.24 0.20 0.19
query4 1.59 0.20 0.19
query5 0.60 0.57 0.58
query6 1.19 0.71 0.70
query7 0.02 0.02 0.02
query8 0.04 0.04 0.04
query9 0.58 0.51 0.51
query10 0.57 0.59 0.58
query11 0.15 0.11 0.11
query12 0.14 0.11 0.11
query13 0.61 0.59 0.59
query14 2.66 2.70 2.72
query15 0.92 0.86 0.85
query16 0.39 0.40 0.38
query17 1.08 1.05 1.03
query18 0.21 0.19 0.19
query19 1.89 1.96 1.81
query20 0.02 0.01 0.01
query21 15.37 0.93 0.53
query22 0.75 1.26 0.71
query23 14.86 1.40 0.64
query24 6.65 2.18 1.04
query25 0.46 0.10 0.13
query26 0.61 0.16 0.15
query27 0.05 0.05 0.05
query28 9.31 0.88 0.42
query29 12.55 3.98 3.37
query30 0.26 0.09 0.06
query31 2.82 0.59 0.39
query32 3.24 0.54 0.47
query33 3.06 3.00 3.07
query34 15.84 5.15 4.53
query35 4.53 4.59 4.54
query36 0.68 0.50 0.48
query37 0.09 0.07 0.06
query38 0.05 0.04 0.04
query39 0.04 0.02 0.02
query40 0.18 0.15 0.12
query41 0.08 0.03 0.02
query42 0.04 0.03 0.02
query43 0.04 0.03 0.03
Total cold run time: 104.64 s
Total hot run time: 31.5 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2768929572
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2769148451
<details>
<summary>TPC-DS: <b>Total hot run time: 193254 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e54aa7ba6db49a47b4cfbcd88faf304c883ba088, data reload: false
query1 1428 1081 1038 1038
query2 6317 2003 1986 1986
query3 11060 4442 4744 4442
query4 25784 23675 23250 23250
query5 4517 610 455 455
query6 340 221 201 201
query7 4006 487 280 280
query8 306 256 236 236
query9 8523 2596 2579 2579
query10 465 336 265 265
query11 15582 15047 14764 14764
query12 169 112 109 109
query13 1570 538 402 402
query14 9367 6111 6173 6111
query15 211 177 167 167
query16 7593 615 462 462
query17 1173 797 593 593
query18 2011 403 333 333
query19 197 183 168 168
query20 125 130 127 127
query21 210 126 112 112
query22 4554 4693 4403 4403
query23 34147 33397 33369 33369
query24 8639 2410 2445 2410
query25 510 480 417 417
query26 1054 275 158 158
query27 2807 501 351 351
query28 4839 2482 2448 2448
query29 698 570 465 465
query30 283 224 195 195
query31 891 899 785 785
query32 74 65 61 61
query33 531 360 355 355
query34 793 875 558 558
query35 835 844 812 812
query36 985 1004 893 893
query37 123 98 87 87
query38 4250 4090 4239 4090
query39 1502 1481 1458 1458
query40 227 123 113 113
query41 60 57 54 54
query42 131 106 109 106
query43 511 521 498 498
query44 1323 829 825 825
query45 177 173 165 165
query46 849 1016 661 661
query47 1830 1880 1803 1803
query48 399 418 320 320
query49 800 520 444 444
query50 664 708 416 416
query51 4215 4321 4269 4269
query52 105 111 106 106
query53 236 261 189 189
query54 602 600 510 510
query55 103 79 84 79
query56 313 307 304 304
query57 1175 1206 1129 1129
query58 285 275 280 275
query59 2744 2926 2938 2926
query60 356 341 329 329
query61 160 179 161 161
query62 761 729 668 668
query63 222 196 187 187
query64 3764 1078 713 713
query65 4385 4332 4316 4316
query66 958 411 301 301
query67 16230 15450 15703 15450
query68 8234 893 531 531
query69 484 318 265 265
query70 1150 1015 1086 1015
query71 477 318 300 300
query72 5808 4773 4888 4773
query73 726 649 348 348
query74 8846 8884 8686 8686
query75 3942 3179 2695 2695
query76 3700 1184 754 754
query77 768 387 291 291
query78 9822 9963 9285 9285
query79 2497 834 569 569
query80 578 517 442 442
query81 496 268 227 227
query82 467 129 95 95
query83 297 251 237 237
query84 289 113 88 88
query85 919 356 316 316
query86 395 298 275 275
query87 4380 4441 4451 4441
query88 3619 2245 2231 2231
query89 408 309 276 276
query90 1836 213 228 213
query91 144 145 185 145
query92 72 61 57 57
query93 2022 960 578 578
query94 653 402 298 298
query95 366 300 288 288
query96 487 583 273 273
query97 3200 3235 3097 3097
query98 238 207 209 207
query99 1475 1384 1246 1246
Total cold run time: 280849 ms
Total hot run time: 193254 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2791516446
<details>
<summary>TPC-H: <b>Total hot run time: 34704 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0077dae60c783fdc617e0e55cf82853ece1cf0c4, data reload: false
------ Round 1 ----------------------------------
q1 25888 5352 5056 5056
q2 2067 267 176 176
q3 10410 1204 680 680
q4 10237 1019 520 520
q5 7524 2309 2366 2309
q6 185 163 130 130
q7 895 748 608 608
q8 9319 1286 1062 1062
q9 6839 5091 5100 5091
q10 6857 2282 1884 1884
q11 496 280 266 266
q12 346 349 216 216
q13 17768 3658 3121 3121
q14 224 227 215 215
q15 527 481 499 481
q16 624 623 574 574
q17 609 841 385 385
q18 7553 7129 6952 6952
q19 1377 941 578 578
q20 353 343 242 242
q21 4239 3371 3175 3175
q22 1047 1012 983 983
Total cold run time: 115384 ms
Total hot run time: 34704 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5231 5130 5224 5130
q2 251 333 236 236
q3 2182 2699 2321 2321
q4 1471 1914 1636 1636
q5 4554 4528 4444 4444
q6 230 173 138 138
q7 2031 1918 1765 1765
q8 2589 2649 2546 2546
q9 7249 7208 7127 7127
q10 2998 3124 2757 2757
q11 585 513 493 493
q12 700 754 632 632
q13 3508 3953 3326 3326
q14 284 315 265 265
q15 522 486 474 474
q16 632 675 664 664
q17 1147 1528 1410 1410
q18 7782 7568 7482 7482
q19 837 793 842 793
q20 1917 1972 1821 1821
q21 5309 5065 4852 4852
q22 1068 1060 1036 1036
Total cold run time: 53077 ms
Total hot run time: 51348 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2827043046
<details>
<summary>TPC-H: <b>Total hot run time: 33798 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 07e9ac1d992b98bcf5d072739c0464a042c3a1d6, data reload: false
------ Round 1 ----------------------------------
q1 26123 5567 5043 5043
q2 2092 295 190 190
q3 10380 1260 690 690
q4 10225 985 533 533
q5 7521 2336 2309 2309
q6 180 161 132 132
q7 911 733 619 619
q8 9324 1272 1094 1094
q9 6895 5007 5109 5007
q10 6882 2309 1910 1910
q11 489 278 272 272
q12 359 350 221 221
q13 17769 3699 3076 3076
q14 230 226 211 211
q15 520 478 483 478
q16 450 452 408 408
q17 591 847 347 347
q18 7515 7232 7040 7040
q19 1850 957 579 579
q20 326 340 227 227
q21 3901 2588 2427 2427
q22 1031 1023 985 985
Total cold run time: 115564 ms
Total hot run time: 33798 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5171 5113 5106 5106
q2 235 326 227 227
q3 2177 2648 2307 2307
q4 1411 1797 1405 1405
q5 4526 4364 4470 4364
q6 220 165 126 126
q7 1989 1894 1760 1760
q8 2593 2520 2532 2520
q9 7196 7273 7066 7066
q10 3030 3189 2720 2720
q11 576 510 493 493
q12 674 788 618 618
q13 3511 3865 3283 3283
q14 299 318 301 301
q15 511 485 484 484
q16 465 524 467 467
q17 1127 1544 1388 1388
q18 7649 7660 7407 7407
q19 837 832 943 832
q20 1969 1992 1828 1828
q21 5206 4961 4790 4790
q22 1054 1068 1019 1019
Total cold run time: 52426 ms
Total hot run time: 50511 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2767972205
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2769116891
<details>
<summary>TPC-H: <b>Total hot run time: 33999 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e54aa7ba6db49a47b4cfbcd88faf304c883ba088, data reload: false
------ Round 1 ----------------------------------
q1 26030 5029 5012 5012
q2 2061 317 189 189
q3 10339 1209 687 687
q4 10216 999 522 522
q5 7484 2433 2314 2314
q6 187 166 129 129
q7 928 757 624 624
q8 9324 1282 1112 1112
q9 6817 5118 5114 5114
q10 6808 2304 1899 1899
q11 465 289 275 275
q12 357 355 222 222
q13 17775 3650 3049 3049
q14 221 223 215 215
q15 523 485 474 474
q16 634 618 579 579
q17 583 860 368 368
q18 7669 7175 7046 7046
q19 2000 962 577 577
q20 338 332 222 222
q21 3997 3455 2428 2428
q22 1059 1023 942 942
Total cold run time: 115815 ms
Total hot run time: 33999 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5242 5063 5091 5063
q2 240 325 239 239
q3 2134 2667 2314 2314
q4 1422 1811 1408 1408
q5 4458 4432 4411 4411
q6 216 169 131 131
q7 2020 1922 1815 1815
q8 2590 2676 2532 2532
q9 7303 7201 7202 7201
q10 2987 3149 2758 2758
q11 586 499 484 484
q12 691 747 610 610
q13 3538 3863 3377 3377
q14 314 289 273 273
q15 531 502 489 489
q16 663 699 661 661
q17 1151 1561 1387 1387
q18 7758 7534 7445 7445
q19 795 783 958 783
q20 1957 1948 1921 1921
q21 5289 4937 4937 4937
q22 1111 1057 1017 1017
Total cold run time: 52996 ms
Total hot run time: 51256 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2833801450
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2768028171
<details>
<summary>TPC-H: <b>Total hot run time: 33875 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b77fcf4a3b1015bec1febfa73ffef89451deb782, data reload: false
------ Round 1 ----------------------------------
q1 25816 5006 5004 5004
q2 2082 279 184 184
q3 10400 1245 656 656
q4 10222 969 504 504
q5 7497 2264 2359 2264
q6 189 163 132 132
q7 897 744 614 614
q8 9301 1291 1104 1104
q9 6719 5129 5075 5075
q10 6863 2288 1875 1875
q11 485 288 269 269
q12 350 358 214 214
q13 17763 3668 3054 3054
q14 217 233 211 211
q15 535 491 497 491
q16 631 617 599 599
q17 619 858 389 389
q18 7690 7235 7057 7057
q19 1903 977 570 570
q20 331 322 239 239
q21 3885 3326 2416 2416
q22 1045 1004 954 954
Total cold run time: 115440 ms
Total hot run time: 33875 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5200 5099 5094 5094
q2 244 324 227 227
q3 2118 2613 2254 2254
q4 1383 1775 1403 1403
q5 4447 4413 4359 4359
q6 221 169 135 135
q7 2014 1903 1736 1736
q8 2601 2456 2724 2456
q9 7261 7217 6949 6949
q10 3023 3148 2721 2721
q11 566 496 491 491
q12 673 742 624 624
q13 3503 3857 4112 3857
q14 302 306 259 259
q15 514 475 481 475
q16 643 680 658 658
q17 1151 1590 1327 1327
q18 7749 7705 7429 7429
q19 810 807 817 807
q20 1903 1939 1824 1824
q21 5316 4785 4864 4785
q22 1112 1040 996 996
Total cold run time: 52754 ms
Total hot run time: 50866 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2791479231
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2791530050
<details>
<summary>TPC-DS: <b>Total hot run time: 193096 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0077dae60c783fdc617e0e55cf82853ece1cf0c4, data reload: false
query1 1385 1057 1074 1057
query2 6292 1992 1964 1964
query3 11158 4556 4457 4457
query4 25388 23165 23439 23165
query5 4360 612 461 461
query6 309 216 196 196
query7 3996 492 277 277
query8 316 268 249 249
query9 8552 2552 2535 2535
query10 442 326 258 258
query11 15231 15163 14784 14784
query12 153 113 102 102
query13 1549 506 387 387
query14 8711 6210 6294 6210
query15 208 189 173 173
query16 7190 624 446 446
query17 1231 706 555 555
query18 1966 417 317 317
query19 193 184 161 161
query20 133 128 121 121
query21 211 124 108 108
query22 4407 4512 4428 4428
query23 34226 33729 33530 33530
query24 8851 2457 2393 2393
query25 548 468 401 401
query26 1231 270 149 149
query27 2921 507 332 332
query28 4670 2492 2413 2413
query29 749 594 432 432
query30 275 230 192 192
query31 914 854 835 835
query32 76 61 61 61
query33 551 374 313 313
query34 819 878 526 526
query35 814 830 781 781
query36 975 994 901 901
query37 137 102 77 77
query38 4230 4202 4119 4119
query39 1464 1458 1459 1458
query40 218 126 106 106
query41 58 58 50 50
query42 128 110 109 109
query43 511 494 478 478
query44 1365 818 816 816
query45 193 172 167 167
query46 838 1025 649 649
query47 1860 1886 1823 1823
query48 394 431 305 305
query49 781 500 434 434
query50 674 703 402 402
query51 4230 4225 4238 4225
query52 113 114 101 101
query53 236 253 182 182
query54 576 595 551 551
query55 86 80 84 80
query56 306 301 292 292
query57 1189 1204 1113 1113
query58 274 275 270 270
query59 2835 2935 2832 2832
query60 336 329 328 328
query61 134 134 147 134
query62 759 740 674 674
query63 225 187 184 184
query64 4091 1151 868 868
query65 4455 4372 4455 4372
query66 1053 404 326 326
query67 16429 15465 15200 15200
query68 8307 885 517 517
query69 482 326 260 260
query70 1168 1105 1106 1105
query71 456 318 279 279
query72 5217 4658 4619 4619
query73 639 546 350 350
query74 9151 8990 9045 8990
query75 3875 3210 2668 2668
query76 3652 1203 749 749
query77 778 352 279 279
query78 9808 10025 9297 9297
query79 2009 810 570 570
query80 622 510 443 443
query81 467 257 223 223
query82 432 126 94 94
query83 254 251 238 238
query84 248 99 80 80
query85 784 352 310 310
query86 327 306 284 284
query87 4413 4449 4386 4386
query88 3198 2186 2181 2181
query89 387 309 289 289
query90 1923 216 207 207
query91 135 138 112 112
query92 77 59 60 59
query93 1262 932 591 591
query94 662 421 298 298
query95 379 291 294 291
query96 482 580 274 274
query97 3131 3217 3136 3136
query98 222 200 207 200
query99 1408 1401 1322 1322
Total cold run time: 277534 ms
Total hot run time: 193096 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2768046208
<details>
<summary>ClickBench: <b>Total hot run time: 31.39 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b77fcf4a3b1015bec1febfa73ffef89451deb782, data reload: false
query1 0.04 0.03 0.03
query2 0.12 0.11 0.10
query3 0.24 0.20 0.20
query4 1.59 0.20 0.20
query5 0.63 0.57 0.60
query6 1.18 0.73 0.71
query7 0.02 0.02 0.02
query8 0.04 0.03 0.03
query9 0.58 0.52 0.52
query10 0.57 0.60 0.57
query11 0.16 0.11 0.11
query12 0.15 0.11 0.12
query13 0.61 0.61 0.60
query14 2.69 2.70 2.72
query15 0.93 0.88 0.83
query16 0.39 0.37 0.38
query17 1.04 1.02 1.05
query18 0.21 0.20 0.20
query19 1.89 2.00 1.82
query20 0.01 0.01 0.01
query21 15.36 0.92 0.57
query22 0.77 1.13 0.71
query23 14.92 1.41 0.66
query24 7.45 1.21 0.84
query25 0.44 0.16 0.09
query26 0.61 0.16 0.14
query27 0.05 0.05 0.05
query28 8.86 0.85 0.45
query29 12.63 4.04 3.38
query30 0.25 0.09 0.07
query31 2.84 0.59 0.38
query32 3.23 0.56 0.47
query33 3.00 2.99 3.08
query34 15.78 5.11 4.57
query35 4.53 4.48 4.55
query36 0.65 0.49 0.49
query37 0.08 0.06 0.07
query38 0.05 0.04 0.04
query39 0.04 0.03 0.02
query40 0.18 0.14 0.13
query41 0.09 0.03 0.03
query42 0.03 0.02 0.03
query43 0.04 0.03 0.03
Total cold run time: 104.97 s
Total hot run time: 31.39 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2769162281
<details>
<summary>ClickBench: <b>Total hot run time: 31.05 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e54aa7ba6db49a47b4cfbcd88faf304c883ba088, data reload: false
query1 0.04 0.04 0.02
query2 0.12 0.10 0.10
query3 0.24 0.20 0.19
query4 1.59 0.19 0.19
query5 0.59 0.58 0.57
query6 1.20 0.72 0.72
query7 0.02 0.01 0.01
query8 0.04 0.04 0.04
query9 0.58 0.51 0.52
query10 0.57 0.60 0.56
query11 0.15 0.10 0.11
query12 0.15 0.11 0.12
query13 0.62 0.60 0.60
query14 2.65 2.69 2.70
query15 0.91 0.86 0.84
query16 0.37 0.39 0.37
query17 1.09 1.06 1.03
query18 0.21 0.20 0.19
query19 1.92 1.92 1.89
query20 0.02 0.00 0.01
query21 15.38 0.91 0.55
query22 0.77 1.32 0.65
query23 14.83 1.36 0.61
query24 7.09 0.83 0.80
query25 0.49 0.18 0.09
query26 0.53 0.16 0.13
query27 0.04 0.05 0.06
query28 9.51 0.94 0.43
query29 12.62 4.09 3.31
query30 0.24 0.09 0.06
query31 2.81 0.60 0.38
query32 3.22 0.58 0.50
query33 3.00 3.15 3.02
query34 15.82 5.18 4.44
query35 4.56 4.48 4.52
query36 0.66 0.50 0.50
query37 0.09 0.07 0.06
query38 0.04 0.04 0.04
query39 0.03 0.02 0.02
query40 0.17 0.13 0.13
query41 0.08 0.02 0.02
query42 0.04 0.02 0.02
query43 0.03 0.03 0.03
Total cold run time: 105.13 s
Total hot run time: 31.05 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2833801409
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly merged PR #49730:
URL: https://github.com/apache/doris/pull/49730
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2827073403
<details>
<summary>TPC-DS: <b>Total hot run time: 192750 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 07e9ac1d992b98bcf5d072739c0464a042c3a1d6, data reload: false
query1 1423 1100 1075 1075
query2 6341 1822 1825 1822
query3 11037 4484 4528 4484
query4 54799 26268 23358 23358
query5 5066 529 467 467
query6 347 196 186 186
query7 4871 519 277 277
query8 300 258 250 250
query9 5535 2582 2577 2577
query10 431 331 265 265
query11 15013 15076 14921 14921
query12 155 109 113 109
query13 1028 513 404 404
query14 10135 6252 6327 6252
query15 204 193 185 185
query16 7138 657 501 501
query17 1113 743 576 576
query18 1590 407 359 359
query19 203 190 161 161
query20 123 129 133 129
query21 202 124 106 106
query22 4433 4383 4292 4292
query23 34077 33409 33713 33409
query24 6600 2432 2443 2432
query25 452 449 406 406
query26 694 272 150 150
query27 2183 512 346 346
query28 2873 2158 2166 2158
query29 597 562 430 430
query30 274 215 192 192
query31 877 860 784 784
query32 74 61 61 61
query33 481 369 310 310
query34 775 895 516 516
query35 787 869 733 733
query36 961 1001 898 898
query37 112 105 82 82
query38 4115 4233 4193 4193
query39 1570 1457 1428 1428
query40 221 115 108 108
query41 56 53 51 51
query42 123 110 108 108
query43 496 498 492 492
query44 1313 808 813 808
query45 176 178 166 166
query46 850 1038 639 639
query47 1875 1921 1779 1779
query48 387 413 302 302
query49 688 502 422 422
query50 678 712 404 404
query51 4205 4155 4155 4155
query52 112 104 97 97
query53 219 258 179 179
query54 571 556 514 514
query55 89 80 80 80
query56 302 300 284 284
query57 1167 1182 1121 1121
query58 273 262 249 249
query59 2711 2801 2684 2684
query60 330 317 308 308
query61 146 152 151 151
query62 779 749 672 672
query63 230 187 204 187
query64 1742 1030 692 692
query65 4432 4288 4242 4242
query66 715 415 304 304
query67 15590 15652 15519 15519
query68 5612 831 529 529
query69 509 303 267 267
query70 1166 1114 1102 1102
query71 419 310 301 301
query72 5941 4807 5088 4807
query73 1314 665 343 343
query74 8877 8985 8832 8832
query75 3236 3244 2717 2717
query76 3814 1196 746 746
query77 652 366 283 283
query78 9995 10112 9368 9368
query79 2783 821 560 560
query80 873 500 427 427
query81 501 262 216 216
query82 741 130 96 96
query83 372 251 241 241
query84 290 109 87 87
query85 788 361 315 315
query86 445 292 286 286
query87 4312 4540 4314 4314
query88 3687 2229 2219 2219
query89 397 305 282 282
query90 1717 311 208 208
query91 139 149 110 110
query92 70 57 55 55
query93 2577 928 579 579
query94 761 412 314 314
query95 370 290 287 287
query96 476 582 276 276
query97 3200 3250 3119 3119
query98 236 206 200 200
query99 1433 1414 1263 1263
Total cold run time: 297168 ms
Total hot run time: 192750 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) remove const join condition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49730:
URL: https://github.com/apache/doris/pull/49730#issuecomment-2768040708
<details>
<summary>TPC-DS: <b>Total hot run time: 192405 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b77fcf4a3b1015bec1febfa73ffef89451deb782, data reload: false
query1 1398 1059 1045 1045
query2 6192 1917 1892 1892
query3 11017 4539 4523 4523
query4 54030 24752 23211 23211
query5 5201 490 454 454
query6 353 198 185 185
query7 4957 495 283 283
query8 317 238 220 220
query9 5982 2614 2602 2602
query10 450 325 271 271
query11 15103 15126 14727 14727
query12 165 119 106 106
query13 1097 509 409 409
query14 10119 6323 6262 6262
query15 215 189 187 187
query16 7023 701 490 490
query17 1113 749 609 609
query18 1548 410 326 326
query19 221 205 183 183
query20 141 130 125 125
query21 211 127 108 108
query22 4491 4358 4415 4358
query23 34053 33349 33221 33221
query24 6707 2426 2407 2407
query25 465 455 402 402
query26 719 285 155 155
query27 2303 511 345 345
query28 3145 2442 2454 2442
query29 576 563 455 455
query30 268 225 191 191
query31 856 866 765 765
query32 75 69 64 64
query33 462 383 313 313
query34 770 840 530 530
query35 831 832 762 762
query36 961 1007 909 909
query37 119 97 78 78
query38 4213 4084 4110 4084
query39 1642 1426 1438 1426
query40 217 119 105 105
query41 53 51 51 51
query42 128 114 104 104
query43 499 510 470 470
query44 1331 839 820 820
query45 179 175 169 169
query46 849 1025 654 654
query47 1855 1892 1798 1798
query48 388 418 312 312
query49 698 521 424 424
query50 653 684 412 412
query51 4271 4291 4152 4152
query52 110 111 100 100
query53 231 268 207 207
query54 593 580 513 513
query55 82 80 82 80
query56 301 312 288 288
query57 1187 1209 1124 1124
query58 269 265 267 265
query59 2696 2748 2596 2596
query60 337 329 311 311
query61 150 130 128 128
query62 713 746 693 693
query63 230 186 193 186
query64 2025 1041 716 716
query65 4468 4313 4381 4313
query66 756 405 308 308
query67 15795 15784 15536 15536
query68 7704 885 520 520
query69 530 305 257 257
query70 1196 1058 1112 1058
query71 492 313 284 284
query72 5997 4791 5008 4791
query73 1408 680 345 345
query74 8900 9072 8652 8652
query75 3882 3174 2708 2708
query76 4246 1182 789 789
query77 632 355 282 282
query78 9983 9906 9240 9240
query79 3468 825 581 581
query80 652 516 445 445
query81 480 257 220 220
query82 480 131 95 95
query83 359 252 242 242
query84 298 108 84 84
query85 820 355 309 309
query86 437 326 289 289
query87 4579 4437 4372 4372
query88 3192 2210 2218 2210
query89 434 322 281 281
query90 1930 211 210 210
query91 146 142 112 112
query92 74 60 57 57
query93 2532 935 584 584
query94 663 402 273 273
query95 367 299 286 286
query96 488 570 272 272
query97 3167 3267 3105 3105
query98 242 209 204 204
query99 1465 1385 1288 1288
Total cold run time: 301816 ms
Total hot run time: 192405 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org