You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Mryange (via GitHub)" <gi...@apache.org> on 2025/12/23 03:42:34 UTC
[PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Mryange opened a new pull request, #59274:
URL: https://github.com/apache/doris/pull/59274
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685249460
<details>
<summary>TPC-DS: <b>Total hot run time: 179349 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b24a3fb7786f50878495ddb1e99cc341d9c820d2, data reload: false
query5 4379 590 466 466
query6 357 245 229 229
query7 4231 476 282 282
query8 330 250 255 250
query9 8794 2524 2539 2524
query10 524 395 332 332
query11 15473 14909 14612 14612
query12 177 118 117 117
query13 1275 505 397 397
query14 5836 2997 2745 2745
query14_1 2664 2598 2616 2598
query15 203 197 177 177
query16 855 472 446 446
query17 1146 718 619 619
query18 2447 439 352 352
query19 234 235 210 210
query20 123 114 115 114
query21 222 149 118 118
query22 4108 4088 3961 3961
query23 16708 16179 16245 16179
query23_1 16098 16213 16018 16018
query24 7338 1630 1210 1210
query24_1 1221 1203 1260 1203
query25 549 484 408 408
query26 1251 266 162 162
query27 2766 465 304 304
query28 4503 2127 2118 2118
query29 851 538 438 438
query30 309 240 217 217
query31 821 712 634 634
query32 73 68 67 67
query33 522 335 275 275
query34 905 913 546 546
query35 765 797 712 712
query36 852 905 812 812
query37 128 90 80 80
query38 2981 2979 2910 2910
query39 802 745 748 745
query39_1 733 699 710 699
query40 223 138 119 119
query41 66 62 59 59
query42 109 103 101 101
query43 422 457 400 400
query44 1314 755 739 739
query45 195 192 178 178
query46 879 973 600 600
query47 1668 1734 1663 1663
query48 312 314 243 243
query49 631 429 339 339
query50 657 304 224 224
query51 3813 3775 3976 3775
query52 109 112 96 96
query53 325 346 283 283
query54 279 254 239 239
query55 76 77 71 71
query56 308 289 315 289
query57 1185 1138 1103 1103
query58 267 264 245 245
query59 2435 2539 2404 2404
query60 310 308 284 284
query61 163 156 157 156
query62 742 685 666 666
query63 323 291 304 291
query64 5126 1357 987 987
query65 4071 3957 3954 3954
query66 1446 428 317 317
query67 15402 15199 14865 14865
query68 3250 1048 741 741
query69 486 346 313 313
query70 1057 1003 941 941
query71 347 299 276 276
query72 6207 5161 5309 5161
query73 704 616 308 308
query74 8612 8840 8917 8840
query75 3193 3163 2816 2816
query76 3752 1128 786 786
query77 524 403 286 286
query78 9512 9739 8886 8886
query79 1357 912 619 619
query80 1543 646 553 553
query81 546 271 234 234
query82 410 140 102 102
query83 363 260 246 246
query84 254 127 101 101
query85 936 516 463 463
query86 387 320 278 278
query87 3151 3233 3170 3170
query88 3275 2280 2283 2280
query89 462 420 402 402
query90 1963 168 161 161
query91 172 168 142 142
query92 77 66 67 66
query93 1135 941 558 558
query94 525 312 269 269
query95 583 369 301 301
query96 593 467 211 211
query97 2315 2294 2202 2202
query98 212 203 191 191
query99 1411 1363 1292 1292
Total cold run time: 255607 ms
Total hot run time: 179349 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "Mryange (via GitHub)" <gi...@apache.org>.
Mryange closed pull request #59274: [WIP] enable_streaming_agg_force_passthrough
URL: https://github.com/apache/doris/pull/59274
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685508456
# BE UT Coverage Report
Increment line coverage `0.00% (0/7)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/b24a3fb7786f50878495ddb1e99cc341d9c820d2_b24a3fb7786f50878495ddb1e99cc341d9c820d2/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/b24a3fb7786f50878495ddb1e99cc341d9c820d2_b24a3fb7786f50878495ddb1e99cc341d9c820d2/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 53.42% (18929/35435) |
| Line Coverage | 39.31% (175505/446494) |
| Region Coverage | 33.87% (135876/401139) |
| Branch Coverage | 34.77% (58544/168378) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685264562
<details>
<summary>ClickBench: <b>Total hot run time: 28.01 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b24a3fb7786f50878495ddb1e99cc341d9c820d2, data reload: false
query1 0.06 0.04 0.05
query2 0.09 0.05 0.05
query3 0.25 0.09 0.09
query4 1.61 0.11 0.11
query5 0.26 0.25 0.25
query6 1.17 0.64 0.64
query7 0.03 0.03 0.02
query8 0.06 0.05 0.04
query9 0.56 0.51 0.50
query10 0.55 0.55 0.53
query11 0.16 0.11 0.12
query12 0.15 0.12 0.12
query13 0.62 0.60 0.62
query14 1.00 0.99 0.98
query15 0.81 0.79 0.82
query16 0.38 0.42 0.39
query17 0.98 1.00 1.03
query18 0.24 0.22 0.21
query19 1.91 1.84 1.70
query20 0.02 0.01 0.02
query21 15.45 0.31 0.14
query22 4.85 0.05 0.04
query23 16.08 0.28 0.11
query24 1.33 0.67 0.89
query25 0.10 0.12 0.06
query26 0.13 0.13 0.14
query27 0.06 0.05 0.06
query28 5.16 1.23 1.03
query29 12.58 4.03 3.18
query30 0.29 0.15 0.12
query31 2.82 0.63 0.39
query32 3.23 0.54 0.46
query33 3.00 3.03 3.00
query34 16.74 5.25 4.54
query35 4.57 5.01 5.10
query36 0.70 0.54 0.56
query37 0.11 0.08 0.07
query38 0.08 0.04 0.04
query39 0.04 0.03 0.03
query40 0.18 0.15 0.14
query41 0.08 0.04 0.03
query42 0.04 0.02 0.03
query43 0.05 0.04 0.03
Total cold run time: 98.58 s
Total hot run time: 28.01 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685756230
# BE Regression && UT Coverage Report
Increment line coverage `100.00% (7/7)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59274_b24a3fb7786f50878495ddb1e99cc341d9c820d2_merge/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59274_b24a3fb7786f50878495ddb1e99cc341d9c820d2_merge/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 73.91% (25599/34637) |
| Line Coverage | 61.34% (273083/445217) |
| Region Coverage | 56.38% (228521/405331) |
| Branch Coverage | 58.21% (98353/168956) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3684972130
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "Mryange (via GitHub)" <gi...@apache.org>.
Mryange commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3684972254
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685217779
<details>
<summary>TPC-H: <b>Total hot run time: 34974 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b24a3fb7786f50878495ddb1e99cc341d9c820d2, data reload: false
------ Round 1 ----------------------------------
q1 17615 4213 4063 4063
q2 1993 367 237 237
q3 10186 1332 735 735
q4 10220 905 331 331
q5 7501 2125 1994 1994
q6 193 166 136 136
q7 1008 858 703 703
q8 9378 1460 1172 1172
q9 7110 5372 5373 5372
q10 6879 2398 1981 1981
q11 559 339 316 316
q12 684 735 562 562
q13 17769 3728 3005 3005
q14 303 298 283 283
q15 599 526 501 501
q16 690 687 648 648
q17 721 830 566 566
q18 7749 7154 7139 7139
q19 1091 965 586 586
q20 408 363 254 254
q21 4244 3991 3437 3437
q22 1050 1002 953 953
Total cold run time: 107950 ms
Total hot run time: 34974 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4097 4058 4048 4048
q2 326 397 307 307
q3 2153 2649 2312 2312
q4 1341 1757 1279 1279
q5 4277 4638 4775 4638
q6 229 177 135 135
q7 2093 1963 1833 1833
q8 2702 2584 2608 2584
q9 7817 7613 7598 7598
q10 3072 3256 2820 2820
q11 664 556 521 521
q12 647 770 627 627
q13 3673 3897 3296 3296
q14 293 320 284 284
q15 546 509 511 509
q16 672 682 629 629
q17 1306 1423 1331 1331
q18 8077 7624 7747 7624
q19 879 881 908 881
q20 1983 2026 1975 1975
q21 4790 4341 4179 4179
q22 1072 1018 1003 1003
Total cold run time: 52709 ms
Total hot run time: 50413 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685802135
# FE Regression Coverage Report
Increment line coverage ` 100.00% (3/3)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59274_b24a3fb7786f50878495ddb1e99cc341d9c820d2_merge_fe/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59274_b24a3fb7786f50878495ddb1e99cc341d9c820d2_merge_fe/report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [WIP] enable_streaming_agg_force_passthrough [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59274:
URL: https://github.com/apache/doris/pull/59274#issuecomment-3685042438
# Cloud UT Coverage Report
Increment line coverage ` ` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/b24a3fb7786f50878495ddb1e99cc341d9c820d2_b24a3fb7786f50878495ddb1e99cc341d9c820d2_cloud/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/b24a3fb7786f50878495ddb1e99cc341d9c820d2_b24a3fb7786f50878495ddb1e99cc341d9c820d2_cloud/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 79.48% (1766/2222) |
| Line Coverage | 64.82% (31247/48205) |
| Region Coverage | 65.34% (15550/23798) |
| Branch Coverage | 55.97% (8264/14764) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org