You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HappenLee (via GitHub)" <gi...@apache.org> on 2025/12/30 10:01:46 UTC
[PR] scanner merge after projection [doris]
HappenLee opened a new pull request, #59492:
URL: https://github.com/apache/doris/pull/59492
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3699127855
<details>
<summary>ClickBench: <b>Total hot run time: 27.19 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9a6c8f22c77d368df3f7fe889f92f054c16d4036, data reload: false
query1 0.06 0.05 0.04
query2 0.10 0.04 0.04
query3 0.25 0.08 0.08
query4 1.60 0.12 0.11
query5 0.27 0.26 0.26
query6 1.15 0.67 0.66
query7 0.04 0.02 0.03
query8 0.05 0.04 0.04
query9 0.58 0.52 0.50
query10 0.56 0.56 0.54
query11 0.15 0.10 0.11
query12 0.14 0.11 0.11
query13 0.62 0.60 0.60
query14 0.99 0.97 0.98
query15 0.81 0.78 0.80
query16 0.42 0.41 0.43
query17 1.05 1.07 1.07
query18 0.23 0.22 0.21
query19 1.84 1.92 1.88
query20 0.03 0.02 0.01
query21 15.46 0.26 0.14
query22 5.11 0.05 0.06
query23 15.81 0.30 0.10
query24 2.14 0.66 0.27
query25 0.13 0.06 0.07
query26 0.14 0.13 0.14
query27 0.07 0.06 0.06
query28 5.00 1.07 0.88
query29 12.55 3.86 3.16
query30 0.28 0.13 0.12
query31 2.83 0.64 0.39
query32 3.23 0.55 0.46
query33 3.07 3.10 3.05
query34 16.83 5.14 4.56
query35 4.45 4.49 4.50
query36 0.65 0.49 0.48
query37 0.10 0.06 0.06
query38 0.07 0.04 0.05
query39 0.04 0.03 0.03
query40 0.17 0.15 0.14
query41 0.09 0.03 0.03
query42 0.04 0.02 0.03
query43 0.05 0.04 0.04
Total cold run time: 99.25 s
Total hot run time: 27.19 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702428805
# BE UT Coverage Report
Increment line coverage `0.00% (0/37)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/e415f36ba127a142996dbe92492162ce2eb92bb8_e415f36ba127a142996dbe92492162ce2eb92bb8/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/e415f36ba127a142996dbe92492162ce2eb92bb8_e415f36ba127a142996dbe92492162ce2eb92bb8/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 53.39% (18964/35519) |
| Line Coverage | 39.26% (175954/448203) |
| Region Coverage | 33.80% (136062/402507) |
| Branch Coverage | 34.75% (58795/169188) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703209345
<details>
<summary>TPC-DS: <b>Total hot run time: 173375 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da, data reload: false
query5 4964 580 443 443
query6 328 246 219 219
query7 4211 451 267 267
query8 354 262 244 244
query9 8772 2590 2624 2590
query10 532 378 334 334
query11 15344 15034 14848 14848
query12 191 120 116 116
query13 1280 506 429 429
query14 6456 2981 2687 2687
query14_1 2612 2616 2596 2596
query15 203 190 174 174
query16 1002 471 370 370
query17 1036 649 562 562
query18 2665 438 329 329
query19 225 216 194 194
query20 125 117 113 113
query21 216 136 122 122
query22 4005 3965 4092 3965
query23 16988 16097 15757 15757
query23_1 15864 15766 15890 15766
query24 8131 1644 1213 1213
query24_1 1191 1200 1198 1198
query25 562 491 415 415
query26 1244 261 156 156
query27 2788 430 286 286
query28 4541 2133 2132 2132
query29 786 543 453 453
query30 307 240 210 210
query31 780 641 542 542
query32 79 69 64 64
query33 544 339 288 288
query34 885 886 531 531
query35 750 796 690 690
query36 883 857 829 829
query37 129 95 71 71
query38 2719 2831 2742 2742
query39 765 744 721 721
query39_1 719 717 697 697
query40 222 134 115 115
query41 70 64 67 64
query42 105 104 103 103
query43 465 477 465 465
query44 1318 732 739 732
query45 193 180 177 177
query46 840 1009 591 591
query47 1348 1429 1339 1339
query48 327 327 266 266
query49 605 429 323 323
query50 644 274 208 208
query51 3687 3757 3728 3728
query52 115 106 96 96
query53 301 324 269 269
query54 276 261 243 243
query55 81 73 68 68
query56 288 288 283 283
query57 993 976 952 952
query58 262 250 243 243
query59 2147 2237 2163 2163
query60 316 320 293 293
query61 159 155 153 153
query62 379 366 332 332
query63 307 270 268 268
query64 4869 1306 1012 1012
query65 3715 3752 3790 3752
query66 1398 393 290 290
query67 15501 14859 14729 14729
query68 8285 1003 709 709
query69 498 346 310 310
query70 1048 966 935 935
query71 349 298 280 280
query72 6040 3400 3438 3400
query73 774 721 297 297
query74 8849 8820 8660 8660
query75 2841 2819 2429 2429
query76 3988 1058 651 651
query77 540 365 268 268
query78 9695 9855 9070 9070
query79 1425 896 577 577
query80 614 578 469 469
query81 525 264 230 230
query82 208 146 111 111
query83 264 257 239 239
query84 260 121 102 102
query85 888 516 447 447
query86 404 319 333 319
query87 2826 2875 2750 2750
query88 4266 2206 2200 2200
query89 393 348 321 321
query90 2198 149 145 145
query91 175 161 146 146
query92 91 66 61 61
query93 1605 873 532 532
query94 562 333 289 289
query95 581 318 300 300
query96 565 467 203 203
query97 2311 2328 2283 2283
query98 234 200 196 196
query99 570 589 529 529
Total cold run time: 259075 ms
Total hot run time: 173375 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702610264
<details>
<summary>TPC-DS: <b>Total hot run time: 173401 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 99202f5035272ca92d90099ab89e0bb586ce3078, data reload: false
query5 4801 575 427 427
query6 327 233 211 211
query7 4217 463 266 266
query8 326 250 235 235
query9 8759 2616 2613 2613
query10 502 363 310 310
query11 15149 15136 14973 14973
query12 164 117 113 113
query13 1269 478 383 383
query14 6245 2981 2763 2763
query14_1 2750 2675 2682 2675
query15 199 191 171 171
query16 979 476 472 472
query17 1089 684 595 595
query18 2454 443 349 349
query19 223 232 201 201
query20 123 124 115 115
query21 216 142 121 121
query22 3928 4087 4124 4087
query23 15930 15840 15375 15375
query23_1 15362 15495 15477 15477
query24 7573 1609 1221 1221
query24_1 1221 1197 1211 1197
query25 586 481 427 427
query26 1253 271 170 170
query27 2756 464 291 291
query28 4557 2150 2127 2127
query29 793 555 471 471
query30 316 245 208 208
query31 800 628 553 553
query32 79 71 70 70
query33 569 355 300 300
query34 913 895 536 536
query35 739 774 705 705
query36 855 898 826 826
query37 130 136 73 73
query38 2698 2707 2668 2668
query39 788 781 718 718
query39_1 708 705 734 705
query40 213 133 115 115
query41 69 63 65 63
query42 103 104 101 101
query43 455 454 398 398
query44 1307 741 735 735
query45 191 181 175 175
query46 846 977 625 625
query47 1442 1452 1372 1372
query48 309 326 250 250
query49 598 422 323 323
query50 637 277 215 215
query51 3767 3816 3760 3760
query52 106 109 97 97
query53 287 326 284 284
query54 281 266 249 249
query55 78 76 70 70
query56 290 287 287 287
query57 1003 1008 960 960
query58 265 250 247 247
query59 2071 2237 2079 2079
query60 318 313 302 302
query61 165 159 154 154
query62 400 364 309 309
query63 302 261 271 261
query64 4942 1334 1001 1001
query65 3737 3700 3725 3700
query66 1435 421 327 327
query67 14780 15087 14814 14814
query68 8306 991 709 709
query69 482 341 305 305
query70 1034 968 925 925
query71 350 305 270 270
query72 6173 3713 3455 3455
query73 753 717 304 304
query74 8771 8748 8685 8685
query75 2819 2807 2461 2461
query76 3924 1074 658 658
query77 521 381 276 276
query78 9680 9938 9207 9207
query79 1257 874 579 579
query80 641 582 496 496
query81 509 258 227 227
query82 209 148 112 112
query83 257 254 238 238
query84 252 115 100 100
query85 894 519 471 471
query86 387 325 304 304
query87 2910 2840 2780 2780
query88 3226 2224 2186 2186
query89 395 349 330 330
query90 2181 154 147 147
query91 176 169 143 143
query92 79 63 65 63
query93 1637 894 551 551
query94 590 321 301 301
query95 575 376 304 304
query96 579 455 199 199
query97 2330 2372 2324 2324
query98 217 205 197 197
query99 585 578 498 498
Total cold run time: 254131 ms
Total hot run time: 173401 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703242070
# BE UT Coverage Report
Increment line coverage `0.00% (0/38)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da_efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da_efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 53.39% (18965/35519) |
| Line Coverage | 39.27% (175992/448204) |
| Region Coverage | 33.80% (136039/402520) |
| Branch Coverage | 34.75% (58797/169194) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703225136
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702884935
# BE Regression && UT Coverage Report
Increment line coverage `81.08% (30/37)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59492_99202f5035272ca92d90099ab89e0bb586ce3078_merge/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59492_99202f5035272ca92d90099ab89e0bb586ce3078_merge/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 73.89% (25656/34724) |
| Line Coverage | 61.32% (274087/447011) |
| Region Coverage | 56.12% (228240/406670) |
| Branch Coverage | 58.04% (98530/169750) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702213134
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702338610
<details>
<summary>ClickBench: <b>Total hot run time: 26.95 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e415f36ba127a142996dbe92492162ce2eb92bb8, data reload: false
query1 0.06 0.05 0.05
query2 0.10 0.05 0.05
query3 0.26 0.08 0.09
query4 1.61 0.12 0.11
query5 0.27 0.26 0.27
query6 1.15 0.67 0.66
query7 0.04 0.03 0.03
query8 0.06 0.04 0.05
query9 0.57 0.51 0.52
query10 0.55 0.56 0.54
query11 0.16 0.11 0.11
query12 0.17 0.14 0.13
query13 0.62 0.59 0.60
query14 0.98 0.99 0.99
query15 0.81 0.80 0.80
query16 0.39 0.40 0.42
query17 1.03 1.01 1.05
query18 0.23 0.21 0.21
query19 1.95 1.92 1.74
query20 0.01 0.02 0.01
query21 15.46 0.29 0.14
query22 4.78 0.05 0.05
query23 16.08 0.26 0.10
query24 0.93 0.33 0.55
query25 0.12 0.06 0.04
query26 0.15 0.14 0.13
query27 0.11 0.06 0.05
query28 3.91 1.04 0.88
query29 12.62 3.96 3.16
query30 0.27 0.14 0.12
query31 2.81 0.62 0.39
query32 3.23 0.55 0.48
query33 3.12 3.00 3.03
query34 16.83 5.13 4.47
query35 4.52 4.46 4.46
query36 0.65 0.50 0.49
query37 0.11 0.07 0.07
query38 0.07 0.04 0.03
query39 0.04 0.03 0.03
query40 0.18 0.14 0.12
query41 0.08 0.03 0.03
query42 0.04 0.03 0.03
query43 0.04 0.04 0.03
Total cold run time: 97.17 s
Total hot run time: 26.95 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703212946
<details>
<summary>ClickBench: <b>Total hot run time: 26.86 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da, data reload: false
query1 0.05 0.05 0.05
query2 0.10 0.05 0.04
query3 0.26 0.09 0.09
query4 1.62 0.12 0.12
query5 0.26 0.27 0.26
query6 1.15 0.68 0.63
query7 0.03 0.02 0.02
query8 0.06 0.04 0.04
query9 0.57 0.51 0.49
query10 0.53 0.55 0.55
query11 0.15 0.10 0.10
query12 0.15 0.10 0.11
query13 0.59 0.59 0.59
query14 0.95 0.96 0.94
query15 0.78 0.77 0.78
query16 0.40 0.41 0.40
query17 1.04 1.01 1.04
query18 0.23 0.21 0.21
query19 1.93 1.87 1.84
query20 0.02 0.01 0.02
query21 15.43 0.26 0.14
query22 5.33 0.05 0.05
query23 16.07 0.27 0.11
query24 1.02 0.35 0.18
query25 0.09 0.11 0.05
query26 0.15 0.13 0.12
query27 0.08 0.10 0.05
query28 3.56 1.05 0.88
query29 12.56 3.91 3.20
query30 0.27 0.13 0.14
query31 2.82 0.64 0.40
query32 3.24 0.56 0.45
query33 2.93 3.02 3.02
query34 16.74 5.16 4.49
query35 4.47 4.50 4.53
query36 0.65 0.50 0.49
query37 0.10 0.07 0.06
query38 0.07 0.04 0.04
query39 0.05 0.03 0.03
query40 0.17 0.13 0.12
query41 0.09 0.03 0.03
query42 0.05 0.03 0.03
query43 0.04 0.04 0.03
Total cold run time: 96.85 s
Total hot run time: 26.86 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3699352455
# BE Regression && UT Coverage Report
Increment line coverage `79.41% (27/34)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59492_9a6c8f22c77d368df3f7fe889f92f054c16d4036_merge/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59492_9a6c8f22c77d368df3f7fe889f92f054c16d4036_merge/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 58.16% (20190/34714) |
| Line Coverage | 43.95% (196414/446908) |
| Region Coverage | 38.66% (157187/406595) |
| Branch Coverage | 39.28% (66672/169724) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702622292
<details>
<summary>ClickBench: <b>Total hot run time: 26.91 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 99202f5035272ca92d90099ab89e0bb586ce3078, data reload: false
query1 0.05 0.04 0.04
query2 0.10 0.05 0.05
query3 0.26 0.09 0.09
query4 1.61 0.11 0.11
query5 0.28 0.26 0.26
query6 1.15 0.67 0.65
query7 0.03 0.03 0.02
query8 0.05 0.04 0.05
query9 0.57 0.50 0.51
query10 0.56 0.56 0.54
query11 0.15 0.10 0.10
query12 0.15 0.10 0.11
query13 0.62 0.60 0.61
query14 1.00 0.99 0.98
query15 0.82 0.81 0.81
query16 0.39 0.39 0.40
query17 1.04 1.04 1.02
query18 0.23 0.21 0.22
query19 1.87 1.78 1.85
query20 0.01 0.01 0.02
query21 15.44 0.27 0.14
query22 5.35 0.05 0.04
query23 16.07 0.27 0.10
query24 1.23 1.36 0.33
query25 0.10 0.05 0.06
query26 0.14 0.13 0.13
query27 0.06 0.04 0.06
query28 4.30 1.04 0.88
query29 12.62 3.91 3.13
query30 0.27 0.14 0.12
query31 2.82 0.64 0.39
query32 3.23 0.55 0.46
query33 2.95 3.02 3.10
query34 16.74 5.06 4.47
query35 4.51 4.53 4.45
query36 0.69 0.50 0.49
query37 0.10 0.06 0.07
query38 0.07 0.05 0.05
query39 0.04 0.03 0.04
query40 0.17 0.14 0.14
query41 0.09 0.04 0.03
query42 0.04 0.03 0.03
query43 0.04 0.04 0.03
Total cold run time: 98.01 s
Total hot run time: 26.91 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3701975497
<details>
<summary>ClickBench: <b>Total hot run time: 27.27 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7cfacbb9fb4635a59109a572c8c550a482357905, data reload: false
query1 0.05 0.05 0.05
query2 0.10 0.05 0.05
query3 0.26 0.10 0.09
query4 1.61 0.12 0.11
query5 0.27 0.26 0.25
query6 1.14 0.67 0.66
query7 0.03 0.02 0.02
query8 0.05 0.04 0.04
query9 0.57 0.51 0.50
query10 0.56 0.55 0.54
query11 0.15 0.09 0.10
query12 0.15 0.11 0.11
query13 0.62 0.60 0.61
query14 0.98 0.99 0.98
query15 0.81 0.79 0.78
query16 0.39 0.40 0.39
query17 1.05 1.06 1.06
query18 0.23 0.22 0.21
query19 1.93 1.83 1.89
query20 0.02 0.02 0.01
query21 15.42 0.26 0.13
query22 5.18 0.05 0.05
query23 15.87 0.27 0.10
query24 1.36 0.67 0.55
query25 0.11 0.07 0.06
query26 0.14 0.13 0.13
query27 0.07 0.05 0.07
query28 5.22 1.06 0.88
query29 12.62 3.96 3.18
query30 0.28 0.14 0.12
query31 2.83 0.62 0.41
query32 3.23 0.55 0.46
query33 3.00 3.00 3.02
query34 16.78 5.14 4.44
query35 4.49 4.49 4.51
query36 0.67 0.50 0.49
query37 0.11 0.06 0.06
query38 0.07 0.05 0.04
query39 0.05 0.03 0.03
query40 0.17 0.15 0.14
query41 0.09 0.04 0.03
query42 0.04 0.03 0.03
query43 0.05 0.04 0.03
Total cold run time: 98.82 s
Total hot run time: 27.27 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703157254
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3698888797
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702330997
<details>
<summary>TPC-DS: <b>Total hot run time: 174042 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e415f36ba127a142996dbe92492162ce2eb92bb8, data reload: false
query5 4624 601 428 428
query6 344 236 212 212
query7 4204 463 279 279
query8 342 244 237 237
query9 8766 2642 2658 2642
query10 509 368 309 309
query11 15353 15317 14931 14931
query12 165 116 110 110
query13 1263 493 411 411
query14 6045 2964 2701 2701
query14_1 2626 2602 2617 2602
query15 195 192 180 180
query16 1000 474 461 461
query17 1072 650 572 572
query18 2435 427 339 339
query19 229 221 191 191
query20 121 118 113 113
query21 212 140 116 116
query22 3857 4073 4019 4019
query23 16236 15810 15440 15440
query23_1 15600 15564 15672 15564
query24 7439 1625 1246 1246
query24_1 1224 1223 1199 1199
query25 576 477 438 438
query26 1248 269 171 171
query27 2746 468 306 306
query28 4551 2202 2198 2198
query29 845 557 463 463
query30 314 247 223 223
query31 802 638 568 568
query32 81 77 74 74
query33 556 352 307 307
query34 915 878 536 536
query35 761 793 703 703
query36 897 885 800 800
query37 128 94 85 85
query38 2685 2784 2645 2645
query39 782 766 727 727
query39_1 723 737 715 715
query40 225 138 119 119
query41 71 70 67 67
query42 108 106 112 106
query43 468 433 432 432
query44 1363 787 776 776
query45 189 187 178 178
query46 877 958 623 623
query47 1429 1371 1299 1299
query48 333 338 261 261
query49 620 433 349 349
query50 648 298 207 207
query51 3730 3827 3798 3798
query52 109 108 95 95
query53 300 329 277 277
query54 307 295 288 288
query55 83 82 79 79
query56 306 315 322 315
query57 1003 1015 954 954
query58 282 262 268 262
query59 2035 2163 2012 2012
query60 381 306 296 296
query61 161 158 159 158
query62 403 366 305 305
query63 302 265 274 265
query64 5048 1284 971 971
query65 3864 3672 3629 3629
query66 1440 428 319 319
query67 14814 14779 15551 14779
query68 8205 1034 729 729
query69 516 349 307 307
query70 1069 960 959 959
query71 374 303 274 274
query72 6165 3415 3496 3415
query73 778 728 308 308
query74 8732 8769 8723 8723
query75 2852 2844 2482 2482
query76 3799 1060 662 662
query77 536 371 280 280
query78 9709 9904 9291 9291
query79 1375 912 610 610
query80 629 575 487 487
query81 509 260 234 234
query82 214 151 113 113
query83 266 272 244 244
query84 257 126 107 107
query85 901 526 463 463
query86 387 299 317 299
query87 2876 2831 2737 2737
query88 3600 2269 2262 2262
query89 383 356 343 343
query90 2176 156 148 148
query91 173 167 142 142
query92 82 72 58 58
query93 1644 899 559 559
query94 580 343 323 323
query95 566 319 305 305
query96 588 486 208 208
query97 2325 2360 2294 2294
query98 223 205 194 194
query99 589 587 511 511
Total cold run time: 256077 ms
Total hot run time: 174042 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702841011
# BE UT Coverage Report
Increment line coverage `0.00% (0/37)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/99202f5035272ca92d90099ab89e0bb586ce3078_99202f5035272ca92d90099ab89e0bb586ce3078/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/99202f5035272ca92d90099ab89e0bb586ce3078_99202f5035272ca92d90099ab89e0bb586ce3078/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 53.39% (18965/35519) |
| Line Coverage | 39.27% (176005/448203) |
| Region Coverage | 33.85% (136235/402507) |
| Branch Coverage | 34.76% (58817/169188) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3698888103
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702591220
<details>
<summary>TPC-H: <b>Total hot run time: 32012 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 99202f5035272ca92d90099ab89e0bb586ce3078, data reload: false
------ Round 1 ----------------------------------
q1 17620 4213 4008 4008
q2 1998 348 233 233
q3 10199 1255 710 710
q4 10217 922 318 318
q5 7572 2082 1916 1916
q6 192 169 141 141
q7 934 793 671 671
q8 9255 1398 1152 1152
q9 4959 4625 4742 4625
q10 6741 1808 1416 1416
q11 537 291 280 280
q12 670 750 606 606
q13 17768 3786 3112 3112
q14 286 288 270 270
q15 589 516 490 490
q16 691 699 624 624
q17 667 791 546 546
q18 6517 6359 6705 6359
q19 1169 1032 647 647
q20 461 452 288 288
q21 3278 2607 2559 2559
q22 1117 1118 1041 1041
Total cold run time: 103437 ms
Total hot run time: 32012 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4275 4234 4251 4234
q2 343 389 313 313
q3 2332 2752 2436 2436
q4 1420 1844 1370 1370
q5 4694 4295 4308 4295
q6 219 167 131 131
q7 1958 1904 1925 1904
q8 2539 2370 2346 2346
q9 7211 7267 6939 6939
q10 2482 2604 2252 2252
q11 552 483 462 462
q12 684 752 651 651
q13 3651 3977 3262 3262
q14 292 282 275 275
q15 518 482 477 477
q16 604 636 630 630
q17 1094 1231 1373 1231
q18 7277 7151 7088 7088
q19 804 773 794 773
q20 1880 1945 1796 1796
q21 4538 4346 4121 4121
q22 1125 1028 993 993
Total cold run time: 50492 ms
Total hot run time: 47979 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702515297
# BE Regression && UT Coverage Report
Increment line coverage `70.27% (26/37)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59492_e415f36ba127a142996dbe92492162ce2eb92bb8_merge/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59492_e415f36ba127a142996dbe92492162ce2eb92bb8_merge/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 72.17% (25059/34724) |
| Line Coverage | 58.90% (263270/447011) |
| Region Coverage | 53.75% (218595/406670) |
| Branch Coverage | 55.29% (93861/169750) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703202391
<details>
<summary>TPC-H: <b>Total hot run time: 31608 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da, data reload: false
------ Round 1 ----------------------------------
q1 17667 4201 4052 4052
q2 2046 376 243 243
q3 10136 1327 723 723
q4 10231 957 345 345
q5 7579 2111 1906 1906
q6 199 181 145 145
q7 914 822 661 661
q8 9272 1427 1168 1168
q9 4956 4589 4508 4508
q10 6751 1799 1412 1412
q11 524 311 298 298
q12 693 734 575 575
q13 17798 3806 3068 3068
q14 288 298 290 290
q15 591 513 508 508
q16 705 686 636 636
q17 698 841 511 511
q18 7197 6426 6535 6426
q19 1088 974 603 603
q20 407 371 251 251
q21 3014 2332 2355 2332
q22 1052 997 947 947
Total cold run time: 103806 ms
Total hot run time: 31608 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4089 4017 4054 4017
q2 340 418 318 318
q3 2099 2582 2167 2167
q4 1315 1770 1298 1298
q5 4099 4078 4076 4076
q6 218 172 133 133
q7 1850 1808 1867 1808
q8 2691 2459 2415 2415
q9 7177 7395 7332 7332
q10 2607 2764 2278 2278
q11 565 581 516 516
q12 689 730 615 615
q13 3585 3996 3408 3408
q14 285 296 294 294
q15 544 504 505 504
q16 681 691 638 638
q17 1146 1308 1370 1308
q18 8011 7954 7922 7922
q19 891 838 904 838
q20 1972 2098 1959 1959
q21 4664 4561 4409 4409
q22 1142 1150 1078 1078
Total cold run time: 50660 ms
Total hot run time: 49331 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703301580
# BE Regression && UT Coverage Report
Increment line coverage `81.58% (31/38)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/59492_efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da_merge/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/59492_efcbe4a0f1103b762631eb2fa0ffc5c0a25ab0da_merge/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 72.20% (25071/34724) |
| Line Coverage | 58.96% (263558/447012) |
| Region Coverage | 53.80% (218783/406683) |
| Branch Coverage | 55.41% (94070/169756) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703225153
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702315068
<details>
<summary>TPC-H: <b>Total hot run time: 32295 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e415f36ba127a142996dbe92492162ce2eb92bb8, data reload: false
------ Round 1 ----------------------------------
q1 17620 4259 4081 4081
q2 2025 355 234 234
q3 10166 1300 735 735
q4 10206 843 334 334
q5 7527 2173 1859 1859
q6 195 177 146 146
q7 991 810 666 666
q8 9262 1404 1150 1150
q9 5253 4804 4858 4804
q10 6795 1831 1420 1420
q11 517 301 290 290
q12 720 739 607 607
q13 17796 3864 3148 3148
q14 285 298 267 267
q15 599 511 501 501
q16 680 692 638 638
q17 726 733 642 642
q18 6859 6475 6471 6471
q19 1103 970 615 615
q20 393 367 255 255
q21 3236 2598 2447 2447
q22 1092 1049 985 985
Total cold run time: 104046 ms
Total hot run time: 32295 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4093 4063 4050 4050
q2 335 393 318 318
q3 2083 2592 2245 2245
q4 1334 1816 1304 1304
q5 4034 4030 4006 4006
q6 212 174 132 132
q7 1848 1838 2167 1838
q8 2577 2413 2360 2360
q9 7284 7151 7109 7109
q10 2577 2727 2327 2327
q11 571 492 460 460
q12 710 769 618 618
q13 3560 4110 3338 3338
q14 320 411 275 275
q15 551 504 509 504
q16 676 694 655 655
q17 1140 1346 1343 1343
q18 8230 8129 7831 7831
q19 920 895 951 895
q20 2053 2083 1935 1935
q21 4737 4383 4193 4193
q22 1141 1043 989 989
Total cold run time: 50986 ms
Total hot run time: 48725 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702528349
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3701836126
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3701952655
<details>
<summary>TPC-H: <b>Total hot run time: 32509 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7cfacbb9fb4635a59109a572c8c550a482357905, data reload: false
------ Round 1 ----------------------------------
q1 17650 4334 4084 4084
q2 2032 355 239 239
q3 10162 1296 738 738
q4 10225 894 333 333
q5 7493 2154 1937 1937
q6 194 176 143 143
q7 990 815 692 692
q8 9268 1555 1152 1152
q9 5120 4670 4629 4629
q10 6809 1816 1410 1410
q11 497 298 285 285
q12 680 725 630 630
q13 17801 3881 3092 3092
q14 295 305 283 283
q15 583 514 511 511
q16 690 721 645 645
q17 688 862 483 483
q18 6630 6505 6982 6505
q19 1319 1077 695 695
q20 435 382 287 287
q21 3294 2699 2764 2699
q22 1168 1082 1037 1037
Total cold run time: 104023 ms
Total hot run time: 32509 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4356 4344 4337 4337
q2 319 433 319 319
q3 2380 2853 2452 2452
q4 1424 1917 1415 1415
q5 4544 4530 4290 4290
q6 211 170 130 130
q7 1963 1973 1792 1792
q8 2727 2378 2352 2352
q9 7220 7088 7085 7085
q10 2520 2717 2325 2325
q11 586 462 441 441
q12 759 765 625 625
q13 3524 3801 3138 3138
q14 272 282 271 271
q15 526 493 500 493
q16 653 672 603 603
q17 1116 1273 1370 1273
q18 7294 7302 7183 7183
q19 870 796 821 796
q20 1889 1964 1817 1817
q21 4603 4322 4172 4172
q22 1089 1036 1008 1008
Total cold run time: 50845 ms
Total hot run time: 48317 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3699344411
# BE UT Coverage Report
Increment line coverage `0.00% (0/34)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/9a6c8f22c77d368df3f7fe889f92f054c16d4036_9a6c8f22c77d368df3f7fe889f92f054c16d4036/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/9a6c8f22c77d368df3f7fe889f92f054c16d4036_9a6c8f22c77d368df3f7fe889f92f054c16d4036/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 53.37% (18951/35509) |
| Line Coverage | 39.25% (175885/448100) |
| Region Coverage | 33.81% (136068/402432) |
| Branch Coverage | 34.74% (58771/169162) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3703177700
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [performance][Exec] scanner merge block before projection [doris]
Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 merged PR #59492:
URL: https://github.com/apache/doris/pull/59492
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3699118288
<details>
<summary>TPC-DS: <b>Total hot run time: 176204 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9a6c8f22c77d368df3f7fe889f92f054c16d4036, data reload: false
query5 4463 598 473 473
query6 336 229 219 219
query7 4225 481 270 270
query8 353 289 258 258
query9 8976 2653 2667 2653
query10 504 395 320 320
query11 15410 15222 15065 15065
query12 175 120 134 120
query13 1294 507 389 389
query14 5806 2992 2786 2786
query14_1 2631 2623 2650 2623
query15 204 197 176 176
query16 999 492 474 474
query17 1169 670 575 575
query18 2436 429 328 328
query19 217 218 187 187
query20 124 122 121 121
query21 214 146 118 118
query22 4002 4074 4186 4074
query23 15969 15663 15440 15440
query23_1 15526 15661 15584 15584
query24 7516 1595 1200 1200
query24_1 1212 1185 1199 1185
query25 529 456 418 418
query26 1284 265 169 169
query27 2799 468 289 289
query28 4628 2133 2116 2116
query29 747 517 454 454
query30 316 240 214 214
query31 787 645 561 561
query32 82 74 68 68
query33 554 341 280 280
query34 881 879 521 521
query35 762 810 688 688
query36 886 917 843 843
query37 139 110 95 95
query38 2678 2687 2615 2615
query39 768 750 739 739
query39_1 709 717 718 717
query40 227 137 118 118
query41 69 62 61 61
query42 109 110 115 110
query43 457 490 421 421
query44 1314 745 726 726
query45 187 183 177 177
query46 856 965 598 598
query47 1510 1403 1384 1384
query48 312 323 241 241
query49 609 415 325 325
query50 641 288 215 215
query51 3759 3753 3740 3740
query52 116 127 110 110
query53 293 329 271 271
query54 292 261 261 261
query55 85 78 74 74
query56 296 310 310 310
query57 1034 1050 984 984
query58 296 276 256 256
query59 2072 2111 2125 2111
query60 345 320 303 303
query61 159 176 152 152
query62 396 369 369 369
query63 298 271 266 266
query64 4967 1294 1002 1002
query65 3707 3763 3750 3750
query66 1483 439 299 299
query67 14916 15992 15341 15341
query68 2788 1012 739 739
query69 476 357 316 316
query70 1001 1001 1000 1000
query71 327 304 284 284
query72 6179 4960 5069 4960
query73 507 600 307 307
query74 8813 8840 8610 8610
query75 2863 2927 2520 2520
query76 2875 1067 658 658
query77 343 386 289 289
query78 9795 10160 9235 9235
query79 1097 867 596 596
query80 829 614 540 540
query81 503 266 231 231
query82 1334 150 114 114
query83 415 247 243 243
query84 257 113 100 100
query85 923 533 463 463
query86 366 358 334 334
query87 2863 2900 2753 2753
query88 3189 2228 2228 2228
query89 391 348 335 335
query90 1869 159 155 155
query91 171 167 140 140
query92 77 75 72 72
query93 946 894 545 545
query94 503 323 297 297
query95 581 381 312 312
query96 579 453 207 207
query97 2341 2380 2336 2336
query98 217 216 252 216
query99 584 585 495 495
Total cold run time: 247942 ms
Total hot run time: 176204 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3699098300
<details>
<summary>TPC-H: <b>Total hot run time: 34249 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9a6c8f22c77d368df3f7fe889f92f054c16d4036, data reload: false
------ Round 1 ----------------------------------
q1 17630 4243 4074 4074
q2 2043 380 241 241
q3 10156 1301 721 721
q4 10241 905 323 323
q5 7698 2187 1891 1891
q6 236 182 145 145
q7 946 823 670 670
q8 9276 1412 1163 1163
q9 6926 5225 5122 5122
q10 6823 1837 1396 1396
q11 516 314 276 276
q12 726 748 572 572
q13 17818 3830 3068 3068
q14 318 294 276 276
q15 585 515 521 515
q16 677 681 648 648
q17 679 779 577 577
q18 8052 7307 7359 7307
q19 1116 977 599 599
q20 406 355 253 253
q21 4177 4001 3443 3443
q22 1079 988 969 969
Total cold run time: 108124 ms
Total hot run time: 34249 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4131 4048 4042 4042
q2 337 403 311 311
q3 2088 2634 2212 2212
q4 1293 1789 1328 1328
q5 4104 4213 4493 4213
q6 256 203 149 149
q7 2058 1949 1781 1781
q8 2604 2344 2311 2311
q9 7257 7132 7159 7132
q10 2570 2739 2310 2310
q11 561 493 463 463
q12 723 760 606 606
q13 3841 4042 3435 3435
q14 304 326 296 296
q15 548 493 504 493
q16 660 686 655 655
q17 1132 1286 1345 1286
q18 8122 7708 7775 7708
q19 886 825 870 825
q20 1998 2259 1882 1882
q21 4665 4407 4127 4127
q22 1093 1068 1018 1018
Total cold run time: 51231 ms
Total hot run time: 48583 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3701968252
<details>
<summary>TPC-DS: <b>Total hot run time: 173136 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7cfacbb9fb4635a59109a572c8c550a482357905, data reload: false
query5 4567 588 449 449
query6 333 248 212 212
query7 4229 469 258 258
query8 340 280 282 280
query9 8789 2594 2578 2578
query10 524 383 338 338
query11 15207 15263 14928 14928
query12 176 122 118 118
query13 1270 499 400 400
query14 6335 3129 2793 2793
query14_1 2707 2667 2732 2667
query15 206 195 181 181
query16 1003 471 470 470
query17 1107 712 598 598
query18 2565 446 352 352
query19 239 231 204 204
query20 129 124 118 118
query21 215 154 123 123
query22 3849 3880 3913 3880
query23 15954 15435 15305 15305
query23_1 15251 16052 15495 15495
query24 7416 1590 1223 1223
query24_1 1230 1219 1222 1219
query25 568 483 438 438
query26 825 275 174 174
query27 2733 450 302 302
query28 4483 2143 2120 2120
query29 865 562 454 454
query30 328 245 210 210
query31 779 647 547 547
query32 78 71 66 66
query33 559 370 310 310
query34 879 889 533 533
query35 751 809 720 720
query36 852 873 867 867
query37 136 101 88 88
query38 2735 2746 2732 2732
query39 775 754 736 736
query39_1 712 738 707 707
query40 214 135 120 120
query41 69 70 61 61
query42 109 108 114 108
query43 449 453 418 418
query44 1312 738 727 727
query45 185 181 175 175
query46 852 974 601 601
query47 1437 1487 1289 1289
query48 317 329 237 237
query49 578 399 316 316
query50 626 279 200 200
query51 3824 3754 3769 3754
query52 104 113 97 97
query53 300 344 270 270
query54 287 261 248 248
query55 76 72 70 70
query56 283 302 290 290
query57 1032 1016 877 877
query58 270 257 251 251
query59 2150 2150 2148 2148
query60 331 316 308 308
query61 192 158 153 153
query62 406 354 315 315
query63 305 266 267 266
query64 4397 1301 1019 1019
query65 3805 3681 3775 3681
query66 1394 429 318 318
query67 15183 15932 15589 15589
query68 7427 1006 711 711
query69 500 341 314 314
query70 1045 904 946 904
query71 377 303 290 290
query72 6056 2566 3579 2566
query73 735 723 299 299
query74 8853 8868 8543 8543
query75 2831 2868 2484 2484
query76 3754 1058 663 663
query77 519 373 282 282
query78 9656 9970 9182 9182
query79 1045 882 585 585
query80 653 573 481 481
query81 510 260 227 227
query82 218 145 110 110
query83 254 249 233 233
query84 253 119 108 108
query85 882 518 470 470
query86 346 313 324 313
query87 2876 2863 2748 2748
query88 3045 2198 2214 2198
query89 382 365 336 336
query90 1969 151 158 151
query91 181 174 150 150
query92 72 65 66 65
query93 952 889 534 534
query94 558 309 282 282
query95 592 333 305 305
query96 573 459 204 204
query97 2295 2394 2329 2329
query98 226 201 202 201
query99 550 577 514 514
Total cold run time: 251533 ms
Total hot run time: 173136 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] scanner merge after projection [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #59492:
URL: https://github.com/apache/doris/pull/59492#issuecomment-3702033522
# BE UT Coverage Report
Increment line coverage `0.00% (0/36)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/7cfacbb9fb4635a59109a572c8c550a482357905_7cfacbb9fb4635a59109a572c8c550a482357905/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/7cfacbb9fb4635a59109a572c8c550a482357905_7cfacbb9fb4635a59109a572c8c550a482357905/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 53.38% (18958/35516) |
| Line Coverage | 39.27% (175991/448164) |
| Region Coverage | 33.84% (136188/402486) |
| Branch Coverage | 34.76% (58811/169180) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org