You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zhannngchen (via GitHub)" <gi...@apache.org> on 2025/05/26 04:15:11 UTC
[PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
zhannngchen opened a new pull request, #51232:
URL: https://github.com/apache/doris/pull/51232
cherry-pick #51093
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "zhannngchen (via GitHub)" <gi...@apache.org>.
zhannngchen commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908469789
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908518930
<details>
<summary>TPC-H: <b>Total hot run time: 39770 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0d0de903016b901605d4932b3190e1634d2940a6, data reload: false
------ Round 1 ----------------------------------
q1 17608 6767 6609 6609
q2 2068 175 166 166
q3 10623 1129 1141 1129
q4 10229 746 750 746
q5 7755 2854 2805 2805
q6 213 131 130 130
q7 966 613 598 598
q8 9362 1905 2038 1905
q9 6590 6428 6371 6371
q10 7022 2234 2297 2234
q11 457 263 261 261
q12 384 213 204 204
q13 17768 2951 2961 2951
q14 235 209 206 206
q15 495 468 453 453
q16 467 372 374 372
q17 973 596 571 571
q18 7349 6581 6612 6581
q19 1404 1137 1120 1120
q20 464 209 202 202
q21 3940 3176 3274 3176
q22 1071 980 986 980
Total cold run time: 107443 ms
Total hot run time: 39770 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6623 6609 6575 6575
q2 329 234 237 234
q3 2946 2760 2798 2760
q4 2028 1738 1742 1738
q5 5782 5717 5707 5707
q6 209 122 124 122
q7 2255 1815 1792 1792
q8 3332 3540 3533 3533
q9 8920 8719 8891 8719
q10 3498 3509 3516 3509
q11 592 504 502 502
q12 792 583 593 583
q13 9753 3166 3143 3143
q14 294 259 283 259
q15 504 461 464 461
q16 488 452 448 448
q17 1844 1613 1616 1613
q18 8165 7787 7658 7658
q19 1694 1684 1485 1485
q20 2050 1788 1783 1783
q21 5491 5219 5324 5219
q22 1101 1026 1073 1026
Total cold run time: 68690 ms
Total hot run time: 58869 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908528921
# BE UT Coverage Report
Increment line coverage `0.00% (0/1)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/0d0de903016b901605d4932b3190e1634d2940a6_0d0de903016b901605d4932b3190e1634d2940a6/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/0d0de903016b901605d4932b3190e1634d2940a6_0d0de903016b901605d4932b3190e1634d2940a6/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 41.07% (10860/26443) |
| Line Coverage | 31.87% (92693/290887) |
| Region Coverage | 30.95% (47817/154476) |
| Branch Coverage | 27.43% (24480/89260) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908545380
<details>
<summary>ClickBench: <b>Total hot run time: 30.98 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0d0de903016b901605d4932b3190e1634d2940a6, data reload: false
query1 0.03 0.03 0.03
query2 0.07 0.03 0.04
query3 0.24 0.06 0.06
query4 1.62 0.10 0.10
query5 0.50 0.52 0.54
query6 1.13 0.73 0.73
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.56 0.50 0.49
query10 0.56 0.54 0.55
query11 0.14 0.10 0.10
query12 0.14 0.11 0.11
query13 0.61 0.61 0.60
query14 0.75 0.80 0.80
query15 0.84 0.82 0.82
query16 0.37 0.38 0.39
query17 1.02 1.05 1.07
query18 0.24 0.21 0.22
query19 1.97 1.91 1.83
query20 0.01 0.01 0.01
query21 15.40 0.59 0.56
query22 3.06 2.38 1.97
query23 16.92 0.97 0.76
query24 3.17 1.67 1.62
query25 0.17 0.22 0.09
query26 0.52 0.14 0.14
query27 0.08 0.04 0.04
query28 9.38 0.52 0.52
query29 12.57 3.23 3.22
query30 0.25 0.06 0.06
query31 2.85 0.38 0.37
query32 3.28 0.47 0.46
query33 2.95 2.99 3.00
query34 16.99 4.45 4.47
query35 4.54 4.51 4.53
query36 0.68 0.48 0.47
query37 0.09 0.06 0.06
query38 0.04 0.03 0.03
query39 0.03 0.02 0.03
query40 0.16 0.13 0.12
query41 0.07 0.02 0.02
query42 0.04 0.02 0.02
query43 0.04 0.03 0.03
Total cold run time: 104.14 s
Total hot run time: 30.98 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908469612
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908535969
<details>
<summary>TPC-DS: <b>Total hot run time: 196192 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0d0de903016b901605d4932b3190e1634d2940a6, data reload: false
query1 1265 890 901 890
query2 6290 1939 1894 1894
query3 10808 4329 4330 4329
query4 61434 28656 23358 23358
query5 5148 469 457 457
query6 412 181 204 181
query7 5487 318 306 306
query8 315 225 223 223
query9 8540 2587 2585 2585
query10 462 269 264 264
query11 17813 15179 15644 15179
query12 165 104 109 104
query13 1484 438 417 417
query14 10032 7331 7620 7331
query15 202 182 174 174
query16 7098 476 462 462
query17 1288 589 602 589
query18 1872 320 318 318
query19 223 166 158 158
query20 122 113 109 109
query21 207 109 102 102
query22 4735 4652 4704 4652
query23 34432 33599 33934 33599
query24 6134 3033 2914 2914
query25 527 388 402 388
query26 641 161 160 160
query27 2205 366 356 356
query28 4143 2171 2118 2118
query29 686 445 431 431
query30 240 156 156 156
query31 967 792 823 792
query32 62 52 54 52
query33 456 288 277 277
query34 936 500 528 500
query35 858 721 726 721
query36 1097 938 946 938
query37 110 64 71 64
query38 4019 3942 3918 3918
query39 1484 1496 1464 1464
query40 199 98 98 98
query41 51 51 50 50
query42 110 101 95 95
query43 521 487 475 475
query44 1174 809 794 794
query45 182 165 174 165
query46 1182 730 724 724
query47 2038 1930 1900 1900
query48 467 388 397 388
query49 721 403 402 402
query50 877 428 436 428
query51 7252 7112 7216 7112
query52 102 96 94 94
query53 259 184 185 184
query54 574 462 459 459
query55 79 81 80 80
query56 269 240 258 240
query57 1292 1234 1185 1185
query58 215 213 219 213
query59 3177 2970 3013 2970
query60 271 252 255 252
query61 105 102 105 102
query62 797 664 683 664
query63 220 183 189 183
query64 1357 659 641 641
query65 3233 3140 3208 3140
query66 710 300 305 300
query67 15900 15571 15429 15429
query68 4284 568 565 565
query69 450 276 267 267
query70 1178 1098 1118 1098
query71 347 259 261 259
query72 6531 4220 4108 4108
query73 759 341 348 341
query74 10442 9112 8909 8909
query75 3356 2665 2661 2661
query76 1905 1136 1144 1136
query77 517 288 259 259
query78 10688 9678 9581 9581
query79 2693 607 604 604
query80 1352 423 439 423
query81 537 213 218 213
query82 1180 89 86 86
query83 170 144 145 144
query84 290 78 74 74
query85 959 290 285 285
query86 399 290 294 290
query87 4293 4182 4248 4182
query88 4171 2390 2379 2379
query89 416 291 290 290
query90 1961 182 181 181
query91 185 151 151 151
query92 63 47 55 47
query93 2771 547 550 547
query94 807 291 299 291
query95 355 263 257 257
query96 615 275 280 275
query97 3288 3119 3155 3119
query98 217 197 193 193
query99 1548 1288 1280 1280
Total cold run time: 316460 ms
Total hot run time: 196192 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #51232:
URL: https://github.com/apache/doris/pull/51232#issuecomment-2908484245
# Cloud UT Coverage Report
Increment line coverage `100.00% (6/6)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/0d0de903016b901605d4932b3190e1634d2940a6_0d0de903016b901605d4932b3190e1634d2940a6_cloud/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/0d0de903016b901605d4932b3190e1634d2940a6_0d0de903016b901605d4932b3190e1634d2940a6_cloud/report/index.html)
| Category | Coverage |
|-------------------|--------------------|
| Function Coverage | 83.13% (1094/1316) |
| Line Coverage | 66.25% (18180/27442) |
| Region Coverage | 65.99% (9003/13643) |
| Branch Coverage | 55.66% (4856/8724) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0-pick: [log](mow) optimize some log for mow table (#51093) [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #51232:
URL: https://github.com/apache/doris/pull/51232
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org