You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/22 03:30:32 UTC
[PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
github-actions[bot] opened a new pull request, #57217:
URL: https://github.com/apache/doris/pull/57217
Cherry-picked from #55333
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #57217:
URL: https://github.com/apache/doris/pull/57217#issuecomment-3430357199
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57217:
URL: https://github.com/apache/doris/pull/57217#issuecomment-3430550458
<details>
<summary>TPC-DS: <b>Total hot run time: 197107 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6ad5daddd0787b6cac757591d126137b582de15e, data reload: false
query1 963 433 423 423
query2 6274 2189 2075 2075
query3 8689 219 212 212
query4 33719 24049 23977 23977
query5 3682 626 504 504
query6 301 213 184 184
query7 4207 525 347 347
query8 310 254 243 243
query9 9783 2906 2893 2893
query10 488 335 270 270
query11 18705 15515 15406 15406
query12 172 112 118 112
query13 1591 600 466 466
query14 10729 7428 7520 7428
query15 242 194 188 188
query16 8051 687 552 552
query17 1545 797 637 637
query18 2168 468 350 350
query19 252 206 192 192
query20 131 126 121 121
query21 211 131 117 117
query22 4702 4691 4604 4604
query23 35097 34162 34047 34047
query24 7686 2783 2793 2783
query25 540 471 420 420
query26 747 297 181 181
query27 1993 504 391 391
query28 5316 2422 2409 2409
query29 709 615 457 457
query30 238 203 171 171
query31 1016 963 841 841
query32 94 60 60 60
query33 512 380 366 366
query34 770 907 578 578
query35 812 818 756 756
query36 1092 1093 1030 1030
query37 110 98 74 74
query38 4133 4065 3983 3983
query39 1577 1503 1475 1475
query40 210 119 117 117
query41 51 53 52 52
query42 133 116 114 114
query43 557 539 528 528
query44 1383 912 901 901
query45 186 180 173 173
query46 931 1085 725 725
query47 1987 2055 1956 1956
query48 438 458 374 374
query49 735 501 427 427
query50 714 740 463 463
query51 7483 7544 7404 7404
query52 110 112 101 101
query53 254 266 211 211
query54 608 624 516 516
query55 86 83 82 82
query56 298 278 257 257
query57 1293 1286 1218 1218
query58 243 231 229 229
query59 3222 3317 3247 3247
query60 308 288 295 288
query61 116 115 117 115
query62 831 759 703 703
query63 245 208 209 208
query64 3268 1035 652 652
query65 3415 3298 3339 3298
query66 805 418 339 339
query67 16744 16017 15769 15769
query68 2763 896 630 630
query69 480 322 291 291
query70 1285 1221 1160 1160
query71 370 310 277 277
query72 5827 3982 4041 3982
query73 694 783 401 401
query74 10135 9045 9365 9045
query75 3235 3179 2743 2743
query76 2904 1163 800 800
query77 511 373 294 294
query78 10598 10524 9625 9625
query79 3946 882 635 635
query80 1812 547 459 459
query81 555 256 229 229
query82 943 119 93 93
query83 256 167 152 152
query84 240 112 83 83
query85 820 373 315 315
query86 473 334 288 288
query87 4356 4339 4272 4272
query88 5197 2674 2674 2674
query89 410 339 309 309
query90 1745 198 201 198
query91 138 141 116 116
query92 65 57 51 51
query93 2688 947 587 587
query94 759 425 325 325
query95 360 289 282 282
query96 534 638 307 307
query97 3168 3265 3188 3188
query98 227 217 212 212
query99 1290 1409 1294 1294
Total cold run time: 294795 ms
Total hot run time: 197107 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring closed pull request #57217: branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333
URL: https://github.com/apache/doris/pull/57217
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57217:
URL: https://github.com/apache/doris/pull/57217#issuecomment-3430522619
<details>
<summary>TPC-H: <b>Total hot run time: 33784 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6ad5daddd0787b6cac757591d126137b582de15e, data reload: false
------ Round 1 ----------------------------------
q1 17836 5617 5497 5497
q2 2030 441 302 302
q3 12422 1278 811 811
q4 10288 911 496 496
q5 9215 2460 2255 2255
q6 196 174 138 138
q7 919 775 631 631
q8 9353 1523 1239 1239
q9 5398 5051 5002 5002
q10 6801 2310 1871 1871
q11 486 295 280 280
q12 359 373 227 227
q13 17795 3696 3113 3113
q14 242 245 232 232
q15 527 476 476 476
q16 460 456 385 385
q17 648 884 396 396
q18 7102 6496 6440 6440
q19 1961 986 571 571
q20 345 364 222 222
q21 3345 2377 2189 2189
q22 1070 1081 1011 1011
Total cold run time: 108798 ms
Total hot run time: 33784 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5692 5561 5471 5471
q2 247 329 239 239
q3 2290 2699 2336 2336
q4 1388 1884 1443 1443
q5 4654 5156 5097 5097
q6 174 169 129 129
q7 2094 1961 1888 1888
q8 2694 2882 2800 2800
q9 7328 7319 7332 7319
q10 2945 3279 2810 2810
q11 594 536 512 512
q12 717 809 608 608
q13 3461 3832 3250 3250
q14 285 303 273 273
q15 527 464 479 464
q16 458 501 449 449
q17 1299 1746 1276 1276
q18 7765 7416 7510 7416
q19 910 1232 1086 1086
q20 2054 2088 1954 1954
q21 5591 5150 4704 4704
q22 1105 1069 1082 1069
Total cold run time: 54272 ms
Total hot run time: 52593 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #57217:
URL: https://github.com/apache/doris/pull/57217
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #57217:
URL: https://github.com/apache/doris/pull/57217#issuecomment-3430357289
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.1: [chore](cold) add a score threshold for cold data compaction #55333 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57217:
URL: https://github.com/apache/doris/pull/57217#issuecomment-3430558741
<details>
<summary>ClickBench: <b>Total hot run time: 28.72 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6ad5daddd0787b6cac757591d126137b582de15e, data reload: false
query1 0.04 0.03 0.03
query2 0.07 0.03 0.03
query3 0.24 0.07 0.06
query4 1.62 0.10 0.11
query5 0.52 0.53 0.50
query6 1.13 0.73 0.73
query7 0.02 0.02 0.02
query8 0.04 0.03 0.04
query9 0.59 0.50 0.51
query10 0.56 0.56 0.55
query11 0.15 0.12 0.10
query12 0.15 0.12 0.11
query13 0.64 0.61 0.59
query14 0.81 0.82 0.79
query15 0.84 0.84 0.83
query16 0.40 0.41 0.38
query17 1.08 1.07 1.10
query18 0.25 0.24 0.23
query19 1.82 1.85 1.98
query20 0.02 0.01 0.02
query21 15.35 1.00 0.61
query22 0.73 0.71 0.66
query23 15.19 1.53 0.59
query24 2.65 0.49 1.05
query25 0.22 0.11 0.07
query26 0.31 0.16 0.15
query27 0.08 0.05 0.06
query28 12.77 1.16 0.45
query29 12.58 4.14 3.38
query30 0.26 0.09 0.07
query31 2.82 0.60 0.39
query32 3.22 0.55 0.47
query33 3.04 3.01 3.06
query34 16.56 5.28 4.49
query35 4.57 4.64 4.53
query36 0.64 0.51 0.48
query37 0.08 0.06 0.07
query38 0.05 0.04 0.03
query39 0.04 0.03 0.03
query40 0.17 0.14 0.12
query41 0.08 0.02 0.03
query42 0.04 0.03 0.03
query43 0.04 0.03 0.03
Total cold run time: 102.48 s
Total hot run time: 28.72 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org