You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "924060929 (via GitHub)" <gi...@apache.org> on 2025/12/05 08:47:35 UTC
[PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
924060929 opened a new pull request, #58766:
URL: https://github.com/apache/doris/pull/58766
### What problem does this PR solve?
add cache_sorted_partition_interval_second to control the refresh interval time for the cache of sorted partition
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [x] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [x] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [x] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3619743587
<details>
<summary>TPC-H: <b>Total hot run time: 34092 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b038abb33a68803d4e0f2090270bf47498d54c18, data reload: false
------ Round 1 ----------------------------------
q1 17656 5074 4923 4923
q2 2035 315 190 190
q3 10269 1309 702 702
q4 10238 893 314 314
q5 7530 2556 2164 2164
q6 186 169 138 138
q7 962 770 650 650
q8 9345 1394 1033 1033
q9 6916 5307 5314 5307
q10 6827 2199 1798 1798
q11 538 304 294 294
q12 337 368 225 225
q13 17777 3676 3072 3072
q14 226 233 214 214
q15 579 524 518 518
q16 900 885 840 840
q17 689 859 443 443
q18 7323 7163 7004 7004
q19 1088 943 609 609
q20 375 336 214 214
q21 3939 3127 2508 2508
q22 1031 975 932 932
Total cold run time: 106766 ms
Total hot run time: 34092 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4969 4955 4966 4955
q2 338 416 324 324
q3 2131 2635 2280 2280
q4 1309 1763 1255 1255
q5 4206 4425 4552 4425
q6 221 179 132 132
q7 2107 1918 1880 1880
q8 2637 2435 2469 2435
q9 7429 7462 7517 7462
q10 3155 3265 2879 2879
q11 581 520 479 479
q12 704 770 593 593
q13 3613 4094 3215 3215
q14 292 307 289 289
q15 561 517 514 514
q16 910 925 884 884
q17 1179 1454 1431 1431
q18 8026 7667 7473 7473
q19 868 880 865 865
q20 2059 2131 1860 1860
q21 4570 4277 4113 4113
q22 1085 1013 968 968
Total cold run time: 52950 ms
Total hot run time: 50711 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3616984244
# FE Regression Coverage Report
Increment line coverage ` 66.67% (4/6)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/58766_b038abb33a68803d4e0f2090270bf47498d54c18_merge_fe/increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/58766_b038abb33a68803d4e0f2090270bf47498d54c18_merge_fe/report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3615965658
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3615860069
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3624225698
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3616242480
# FE UT Coverage Report
Increment line coverage ` 66.67% (4/6)` :tada:
[Increment coverage report](http://coverage.selectdb-in.cc/coverage/58766_b038abb33a68803d4e0f2090270bf47498d54c18/fe_increment_report/index.html)
[Complete coverage report](http://coverage.selectdb-in.cc/coverage/58766_b038abb33a68803d4e0f2090270bf47498d54c18/fe_report/index.html)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3619753346
<details>
<summary>TPC-DS: <b>Total hot run time: 179692 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b038abb33a68803d4e0f2090270bf47498d54c18, data reload: false
query5 5191 642 500 500
query6 360 220 206 206
query7 4659 464 276 276
query8 311 259 229 229
query9 8723 2632 2653 2632
query10 563 310 287 287
query11 15633 14812 14603 14603
query12 190 118 116 116
query13 1704 505 402 402
query14 6241 3303 3075 3075
query14_1 2930 2945 2857 2857
query15 215 201 179 179
query16 7725 491 462 462
query17 1256 716 618 618
query18 2056 450 343 343
query19 222 194 184 184
query20 138 123 123 123
query21 225 139 116 116
query22 3908 3957 4027 3957
query23 16475 16075 15793 15793
query23_1 16218 15967 16119 15967
query24 7058 1616 1206 1206
query24_1 1262 1187 1203 1187
query25 593 465 433 433
query26 745 287 175 175
query27 2836 457 310 310
query28 4383 2172 2154 2154
query29 725 564 449 449
query30 317 245 217 217
query31 800 700 624 624
query32 84 70 78 70
query33 666 352 296 296
query34 860 871 546 546
query35 782 833 724 724
query36 883 897 826 826
query37 130 88 74 74
query38 3843 3815 3735 3735
query39 735 723 727 723
query39_1 733 702 740 702
query40 224 129 118 118
query41 70 64 61 61
query42 127 96 99 96
query43 439 424 399 399
query44 1301 754 751 751
query45 198 189 185 185
query46 902 953 591 591
query47 1676 1716 1629 1629
query48 402 322 237 237
query49 719 439 363 363
query50 682 302 240 240
query51 3959 3892 3791 3791
query52 119 96 87 87
query53 239 230 174 174
query54 314 257 238 238
query55 94 80 76 76
query56 346 301 317 301
query57 1160 1150 1106 1106
query58 299 253 250 250
query59 2308 2402 2322 2322
query60 349 315 300 300
query61 167 159 166 159
query62 765 664 613 613
query63 227 173 172 172
query64 3381 1196 909 909
query65 4048 3949 3964 3949
query66 906 465 338 338
query67 15217 15194 14884 14884
query68 6074 934 661 661
query69 531 295 267 267
query70 1084 1020 966 966
query71 440 289 275 275
query72 6010 4844 4796 4796
query73 672 537 290 290
query74 8543 8835 8657 8657
query75 3037 3059 2530 2530
query76 3251 1139 726 726
query77 527 413 304 304
query78 9569 9597 8955 8955
query79 1661 840 579 579
query80 719 563 479 479
query81 515 272 243 243
query82 203 128 107 107
query83 275 276 267 267
query84 263 121 100 100
query85 955 497 452 452
query86 377 306 299 299
query87 4079 4123 3953 3953
query88 2988 2127 2120 2120
query89 381 322 287 287
query90 1956 166 166 166
query91 184 182 141 141
query92 78 72 61 61
query93 1255 1032 686 686
query94 735 320 260 260
query95 567 338 370 338
query96 533 485 210 210
query97 2569 2658 2563 2563
query98 239 196 201 196
query99 1365 1360 1232 1232
Total cold run time: 264551 ms
Total hot run time: 179692 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3619757034
<details>
<summary>ClickBench: <b>Total hot run time: 27.41 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b038abb33a68803d4e0f2090270bf47498d54c18, data reload: false
query1 0.05 0.04 0.04
query2 0.10 0.05 0.05
query3 0.25 0.08 0.08
query4 1.61 0.11 0.11
query5 0.28 0.26 0.28
query6 1.17 0.66 0.64
query7 0.03 0.03 0.03
query8 0.06 0.05 0.04
query9 0.59 0.51 0.51
query10 0.55 0.57 0.56
query11 0.15 0.11 0.11
query12 0.15 0.12 0.11
query13 0.62 0.61 0.60
query14 0.98 0.96 0.98
query15 0.82 0.79 0.80
query16 0.39 0.41 0.42
query17 1.01 0.98 1.01
query18 0.23 0.22 0.21
query19 1.96 1.89 1.80
query20 0.02 0.01 0.02
query21 15.45 0.26 0.14
query22 5.07 0.05 0.05
query23 16.13 0.28 0.10
query24 1.14 0.64 0.32
query25 0.07 0.08 0.05
query26 0.15 0.13 0.13
query27 0.05 0.05 0.05
query28 3.58 1.24 1.03
query29 12.62 4.04 3.34
query30 0.27 0.14 0.12
query31 2.89 0.64 0.39
query32 3.22 0.57 0.46
query33 3.03 3.07 3.05
query34 17.05 5.15 4.51
query35 4.59 4.51 4.61
query36 0.67 0.51 0.50
query37 0.11 0.07 0.06
query38 0.06 0.04 0.04
query39 0.05 0.03 0.03
query40 0.18 0.14 0.14
query41 0.08 0.04 0.03
query42 0.05 0.03 0.03
query43 0.05 0.04 0.03
Total cold run time: 97.58 s
Total hot run time: 27.41 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 merged PR #58766:
URL: https://github.com/apache/doris/pull/58766
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3615858515
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](partition pruner) add cache_sorted_partition_interval_second [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #58766:
URL: https://github.com/apache/doris/pull/58766#issuecomment-3624225615
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org