You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zddr (via GitHub)" <gi...@apache.org> on 2025/04/29 07:00:30 UTC
[PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
zddr opened a new pull request, #50537:
URL: https://github.com/apache/doris/pull/50537
### What problem does this PR solve?
Previously, only one old task would be deleted at most after each new task generation. As a result, even after modifying the configuration, the number of historical tasks could not be effectively reduced.
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
The change to the max_persistence_task_count configuration applies retroactively to existing MTMV
### Release note
The change to the max_persistence_task_count configuration applies retroactively to existing MTMV
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg: https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #50537:
URL: https://github.com/apache/doris/pull/50537
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2837806568
<details>
<summary>TPC-H: <b>Total hot run time: 34035 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9142f001725af2968fb9685753cd2935595a1e1c, data reload: false
------ Round 1 ----------------------------------
q1 26178 5098 5027 5027
q2 2061 274 182 182
q3 12178 1243 702 702
q4 10302 1069 539 539
q5 8376 2417 2368 2368
q6 182 168 135 135
q7 945 765 630 630
q8 9364 1313 1184 1184
q9 8864 5286 5116 5116
q10 6950 2311 1904 1904
q11 498 283 271 271
q12 351 349 218 218
q13 18572 3710 3117 3117
q14 232 239 220 220
q15 528 483 490 483
q16 425 415 378 378
q17 592 841 368 368
q18 7496 7070 7202 7070
q19 1817 953 534 534
q20 332 336 233 233
q21 3910 2617 2386 2386
q22 1035 1029 970 970
Total cold run time: 121188 ms
Total hot run time: 34035 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5161 5017 5039 5017
q2 248 319 228 228
q3 2144 2619 2340 2340
q4 1429 1838 1433 1433
q5 4531 4375 4398 4375
q6 208 165 129 129
q7 1996 1909 1724 1724
q8 2560 2545 2547 2545
q9 7225 7052 7048 7048
q10 3030 3204 2762 2762
q11 577 516 514 514
q12 705 779 611 611
q13 3632 4032 3387 3387
q14 295 311 286 286
q15 521 486 484 484
q16 455 486 439 439
q17 1157 1551 1383 1383
q18 7772 7388 7482 7388
q19 773 758 912 758
q20 1910 1973 1877 1877
q21 5187 4748 4769 4748
q22 1093 1062 1035 1035
Total cold run time: 52609 ms
Total hot run time: 50511 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2854184076
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2837700254
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2837846979
<details>
<summary>ClickBench: <b>Total hot run time: 29.23 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9142f001725af2968fb9685753cd2935595a1e1c, data reload: false
query1 0.03 0.03 0.03
query2 0.12 0.11 0.11
query3 0.25 0.20 0.20
query4 1.59 0.19 0.20
query5 0.57 0.58 0.57
query6 1.20 0.70 0.72
query7 0.02 0.02 0.02
query8 0.05 0.03 0.04
query9 0.56 0.52 0.51
query10 0.56 0.57 0.57
query11 0.15 0.11 0.10
query12 0.14 0.11 0.11
query13 0.61 0.60 0.59
query14 0.78 0.80 0.80
query15 0.86 0.84 0.84
query16 0.38 0.39 0.38
query17 1.00 1.01 1.04
query18 0.21 0.20 0.20
query19 1.96 1.75 1.79
query20 0.01 0.01 0.02
query21 15.47 0.88 0.54
query22 0.77 1.26 0.65
query23 14.88 1.36 0.65
query24 6.65 1.96 0.90
query25 0.50 0.28 0.08
query26 0.61 0.17 0.14
query27 0.05 0.05 0.05
query28 10.06 0.88 0.43
query29 12.57 3.94 3.26
query30 0.25 0.10 0.06
query31 2.82 0.59 0.39
query32 3.22 0.54 0.46
query33 3.02 3.03 3.12
query34 15.74 5.12 4.53
query35 4.57 4.54 4.54
query36 0.67 0.49 0.48
query37 0.09 0.06 0.06
query38 0.05 0.04 0.03
query39 0.03 0.02 0.02
query40 0.17 0.13 0.13
query41 0.08 0.03 0.03
query42 0.04 0.02 0.02
query43 0.04 0.04 0.03
Total cold run time: 103.4 s
Total hot run time: 29.23 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "zddr (via GitHub)" <gi...@apache.org>.
zddr commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2837700449
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2837835508
<details>
<summary>TPC-DS: <b>Total hot run time: 192743 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9142f001725af2968fb9685753cd2935595a1e1c, data reload: false
query1 1432 1090 1045 1045
query2 6080 1825 1813 1813
query3 11107 4639 4581 4581
query4 53774 25346 23387 23387
query5 4935 521 451 451
query6 326 196 185 185
query7 4902 522 285 285
query8 323 248 233 233
query9 5306 2609 2613 2609
query10 427 330 287 287
query11 14968 14994 14757 14757
query12 162 110 106 106
query13 1055 504 400 400
query14 10270 6449 6487 6449
query15 203 208 180 180
query16 7123 666 546 546
query17 1095 752 612 612
query18 1614 446 334 334
query19 216 199 171 171
query20 139 125 121 121
query21 206 130 123 123
query22 4280 4416 4237 4237
query23 34165 33259 33502 33259
query24 6523 2420 2473 2420
query25 451 456 419 419
query26 708 278 165 165
query27 2383 503 340 340
query28 2978 2127 2092 2092
query29 595 574 446 446
query30 269 219 183 183
query31 862 847 781 781
query32 74 65 66 65
query33 446 380 330 330
query34 792 874 528 528
query35 802 825 760 760
query36 954 1006 906 906
query37 116 102 81 81
query38 4171 4183 4232 4183
query39 1479 1440 1426 1426
query40 214 119 102 102
query41 54 53 50 50
query42 122 112 114 112
query43 490 515 488 488
query44 1370 828 814 814
query45 187 168 169 168
query46 837 1041 666 666
query47 1828 1899 1802 1802
query48 386 423 305 305
query49 706 510 402 402
query50 667 720 416 416
query51 4196 4195 4257 4195
query52 112 112 101 101
query53 241 266 189 189
query54 603 601 549 549
query55 82 78 81 78
query56 288 298 307 298
query57 1173 1173 1118 1118
query58 263 251 262 251
query59 2670 2849 2663 2663
query60 343 326 345 326
query61 130 124 129 124
query62 762 747 676 676
query63 230 188 192 188
query64 1911 1033 707 707
query65 4435 4343 4311 4311
query66 706 403 307 307
query67 15721 15549 15358 15358
query68 7871 882 518 518
query69 543 302 260 260
query70 1200 1093 1104 1093
query71 518 319 295 295
query72 5928 4828 4909 4828
query73 1517 698 343 343
query74 8857 9160 8816 8816
query75 3798 3159 2687 2687
query76 4212 1282 778 778
query77 633 360 284 284
query78 9972 10142 9331 9331
query79 2209 851 567 567
query80 799 500 436 436
query81 483 248 215 215
query82 408 172 96 96
query83 337 242 225 225
query84 287 99 84 84
query85 792 351 304 304
query86 374 297 283 283
query87 4334 4394 4386 4386
query88 3228 2198 2216 2198
query89 399 323 279 279
query90 1944 210 211 210
query91 136 138 111 111
query92 83 61 58 58
query93 1291 956 578 578
query94 694 414 300 300
query95 368 284 280 280
query96 478 572 268 268
query97 3169 3178 3108 3108
query98 237 213 196 196
query99 1453 1417 1268 1268
Total cold run time: 296990 ms
Total hot run time: 192743 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "zddr (via GitHub)" <gi...@apache.org>.
zddr commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2838241957
run feut
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #50537:
URL: https://github.com/apache/doris/pull/50537#issuecomment-2854184009
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org