You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/04/03 09:59:19 UTC
[PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
github-actions[bot] opened a new pull request, #49801:
URL: https://github.com/apache/doris/pull/49801
Cherry-picked from #48887
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49801:
URL: https://github.com/apache/doris/pull/49801#issuecomment-2775311567
<details>
<summary>TPC-H: <b>Total hot run time: 40164 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c9f4c4253814b1479661495d34430a0e02dfeeaf, data reload: false
------ Round 1 ----------------------------------
q1 17570 6925 6636 6636
q2 2076 166 165 165
q3 10713 1082 1155 1082
q4 10557 781 777 777
q5 7757 2864 2806 2806
q6 216 129 129 129
q7 973 616 608 608
q8 9490 1941 2064 1941
q9 6577 6406 6375 6375
q10 7030 2248 2303 2248
q11 469 252 259 252
q12 391 214 206 206
q13 17784 2975 2956 2956
q14 232 206 214 206
q15 480 457 446 446
q16 675 578 583 578
q17 979 687 652 652
q18 7298 6760 6675 6675
q19 1394 1078 1046 1046
q20 478 213 198 198
q21 3963 3256 3200 3200
q22 1072 990 982 982
Total cold run time: 108174 ms
Total hot run time: 40164 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6639 6543 6579 6543
q2 330 233 222 222
q3 2905 2778 2903 2778
q4 2036 1809 1862 1809
q5 5799 5711 5767 5711
q6 201 123 127 123
q7 2256 1839 1882 1839
q8 3454 3609 3598 3598
q9 8836 9005 8963 8963
q10 3562 3521 3513 3513
q11 593 489 503 489
q12 804 591 623 591
q13 9026 3220 3175 3175
q14 314 269 260 260
q15 524 465 458 458
q16 674 642 646 642
q17 1855 1604 1585 1585
q18 8247 7723 7714 7714
q19 1668 1634 1502 1502
q20 2100 1821 1884 1821
q21 5535 5308 5398 5308
q22 1129 1048 1001 1001
Total cold run time: 68487 ms
Total hot run time: 59645 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #49801:
URL: https://github.com/apache/doris/pull/49801#issuecomment-2775157351
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49801:
URL: https://github.com/apache/doris/pull/49801#issuecomment-2775391647
<details>
<summary>ClickBench: <b>Total hot run time: 32.72 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c9f4c4253814b1479661495d34430a0e02dfeeaf, data reload: false
query1 0.03 0.03 0.03
query2 0.07 0.03 0.03
query3 0.23 0.06 0.06
query4 1.64 0.10 0.11
query5 0.54 0.52 0.51
query6 1.14 0.73 0.72
query7 0.02 0.02 0.02
query8 0.04 0.04 0.03
query9 0.55 0.50 0.49
query10 0.56 0.55 0.55
query11 0.16 0.10 0.10
query12 0.16 0.11 0.11
query13 0.60 0.60 0.59
query14 2.73 2.82 2.86
query15 0.89 0.83 0.83
query16 0.38 0.37 0.38
query17 1.07 1.04 1.07
query18 0.23 0.23 0.22
query19 1.95 1.84 1.98
query20 0.01 0.01 0.01
query21 15.35 0.58 0.58
query22 2.58 2.41 2.24
query23 16.92 0.91 0.84
query24 3.73 1.13 1.68
query25 0.26 0.07 0.05
query26 0.58 0.14 0.14
query27 0.04 0.04 0.04
query28 9.58 0.52 0.47
query29 12.99 3.26 3.21
query30 0.24 0.06 0.06
query31 2.86 0.38 0.39
query32 3.26 0.46 0.45
query33 3.01 3.05 2.96
query34 17.02 4.51 4.46
query35 4.53 4.50 4.47
query36 0.66 0.50 0.48
query37 0.08 0.06 0.06
query38 0.05 0.03 0.03
query39 0.03 0.02 0.02
query40 0.17 0.13 0.12
query41 0.08 0.03 0.02
query42 0.03 0.02 0.02
query43 0.04 0.03 0.02
Total cold run time: 107.09 s
Total hot run time: 32.72 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring closed pull request #49801: branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887
URL: https://github.com/apache/doris/pull/49801
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #49801:
URL: https://github.com/apache/doris/pull/49801#issuecomment-2775157536
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #49801:
URL: https://github.com/apache/doris/pull/49801
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #49801:
URL: https://github.com/apache/doris/pull/49801#issuecomment-2775374893
<details>
<summary>TPC-DS: <b>Total hot run time: 197581 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c9f4c4253814b1479661495d34430a0e02dfeeaf, data reload: false
query1 1280 918 892 892
query2 6222 2046 2061 2046
query3 10834 4403 4429 4403
query4 65550 28903 23290 23290
query5 5009 469 449 449
query6 414 183 180 180
query7 5662 310 298 298
query8 299 224 208 208
query9 9356 2612 2603 2603
query10 461 258 248 248
query11 17629 15580 15834 15580
query12 154 103 103 103
query13 1531 433 443 433
query14 10517 6887 7163 6887
query15 200 180 172 172
query16 7202 502 522 502
query17 1092 590 603 590
query18 1868 318 321 318
query19 236 173 160 160
query20 121 113 119 113
query21 218 115 115 115
query22 4716 4517 4465 4465
query23 34398 33916 34400 33916
query24 6198 3050 2930 2930
query25 570 443 423 423
query26 657 170 169 169
query27 1723 355 364 355
query28 4339 2448 2434 2434
query29 717 468 456 456
query30 239 168 158 158
query31 1016 806 814 806
query32 70 56 59 56
query33 425 299 277 277
query34 901 505 523 505
query35 838 746 738 738
query36 1119 956 956 956
query37 109 66 68 66
query38 4165 4017 4021 4017
query39 1516 1485 1469 1469
query40 198 97 98 97
query41 52 47 45 45
query42 116 100 102 100
query43 523 487 481 481
query44 1179 834 821 821
query45 187 166 169 166
query46 1206 712 729 712
query47 2035 1933 1942 1933
query48 478 375 385 375
query49 745 400 391 391
query50 851 437 423 423
query51 7360 7258 7147 7147
query52 99 86 87 86
query53 257 183 179 179
query54 565 462 456 456
query55 73 73 72 72
query56 261 238 242 238
query57 1224 1104 1082 1082
query58 214 198 207 198
query59 3303 2911 2886 2886
query60 278 263 245 245
query61 106 103 113 103
query62 782 658 679 658
query63 223 190 185 185
query64 1343 645 636 636
query65 3281 3207 3212 3207
query66 716 297 294 294
query67 15871 15732 15712 15712
query68 3993 579 575 575
query69 448 264 260 260
query70 1205 1120 1112 1112
query71 356 265 255 255
query72 6390 4110 3996 3996
query73 757 347 348 347
query74 9415 9348 9263 9263
query75 3371 2633 2642 2633
query76 2129 1163 1068 1068
query77 486 276 280 276
query78 10573 9643 9652 9643
query79 1707 593 591 591
query80 1467 427 414 414
query81 513 245 233 233
query82 1302 90 86 86
query83 160 148 149 148
query84 282 79 79 79
query85 983 300 302 300
query86 410 301 295 295
query87 4435 4229 4250 4229
query88 4024 2497 2359 2359
query89 414 290 291 290
query90 1947 189 183 183
query91 182 153 151 151
query92 69 49 51 49
query93 2136 555 542 542
query94 865 288 286 286
query95 364 257 257 257
query96 617 280 279 279
query97 3324 3181 3217 3181
query98 209 215 200 200
query99 1558 1287 1303 1287
Total cold run time: 319188 ms
Total hot run time: 197581 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org