You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HHoflittlefish777 (via GitHub)" <gi...@apache.org> on 2024/03/15 09:29:54 UTC
[PR] [branch-2.0](load) fix load channel may memory leak [doris]
HHoflittlefish777 opened a new pull request, #32301:
URL: https://github.com/apache/doris/pull/32301
## Proposed changes
https://github.com/apache/doris/pull/32277
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001781901
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-1999272023
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001951199
<details>
<summary>TPC-DS: <b>Total hot run time: 201713 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b43e1baa14ce00ae6209f3b68a8b108324f367bc, data reload: false
query1 928 381 375 375
query2 6517 2310 2142 2142
query3 6921 200 194 194
query4 21289 17972 17868 17868
query5 19718 6514 6503 6503
query6 276 218 226 218
query7 4150 298 307 298
query8 271 234 220 220
query9 3130 2682 2614 2614
query10 406 298 297 297
query11 11218 10704 10551 10551
query12 130 74 71 71
query13 5577 639 628 628
query14 17782 13592 13853 13592
query15 356 224 243 224
query16 6475 271 262 262
query17 1758 1449 873 873
query18 2329 408 404 404
query19 202 143 149 143
query20 76 71 77 71
query21 185 95 96 95
query22 5188 5076 5084 5076
query23 32907 32089 31930 31930
query24 6943 6612 6509 6509
query25 529 412 403 403
query26 526 163 158 158
query27 1901 296 291 291
query28 6031 2203 2176 2176
query29 2865 2772 2615 2615
query30 244 164 161 161
query31 898 721 726 721
query32 66 59 61 59
query33 392 236 257 236
query34 844 461 491 461
query35 1082 899 954 899
query36 1597 1289 1696 1289
query37 89 65 56 56
query38 3075 2875 2934 2875
query39 1365 1324 1322 1322
query40 198 92 94 92
query41 34 32 31 31
query42 94 85 83 83
query43 681 566 584 566
query44 1132 711 707 707
query45 248 228 227 227
query46 1241 954 962 954
query47 1752 1654 1831 1654
query48 977 686 670 670
query49 610 367 382 367
query50 880 575 624 575
query51 4756 4639 4670 4639
query52 90 82 82 82
query53 456 328 309 309
query54 2632 2423 2453 2423
query55 86 79 79 79
query56 207 204 204 204
query57 1162 1065 1094 1065
query58 202 199 210 199
query59 3524 3399 3444 3399
query60 202 199 186 186
query61 84 85 85 85
query62 790 528 450 450
query63 467 345 335 335
query64 2375 1501 1448 1448
query65 3619 3562 3606 3562
query66 802 373 376 373
query67 15520 16007 15254 15254
query68 8584 661 670 661
query69 585 343 335 335
query70 1786 1782 1668 1668
query71 414 302 299 299
query72 6487 3432 3458 3432
query73 743 320 327 320
query74 6252 5810 5834 5810
query75 4744 3683 3720 3683
query76 4822 1197 1211 1197
query77 644 246 241 241
query78 12498 11466 11730 11466
query79 7606 630 658 630
query80 1059 392 392 392
query81 503 226 234 226
query82 1501 95 100 95
query83 166 133 128 128
query84 263 68 68 68
query85 937 276 272 272
query86 392 411 363 363
query87 3264 2999 3036 2999
query88 4965 2336 2341 2336
query89 367 334 290 290
query90 1850 192 194 192
query91 146 116 113 113
query92 57 55 50 50
query93 4163 561 589 561
query94 723 207 203 203
query95 1110 1039 1038 1038
query96 644 326 318 318
query97 6466 6407 6384 6384
query98 176 178 179 178
query99 2937 884 867 867
Total cold run time: 307911 ms
Total hot run time: 201713 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001933353
<details>
<summary>TPC-DS: <b>Total hot run time: 200064 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b7807a444fb261d65c47cfab11b01d3e2bf1bb9e, data reload: false
query1 916 394 381 381
query2 6537 2181 2118 2118
query3 6919 196 199 196
query4 21061 17827 17763 17763
query5 19718 6503 6412 6412
query6 301 215 219 215
query7 4152 289 295 289
query8 286 238 293 238
query9 3083 2668 2595 2595
query10 414 279 291 279
query11 11183 10671 10617 10617
query12 120 72 70 70
query13 5588 627 594 594
query14 17620 13109 13422 13109
query15 359 224 241 224
query16 6449 260 257 257
query17 1582 1447 861 861
query18 2298 399 391 391
query19 201 140 141 140
query20 78 74 75 74
query21 181 88 94 88
query22 5376 5116 5013 5013
query23 32470 31895 31779 31779
query24 6981 6431 6503 6431
query25 535 416 413 413
query26 522 157 161 157
query27 1865 287 294 287
query28 6045 2205 2160 2160
query29 2905 2806 2897 2806
query30 243 158 159 158
query31 914 702 762 702
query32 70 59 54 54
query33 386 236 260 236
query34 841 463 470 463
query35 1104 907 904 904
query36 1642 1333 1507 1333
query37 84 59 57 57
query38 3083 2943 2888 2888
query39 1369 1339 1309 1309
query40 200 89 93 89
query41 35 36 31 31
query42 90 83 82 82
query43 595 593 541 541
query44 1136 715 703 703
query45 238 223 223 223
query46 1230 973 989 973
query47 2036 1598 1890 1598
query48 974 659 656 656
query49 616 360 354 354
query50 854 618 613 613
query51 4759 4668 4710 4668
query52 83 79 70 70
query53 437 309 309 309
query54 2628 2429 2420 2420
query55 87 83 79 79
query56 213 188 211 188
query57 1153 1056 1165 1056
query58 205 200 203 200
query59 3431 3135 3322 3135
query60 194 189 178 178
query61 80 79 79 79
query62 886 461 471 461
query63 467 337 328 328
query64 2454 1474 1338 1338
query65 3607 3530 3521 3521
query66 799 365 359 359
query67 15943 17006 15254 15254
query68 7600 629 644 629
query69 563 347 349 347
query70 1901 1564 1533 1533
query71 391 295 300 295
query72 6406 3466 3388 3388
query73 716 308 320 308
query74 6307 5920 5787 5787
query75 4566 3714 3635 3635
query76 4552 1162 1200 1162
query77 538 235 248 235
query78 12613 11659 11621 11621
query79 8065 646 635 635
query80 2575 390 377 377
query81 519 227 228 227
query82 1526 102 98 98
query83 184 126 126 126
query84 259 66 66 66
query85 1399 275 273 273
query86 431 371 425 371
query87 3224 3035 2976 2976
query88 5092 2287 2302 2287
query89 343 305 285 285
query90 1741 206 198 198
query91 152 112 111 111
query92 57 51 49 49
query93 4568 585 589 585
query94 875 205 206 205
query95 1095 1053 1035 1035
query96 644 316 323 316
query97 6464 6327 6345 6327
query98 196 171 162 162
query99 2934 848 952 848
Total cold run time: 309407 ms
Total hot run time: 200064 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001213251
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on code in PR #32301:
URL: https://github.com/apache/doris/pull/32301#discussion_r1527023109
##########
be/src/runtime/runtime_state.h:
##########
@@ -165,13 +165,22 @@ class RuntimeState {
void get_unreported_errors(std::vector<std::string>* new_errors);
bool is_cancelled() const { return _is_cancelled.load(); }
+ std::string cancel_reason() const;
Review Comment:
warning: function 'cancel_reason' should be marked [[nodiscard]] [modernize-use-nodiscard]
```suggestion
[[nodiscard]] std::string cancel_reason() const;
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001937292
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #32301:
URL: https://github.com/apache/doris/pull/32301
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001930197
<details>
<summary>TPC-H: <b>Total hot run time: 49723 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b7807a444fb261d65c47cfab11b01d3e2bf1bb9e, data reload: false
------ Round 1 ----------------------------------
q1 17905 4348 4376 4348
q2 2037 148 134 134
q3 10452 1906 1926 1906
q4 10329 1224 1297 1224
q5 8493 3924 3974 3924
q6 221 122 121 121
q7 1991 1560 1588 1560
q8 9293 2686 2682 2682
q9 10698 10433 10419 10419
q10 8636 3506 3510 3506
q11 411 226 232 226
q12 460 292 299 292
q13 18363 3973 3984 3973
q14 344 327 326 326
q15 501 460 456 456
q16 685 580 588 580
q17 1108 951 964 951
q18 7224 6854 6913 6854
q19 1663 1573 1540 1540
q20 504 301 301 301
q21 4410 4117 4011 4011
q22 489 390 389 389
Total cold run time: 116217 ms
Total hot run time: 49723 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4300 4283 4285 4283
q2 317 224 217 217
q3 4110 4113 4093 4093
q4 2763 2731 2730 2730
q5 7158 6987 7049 6987
q6 239 116 117 116
q7 3240 2790 2813 2790
q8 4312 4406 4399 4399
q9 17025 16961 16876 16876
q10 4206 4222 4227 4222
q11 757 671 690 671
q12 1019 850 829 829
q13 7411 3694 3745 3694
q14 442 425 439 425
q15 483 459 454 454
q16 740 691 690 690
q17 3730 3758 3776 3758
q18 8814 8743 8724 8724
q19 1671 1683 1634 1634
q20 2389 2127 2156 2127
q21 8452 8527 8571 8527
q22 1014 938 981 938
Total cold run time: 84592 ms
Total hot run time: 79184 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-1999270752
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001946276
TeamCity be ut coverage result:
Function Coverage: 37.82% (8042/21264)
Line Coverage: 29.49% (65627/222540)
Region Coverage: 28.96% (33772/116607)
Branch Coverage: 24.80% (17333/69880)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b43e1baa14ce00ae6209f3b68a8b108324f367bc_b43e1baa14ce00ae6209f3b68a8b108324f367bc/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001953317
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit b43e1baa14ce00ae6209f3b68a8b108324f367bc with default session variables
Stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.7 seconds inserted 10000000 Rows, about 483K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001977056
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-1999261833
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001934719
<details>
<summary>ClickBench: <b>Total hot run time: 30.71 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b7807a444fb261d65c47cfab11b01d3e2bf1bb9e, data reload: false
query1 0.02 0.02 0.01
query2 0.06 0.02 0.02
query3 0.24 0.05 0.04
query4 1.83 0.07 0.06
query5 0.54 0.53 0.52
query6 1.25 0.62 0.63
query7 0.01 0.01 0.01
query8 0.03 0.02 0.02
query9 0.53 0.46 0.48
query10 0.52 0.54 0.53
query11 0.11 0.08 0.08
query12 0.11 0.08 0.09
query13 0.62 0.61 0.60
query14 0.77 0.78 0.79
query15 0.76 0.75 0.78
query16 0.39 0.38 0.37
query17 1.00 1.03 0.96
query18 0.21 0.26 0.25
query19 1.86 1.81 1.83
query20 0.01 0.01 0.01
query21 15.50 0.54 0.55
query22 1.66 1.73 1.53
query23 17.23 1.06 0.97
query24 4.23 1.22 1.58
query25 0.41 0.10 0.04
query26 0.58 0.15 0.16
query27 0.04 0.04 0.04
query28 8.46 0.72 0.70
query29 12.63 2.29 2.27
query30 0.56 0.51 0.49
query31 2.81 0.39 0.37
query32 3.42 0.49 0.49
query33 3.05 3.08 3.05
query34 15.26 4.80 4.80
query35 4.88 4.83 4.86
query36 1.04 1.00 1.00
query37 0.06 0.05 0.04
query38 0.04 0.02 0.02
query39 0.02 0.02 0.01
query40 0.17 0.14 0.14
query41 0.06 0.01 0.02
query42 0.02 0.01 0.01
query43 0.02 0.01 0.02
Total cold run time: 103.02 s
Total hot run time: 30.71 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001952627
<details>
<summary>ClickBench: <b>Total hot run time: 30.48 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b43e1baa14ce00ae6209f3b68a8b108324f367bc, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.02
query3 0.24 0.04 0.04
query4 1.83 0.07 0.07
query5 0.53 0.53 0.53
query6 1.27 0.62 0.63
query7 0.01 0.01 0.01
query8 0.04 0.02 0.02
query9 0.53 0.49 0.48
query10 0.52 0.53 0.53
query11 0.12 0.09 0.08
query12 0.11 0.09 0.09
query13 0.62 0.61 0.59
query14 0.78 0.81 0.77
query15 0.78 0.76 0.77
query16 0.36 0.37 0.37
query17 1.03 0.99 1.02
query18 0.23 0.26 0.23
query19 1.93 1.85 1.82
query20 0.01 0.01 0.01
query21 15.47 0.56 0.53
query22 2.27 2.11 1.77
query23 17.12 1.03 0.97
query24 6.76 0.63 1.01
query25 0.40 0.08 0.05
query26 0.68 0.17 0.15
query27 0.04 0.04 0.03
query28 6.87 0.76 0.72
query29 12.68 2.31 2.26
query30 0.56 0.54 0.51
query31 2.81 0.40 0.39
query32 3.38 0.50 0.51
query33 3.08 3.06 3.06
query34 15.25 4.79 4.77
query35 4.86 4.83 4.84
query36 1.03 1.00 1.00
query37 0.06 0.04 0.04
query38 0.03 0.02 0.02
query39 0.01 0.01 0.01
query40 0.16 0.14 0.14
query41 0.06 0.02 0.02
query42 0.02 0.02 0.02
query43 0.02 0.01 0.02
Total cold run time: 104.65 s
Total hot run time: 30.48 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001922643
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001931387
TeamCity be ut coverage result:
Function Coverage: 37.82% (8042/21264)
Line Coverage: 29.49% (65623/222540)
Region Coverage: 28.96% (33772/116607)
Branch Coverage: 24.80% (17332/69880)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b7807a444fb261d65c47cfab11b01d3e2bf1bb9e_b7807a444fb261d65c47cfab11b01d3e2bf1bb9e/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001935582
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit b7807a444fb261d65c47cfab11b01d3e2bf1bb9e with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.4 seconds inserted 10000000 Rows, about 490K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001948135
<details>
<summary>TPC-H: <b>Total hot run time: 49913 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b43e1baa14ce00ae6209f3b68a8b108324f367bc, data reload: false
------ Round 1 ----------------------------------
q1 17670 4417 4396 4396
q2 2028 148 138 138
q3 10495 1927 1921 1921
q4 10358 1249 1331 1249
q5 8640 3939 3942 3939
q6 231 124 126 124
q7 2049 1573 1580 1573
q8 9291 2724 2726 2724
q9 10847 10509 10453 10453
q10 8615 3518 3499 3499
q11 423 237 234 234
q12 471 293 300 293
q13 18335 3960 3960 3960
q14 352 319 318 318
q15 511 454 458 454
q16 706 591 582 582
q17 1136 919 950 919
q18 7209 6863 6867 6863
q19 1704 1575 1525 1525
q20 528 313 293 293
q21 4477 4116 4055 4055
q22 505 401 401 401
Total cold run time: 116581 ms
Total hot run time: 49913 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4368 4309 4283 4283
q2 317 221 217 217
q3 4130 4162 4135 4135
q4 2739 2762 2751 2751
q5 7274 7113 7164 7113
q6 237 126 122 122
q7 3211 2873 2864 2864
q8 4325 4466 4414 4414
q9 17076 16983 17037 16983
q10 4245 4226 4293 4226
q11 765 648 663 648
q12 1003 849 851 849
q13 7000 3749 3697 3697
q14 450 410 421 410
q15 504 466 458 458
q16 780 695 708 695
q17 3837 3847 3820 3820
q18 8840 8731 8732 8731
q19 1700 1707 1636 1636
q20 2349 2098 2092 2092
q21 8419 8546 8308 8308
q22 1044 988 938 938
Total cold run time: 84613 ms
Total hot run time: 79390 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [branch-2.0](load) fix load channel may memory leak [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32301:
URL: https://github.com/apache/doris/pull/32301#issuecomment-2001977063
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org