You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "platoneko (via GitHub)" <gi...@apache.org> on 2024/06/04 07:40:31 UTC
[PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
platoneko opened a new pull request, #35852:
URL: https://github.com/apache/doris/pull/35852
## Proposed changes
Limit the concurrency of load data dirs, which can reduce memory usage during BE boot up.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151597710
<details>
<summary>TPC-H: <b>Total hot run time: 41833 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae73e39a987f9da0a863a8096d3f74653fbd117d, data reload: false
------ Round 1 ----------------------------------
q1 17618 4424 4282 4282
q2 2036 197 204 197
q3 10422 1284 1080 1080
q4 10199 763 830 763
q5 7507 2707 2754 2707
q6 215 137 137 137
q7 955 624 622 622
q8 9230 2115 2095 2095
q9 9352 6691 6758 6691
q10 9737 3909 3879 3879
q11 447 254 247 247
q12 521 238 239 238
q13 17784 3224 3274 3224
q14 266 216 224 216
q15 517 469 475 469
q16 520 398 397 397
q17 1002 610 651 610
q18 8474 7886 7928 7886
q19 7261 1440 1408 1408
q20 635 332 312 312
q21 5321 4033 4120 4033
q22 415 361 340 340
Total cold run time: 120434 ms
Total hot run time: 41833 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4615 4465 4493 4465
q2 381 276 259 259
q3 3131 3034 2769 2769
q4 1931 1669 1698 1669
q5 5484 5508 5469 5469
q6 224 126 126 126
q7 2172 1838 1838 1838
q8 3230 3391 3357 3357
q9 8574 8625 8696 8625
q10 4136 3789 3709 3709
q11 605 491 484 484
q12 810 629 642 629
q13 17089 3179 3160 3160
q14 299 266 263 263
q15 529 473 482 473
q16 504 445 440 440
q17 1827 1528 1515 1515
q18 7869 7558 7341 7341
q19 1709 1683 1575 1575
q20 2079 1800 1812 1800
q21 8920 4799 4795 4795
q22 617 537 540 537
Total cold run time: 76735 ms
Total hot run time: 55298 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151874794
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2152678976
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2146841580
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2152831992
<details>
<summary>TPC-H: <b>Total hot run time: 40008 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 19974e84eeb8064a7f3b48a1c3ce4b700df753e0, data reload: false
------ Round 1 ----------------------------------
q1 17642 4657 4355 4355
q2 2036 195 195 195
q3 10511 1205 1261 1205
q4 12288 796 758 758
q5 7818 2744 2644 2644
q6 225 139 140 139
q7 966 617 602 602
q8 9398 2135 2119 2119
q9 9155 6514 6499 6499
q10 8938 3692 3694 3692
q11 448 249 235 235
q12 501 225 229 225
q13 17773 2968 2974 2968
q14 270 223 228 223
q15 521 458 473 458
q16 528 375 383 375
q17 965 733 653 653
q18 8065 7496 7417 7417
q19 5271 1519 1414 1414
q20 651 302 310 302
q21 4882 3192 4024 3192
q22 393 340 338 338
Total cold run time: 119245 ms
Total hot run time: 40008 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4392 4212 4221 4212
q2 364 255 263 255
q3 2988 2749 2722 2722
q4 1882 1578 1589 1578
q5 5259 5303 5306 5303
q6 217 128 127 127
q7 2285 1718 1772 1718
q8 3232 3335 3344 3335
q9 8385 8331 8364 8331
q10 3859 3618 3674 3618
q11 567 489 508 489
q12 756 574 611 574
q13 17477 3003 3013 3003
q14 299 282 265 265
q15 518 468 475 468
q16 461 406 423 406
q17 1788 1476 1495 1476
q18 7669 7585 7446 7446
q19 1679 1587 1543 1543
q20 2001 1779 1751 1751
q21 4855 4800 4677 4677
q22 644 546 555 546
Total cold run time: 71577 ms
Total hot run time: 53843 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #35852:
URL: https://github.com/apache/doris/pull/35852
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2146827888
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151667207
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2152866895
<details>
<summary>ClickBench: <b>Total hot run time: 31.44 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 19974e84eeb8064a7f3b48a1c3ce4b700df753e0, data reload: false
query1 0.04 0.04 0.03
query2 0.08 0.04 0.04
query3 0.23 0.05 0.04
query4 1.69 0.07 0.08
query5 0.54 0.48 0.48
query6 1.14 0.72 0.71
query7 0.02 0.02 0.02
query8 0.05 0.04 0.04
query9 0.53 0.49 0.49
query10 0.55 0.56 0.54
query11 0.15 0.12 0.11
query12 0.15 0.12 0.13
query13 0.59 0.59 0.60
query14 0.79 0.78 0.78
query15 0.84 0.81 0.82
query16 0.36 0.36 0.36
query17 0.97 1.04 0.99
query18 0.24 0.24 0.25
query19 1.78 1.83 1.76
query20 0.01 0.02 0.01
query21 15.53 0.68 0.66
query22 4.48 6.42 2.70
query23 18.29 1.41 1.31
query24 1.94 0.25 0.21
query25 0.16 0.08 0.07
query26 0.27 0.17 0.18
query27 0.08 0.08 0.08
query28 13.25 1.02 1.00
query29 13.03 3.31 3.27
query30 0.24 0.06 0.06
query31 2.89 0.39 0.38
query32 3.29 0.46 0.48
query33 2.86 2.91 2.97
query34 17.06 4.40 4.41
query35 4.55 4.48 4.56
query36 0.65 0.46 0.47
query37 0.18 0.15 0.15
query38 0.15 0.14 0.15
query39 0.04 0.03 0.04
query40 0.16 0.14 0.15
query41 0.10 0.05 0.05
query42 0.06 0.05 0.05
query43 0.04 0.03 0.04
Total cold run time: 110.05 s
Total hot run time: 31.44 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2152866121
TeamCity be ut coverage result:
Function Coverage: 36.44% (8970/24615)
Line Coverage: 27.97% (73313/262089)
Region Coverage: 27.38% (38002/138818)
Branch Coverage: 23.98% (19288/80424)
Coverage Report: http://coverage.selectdb-in.cc/coverage/19974e84eeb8064a7f3b48a1c3ce4b700df753e0_19974e84eeb8064a7f3b48a1c3ce4b700df753e0/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151667148
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "platoneko (via GitHub)" <gi...@apache.org>.
platoneko commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151477753
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151618316
<details>
<summary>TPC-DS: <b>Total hot run time: 169277 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae73e39a987f9da0a863a8096d3f74653fbd117d, data reload: false
query1 930 382 369 369
query2 6448 2390 2507 2390
query3 6648 212 207 207
query4 19334 17271 17171 17171
query5 4151 457 438 438
query6 241 154 146 146
query7 4583 296 293 293
query8 310 291 294 291
query9 8716 2479 2466 2466
query10 445 294 291 291
query11 10590 10039 9772 9772
query12 138 83 87 83
query13 1634 367 361 361
query14 9761 6970 7263 6970
query15 224 189 181 181
query16 7570 267 266 266
query17 1340 514 506 506
query18 1922 275 286 275
query19 191 142 145 142
query20 92 81 83 81
query21 201 132 126 126
query22 4275 3947 4045 3947
query23 33381 32947 33061 32947
query24 11173 2893 2743 2743
query25 646 347 344 344
query26 1423 149 152 149
query27 3030 328 322 322
query28 7682 2133 2108 2108
query29 959 609 608 608
query30 261 149 151 149
query31 984 743 750 743
query32 92 52 55 52
query33 798 274 273 273
query34 1016 466 467 466
query35 733 638 610 610
query36 1093 950 975 950
query37 148 64 69 64
query38 2862 2712 2751 2712
query39 856 785 787 785
query40 200 123 118 118
query41 48 50 51 50
query42 116 93 97 93
query43 582 546 554 546
query44 1243 712 737 712
query45 197 162 171 162
query46 1061 724 730 724
query47 1863 1748 1755 1748
query48 378 305 310 305
query49 1079 438 405 405
query50 775 387 400 387
query51 6684 6676 6696 6676
query52 106 86 90 86
query53 354 276 286 276
query54 895 449 445 445
query55 71 70 71 70
query56 276 251 257 251
query57 1116 1056 1070 1056
query58 246 245 239 239
query59 3510 3244 3175 3175
query60 293 269 262 262
query61 120 85 89 85
query62 651 445 452 445
query63 314 283 282 282
query64 9753 2191 1731 1731
query65 3160 3094 3109 3094
query66 1080 345 342 342
query67 15569 14969 14853 14853
query68 4515 547 534 534
query69 469 322 320 320
query70 1105 1128 1136 1128
query71 393 279 266 266
query72 7147 5696 2756 2756
query73 741 329 326 326
query74 5986 5456 5451 5451
query75 3423 2691 2667 2667
query76 2443 886 922 886
query77 457 293 283 283
query78 10811 9712 9738 9712
query79 2601 513 509 509
query80 2004 457 449 449
query81 579 217 224 217
query82 664 102 102 102
query83 317 170 165 165
query84 268 85 87 85
query85 1891 317 259 259
query86 493 305 286 286
query87 3255 3081 3071 3071
query88 4181 2459 2432 2432
query89 483 387 382 382
query90 1836 185 180 180
query91 121 98 96 96
query92 63 48 49 48
query93 3440 516 494 494
query94 1281 186 180 180
query95 398 301 345 301
query96 591 266 267 266
query97 3166 2986 3038 2986
query98 227 199 191 191
query99 1300 834 839 834
Total cold run time: 275270 ms
Total hot run time: 169277 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151628660
<details>
<summary>ClickBench: <b>Total hot run time: 30.4 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae73e39a987f9da0a863a8096d3f74653fbd117d, data reload: false
query1 0.04 0.03 0.03
query2 0.09 0.04 0.04
query3 0.23 0.05 0.05
query4 1.68 0.08 0.09
query5 0.50 0.48 0.49
query6 1.13 0.72 0.72
query7 0.01 0.01 0.02
query8 0.05 0.04 0.05
query9 0.54 0.48 0.49
query10 0.54 0.55 0.54
query11 0.15 0.11 0.11
query12 0.14 0.12 0.12
query13 0.60 0.59 0.62
query14 0.77 0.78 0.77
query15 0.82 0.81 0.81
query16 0.37 0.36 0.35
query17 0.96 1.04 0.94
query18 0.23 0.24 0.23
query19 1.80 1.69 1.67
query20 0.02 0.01 0.01
query21 15.49 0.70 0.68
query22 4.41 6.54 1.97
query23 18.34 1.39 1.25
query24 2.09 0.22 0.22
query25 0.16 0.09 0.08
query26 0.28 0.17 0.17
query27 0.08 0.08 0.07
query28 13.24 1.02 1.01
query29 13.30 3.30 3.26
query30 0.24 0.06 0.05
query31 2.90 0.38 0.39
query32 3.26 0.46 0.46
query33 2.87 2.88 2.90
query34 17.24 4.45 4.38
query35 4.48 4.43 4.58
query36 0.66 0.48 0.47
query37 0.18 0.15 0.16
query38 0.15 0.14 0.14
query39 0.05 0.03 0.03
query40 0.17 0.14 0.17
query41 0.09 0.05 0.04
query42 0.05 0.04 0.04
query43 0.04 0.04 0.03
Total cold run time: 110.44 s
Total hot run time: 30.4 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151600331
TeamCity be ut coverage result:
Function Coverage: 36.37% (8988/24714)
Line Coverage: 27.91% (73430/263091)
Region Coverage: 27.33% (38007/139068)
Branch Coverage: 23.93% (19284/80600)
Coverage Report: http://coverage.selectdb-in.cc/coverage/ae73e39a987f9da0a863a8096d3f74653fbd117d_ae73e39a987f9da0a863a8096d3f74653fbd117d/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2151484073
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhance](boot) Limit the concurrency of load data dirs [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35852:
URL: https://github.com/apache/doris/pull/35852#issuecomment-2152855334
<details>
<summary>TPC-DS: <b>Total hot run time: 172904 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 19974e84eeb8064a7f3b48a1c3ce4b700df753e0, data reload: false
query1 937 387 378 378
query2 6459 2474 2223 2223
query3 6658 206 211 206
query4 20216 17628 17447 17447
query5 4130 457 480 457
query6 257 161 176 161
query7 4583 314 302 302
query8 318 302 287 287
query9 8428 2352 2337 2337
query10 438 291 279 279
query11 10571 10284 9937 9937
query12 143 85 83 83
query13 1624 370 371 370
query14 10157 7808 6378 6378
query15 246 187 190 187
query16 7917 272 269 269
query17 1828 563 538 538
query18 2016 288 283 283
query19 215 153 198 153
query20 96 86 85 85
query21 208 133 131 131
query22 4258 4217 4015 4015
query23 33887 33412 33369 33369
query24 12072 2941 2925 2925
query25 652 377 361 361
query26 1798 163 168 163
query27 3048 322 324 322
query28 7595 2051 2034 2034
query29 1087 625 615 615
query30 275 150 149 149
query31 989 743 741 741
query32 98 54 54 54
query33 769 284 277 277
query34 1017 483 476 476
query35 760 653 636 636
query36 1107 948 962 948
query37 297 71 73 71
query38 2885 2722 2724 2722
query39 883 821 810 810
query40 282 130 126 126
query41 60 53 45 45
query42 119 100 102 100
query43 587 554 544 544
query44 1317 746 769 746
query45 195 163 163 163
query46 1082 724 729 724
query47 1848 1755 1763 1755
query48 376 307 305 305
query49 1195 409 437 409
query50 785 397 391 391
query51 6807 6725 6668 6668
query52 107 96 91 91
query53 367 291 294 291
query54 1009 452 440 440
query55 73 73 74 73
query56 319 268 290 268
query57 1143 1060 1111 1060
query58 263 280 277 277
query59 3445 3054 3324 3054
query60 291 301 275 275
query61 89 87 89 87
query62 634 447 429 429
query63 327 299 295 295
query64 9877 2258 1720 1720
query65 3198 3109 3155 3109
query66 1359 327 334 327
query67 15574 15015 14841 14841
query68 4846 552 546 546
query69 601 436 373 373
query70 1162 1082 1181 1082
query71 434 282 283 282
query72 7709 5755 5408 5408
query73 774 327 328 327
query74 6032 5573 5503 5503
query75 3652 2668 2691 2668
query76 3490 974 972 972
query77 665 307 296 296
query78 10353 9934 9849 9849
query79 2290 520 533 520
query80 938 476 527 476
query81 573 219 220 219
query82 1100 108 104 104
query83 263 167 170 167
query84 251 86 83 83
query85 1583 271 263 263
query86 501 333 330 330
query87 3254 3126 3087 3087
query88 4159 2472 2465 2465
query89 484 405 395 395
query90 1805 190 197 190
query91 128 100 97 97
query92 60 51 51 51
query93 2303 526 507 507
query94 1236 190 192 190
query95 406 373 316 316
query96 590 273 271 271
query97 3173 3036 3044 3036
query98 218 208 201 201
query99 1130 838 841 838
Total cold run time: 279813 ms
Total hot run time: 172904 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org