You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "freemandealer (via GitHub)" <gi...@apache.org> on 2024/09/24 11:34:58 UTC
[PR] [enhancement](cloud) make active warmup job number configurable [doris]
freemandealer opened a new pull request, #41233:
URL: https://github.com/apache/doris/pull/41233
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2378369514
<details>
<summary>ClickBench: <b>Total hot run time: 33.38 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 52c37e74c993a982cf854de8743c429a9a6c12c1, data reload: false
query1 0.05 0.05 0.05
query2 0.06 0.03 0.03
query3 0.23 0.07 0.06
query4 1.65 0.10 0.10
query5 0.53 0.52 0.52
query6 1.14 0.73 0.73
query7 0.02 0.01 0.01
query8 0.04 0.03 0.04
query9 0.56 0.50 0.48
query10 0.53 0.53 0.55
query11 0.14 0.11 0.11
query12 0.14 0.11 0.11
query13 0.60 0.59 0.59
query14 2.73 2.83 2.74
query15 0.90 0.82 0.84
query16 0.39 0.40 0.38
query17 1.04 1.06 1.04
query18 0.23 0.22 0.21
query19 1.94 1.90 2.00
query20 0.01 0.02 0.01
query21 15.36 0.60 0.61
query22 2.73 2.55 2.49
query23 17.03 0.98 0.77
query24 2.32 0.83 0.86
query25 0.15 0.21 0.07
query26 0.37 0.13 0.13
query27 0.05 0.04 0.04
query28 11.50 1.10 1.08
query29 12.54 3.35 3.32
query30 0.24 0.06 0.06
query31 2.87 0.38 0.37
query32 3.27 0.46 0.47
query33 2.98 2.98 3.05
query34 16.89 4.49 4.49
query35 4.49 4.47 4.48
query36 0.67 0.48 0.49
query37 0.08 0.07 0.06
query38 0.04 0.04 0.03
query39 0.03 0.02 0.02
query40 0.16 0.12 0.13
query41 0.08 0.02 0.02
query42 0.04 0.02 0.02
query43 0.03 0.02 0.02
Total cold run time: 106.85 s
Total hot run time: 33.38 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371010954
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371196494
<details>
<summary>TPC-DS: <b>Total hot run time: 191571 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 52c37e74c993a982cf854de8743c429a9a6c12c1, data reload: false
query1 977 382 360 360
query2 6515 2108 2060 2060
query3 6704 215 221 215
query4 34563 23557 23435 23435
query5 4450 466 473 466
query6 291 175 161 161
query7 4612 314 313 313
query8 270 211 210 210
query9 9641 2652 2669 2652
query10 477 303 279 279
query11 18218 15191 15334 15191
query12 155 102 101 101
query13 1637 437 420 420
query14 10771 7019 7524 7019
query15 282 176 176 176
query16 8071 460 470 460
query17 1702 586 566 566
query18 2154 312 317 312
query19 365 148 149 148
query20 116 107 110 107
query21 213 104 104 104
query22 4688 4361 4590 4361
query23 34866 34161 33885 33885
query24 10926 2898 2842 2842
query25 657 422 416 416
query26 1207 168 164 164
query27 2338 301 299 299
query28 8094 2459 2446 2446
query29 864 449 435 435
query30 321 159 156 156
query31 1037 801 820 801
query32 102 60 59 59
query33 788 295 303 295
query34 963 501 500 500
query35 887 735 722 722
query36 1104 945 944 944
query37 160 95 85 85
query38 4120 3902 3945 3902
query39 1501 1440 1424 1424
query40 219 104 103 103
query41 52 49 49 49
query42 117 103 97 97
query43 538 491 497 491
query44 1302 815 794 794
query45 201 172 166 166
query46 1140 707 732 707
query47 1968 1832 1826 1826
query48 497 378 379 378
query49 1142 415 403 403
query50 817 407 421 407
query51 6963 6907 6939 6907
query52 102 88 87 87
query53 265 190 184 184
query54 1189 480 489 480
query55 83 75 77 75
query56 292 266 270 266
query57 1253 1112 1119 1112
query58 242 274 249 249
query59 3170 2993 2975 2975
query60 309 279 284 279
query61 129 138 102 102
query62 889 653 680 653
query63 222 189 188 188
query64 4203 653 645 645
query65 3303 3196 3198 3196
query66 926 310 303 303
query67 15966 15800 15752 15752
query68 4986 576 572 572
query69 472 293 295 293
query70 1182 1066 1121 1066
query71 359 281 285 281
query72 7249 4058 4010 4010
query73 761 346 351 346
query74 10233 9031 9105 9031
query75 3492 2645 2661 2645
query76 3217 922 818 818
query77 674 297 288 288
query78 10067 9308 9273 9273
query79 2387 601 634 601
query80 1150 442 447 442
query81 576 245 243 243
query82 848 146 141 141
query83 331 138 140 138
query84 280 83 79 79
query85 1583 300 282 282
query86 442 301 286 286
query87 4566 4291 4394 4291
query88 3735 2436 2403 2403
query89 404 284 283 283
query90 1887 190 188 188
query91 174 154 147 147
query92 62 51 47 47
query93 1499 554 554 554
query94 875 296 298 296
query95 351 261 259 259
query96 614 287 283 283
query97 3254 3129 3163 3129
query98 221 196 207 196
query99 1772 1328 1295 1295
Total cold run time: 304009 ms
Total hot run time: 191571 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371209386
<details>
<summary>ClickBench: <b>Total hot run time: 31.82 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 52c37e74c993a982cf854de8743c429a9a6c12c1, data reload: false
query1 0.05 0.05 0.04
query2 0.06 0.03 0.03
query3 0.22 0.07 0.06
query4 1.65 0.10 0.10
query5 0.53 0.51 0.52
query6 1.13 0.72 0.73
query7 0.02 0.02 0.01
query8 0.04 0.03 0.02
query9 0.56 0.51 0.50
query10 0.55 0.57 0.55
query11 0.13 0.10 0.10
query12 0.13 0.10 0.13
query13 0.61 0.59 0.60
query14 2.93 2.96 2.95
query15 0.90 0.84 0.81
query16 0.38 0.38 0.37
query17 1.06 1.00 1.07
query18 0.23 0.21 0.22
query19 1.94 1.80 2.00
query20 0.01 0.01 0.01
query21 15.36 0.56 0.57
query22 2.35 2.62 1.34
query23 17.27 0.74 0.94
query24 2.94 0.57 1.00
query25 0.23 0.12 0.09
query26 0.42 0.15 0.13
query27 0.04 0.04 0.05
query28 11.16 1.08 1.07
query29 12.53 3.25 3.24
query30 0.25 0.06 0.05
query31 2.87 0.39 0.37
query32 3.27 0.46 0.47
query33 2.99 3.04 3.12
query34 16.70 4.50 4.43
query35 4.51 4.47 4.43
query36 0.69 0.48 0.48
query37 0.09 0.06 0.06
query38 0.04 0.03 0.04
query39 0.04 0.02 0.02
query40 0.16 0.12 0.13
query41 0.08 0.03 0.02
query42 0.03 0.02 0.02
query43 0.03 0.03 0.03
Total cold run time: 107.18 s
Total hot run time: 31.82 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371158736
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "freemandealer (via GitHub)" <gi...@apache.org>.
freemandealer commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2378323542
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #41233:
URL: https://github.com/apache/doris/pull/41233
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371158658
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "freemandealer (via GitHub)" <gi...@apache.org>.
freemandealer commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371011052
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2371167554
<details>
<summary>TPC-H: <b>Total hot run time: 41041 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 52c37e74c993a982cf854de8743c429a9a6c12c1, data reload: false
------ Round 1 ----------------------------------
q1 17578 7616 7286 7286
q2 2053 159 177 159
q3 10559 1191 1178 1178
q4 10509 743 753 743
q5 7881 2998 2957 2957
q6 245 152 155 152
q7 1000 634 614 614
q8 9538 1976 2042 1976
q9 6770 6435 6433 6433
q10 6955 2260 2324 2260
q11 445 249 247 247
q12 413 234 220 220
q13 17868 2966 3015 2966
q14 240 234 220 220
q15 570 525 534 525
q16 673 610 606 606
q17 995 576 505 505
q18 7448 6597 6681 6597
q19 1411 1016 1002 1002
q20 599 291 302 291
q21 4085 3271 3121 3121
q22 1099 993 983 983
Total cold run time: 108934 ms
Total hot run time: 41041 ms
----- Round 2, with runtime_filter_mode=off -----
q1 7244 7275 7252 7252
q2 344 230 225 225
q3 2951 2784 2752 2752
q4 1946 1666 1747 1666
q5 5448 5481 5547 5481
q6 223 138 138 138
q7 2097 1714 1724 1714
q8 3263 3434 3438 3434
q9 8616 8541 8560 8541
q10 3502 3455 3457 3455
q11 572 464 465 464
q12 792 598 590 590
q13 7033 3049 3002 3002
q14 289 259 285 259
q15 562 512 509 509
q16 707 683 666 666
q17 1810 1575 1559 1559
q18 7719 7278 7425 7278
q19 1671 1495 1622 1495
q20 2058 1786 1800 1786
q21 5561 5294 5366 5294
q22 1098 1039 995 995
Total cold run time: 65506 ms
Total hot run time: 58555 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2378355012
<details>
<summary>TPC-H: <b>Total hot run time: 41047 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 52c37e74c993a982cf854de8743c429a9a6c12c1, data reload: false
------ Round 1 ----------------------------------
q1 17579 7370 7292 7292
q2 2014 276 270 270
q3 12541 1368 1210 1210
q4 10973 779 700 700
q5 8035 2966 2887 2887
q6 240 152 155 152
q7 1007 630 617 617
q8 9492 1936 2046 1936
q9 6683 6550 6494 6494
q10 7556 2325 2304 2304
q11 452 245 255 245
q12 412 216 221 216
q13 17773 2948 2999 2948
q14 252 210 216 210
q15 572 531 516 516
q16 675 579 589 579
q17 996 611 547 547
q18 7267 6730 6628 6628
q19 1398 960 1078 960
q20 466 198 198 198
q21 3911 3180 3135 3135
q22 1100 1003 1007 1003
Total cold run time: 111394 ms
Total hot run time: 41047 ms
----- Round 2, with runtime_filter_mode=off -----
q1 7380 7202 7215 7202
q2 351 247 241 241
q3 3148 2948 2959 2948
q4 2035 1834 1885 1834
q5 5548 5746 5725 5725
q6 228 140 138 138
q7 2198 1755 1793 1755
q8 3365 3615 3538 3538
q9 8938 8960 8950 8950
q10 3666 3609 3555 3555
q11 596 512 493 493
q12 814 617 619 617
q13 6904 3162 3158 3158
q14 301 268 285 268
q15 582 536 534 534
q16 685 638 644 638
q17 1814 1587 1567 1567
q18 8242 7805 7805 7805
q19 1715 1339 1430 1339
q20 2107 1905 1886 1886
q21 5775 5473 5382 5382
q22 1130 1038 1016 1016
Total cold run time: 67522 ms
Total hot run time: 60589 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](cloud) make active warmup job number configurable [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41233:
URL: https://github.com/apache/doris/pull/41233#issuecomment-2378365091
<details>
<summary>TPC-DS: <b>Total hot run time: 191807 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 52c37e74c993a982cf854de8743c429a9a6c12c1, data reload: false
query1 861 363 377 363
query2 6231 2055 2067 2055
query3 8595 201 208 201
query4 33412 23498 23506 23498
query5 3512 454 445 445
query6 283 184 157 157
query7 4056 301 304 301
query8 287 220 220 220
query9 9193 2701 2675 2675
query10 469 283 302 283
query11 17731 15155 15275 15155
query12 147 100 95 95
query13 1515 420 434 420
query14 9296 7601 7484 7484
query15 262 171 179 171
query16 7917 419 454 419
query17 1636 590 614 590
query18 2004 328 327 327
query19 388 172 156 156
query20 123 113 116 113
query21 221 106 103 103
query22 4738 4576 4443 4443
query23 34899 33990 34007 33990
query24 11385 2838 2930 2838
query25 666 409 411 409
query26 1628 167 169 167
query27 2496 305 303 303
query28 7609 2478 2426 2426
query29 962 437 429 429
query30 261 157 153 153
query31 1016 799 800 799
query32 99 53 57 53
query33 778 309 298 298
query34 931 502 488 488
query35 895 737 717 717
query36 1091 934 970 934
query37 199 83 92 83
query38 4002 3864 3826 3826
query39 1502 1438 1409 1409
query40 253 97 100 97
query41 50 47 45 45
query42 115 100 96 96
query43 548 490 487 487
query44 1217 822 797 797
query45 200 164 162 162
query46 1144 746 757 746
query47 1911 1813 1845 1813
query48 468 370 382 370
query49 1037 425 404 404
query50 815 407 419 407
query51 7006 7102 6871 6871
query52 96 89 90 89
query53 253 181 180 180
query54 1213 474 489 474
query55 83 79 80 79
query56 295 259 264 259
query57 1229 1119 1101 1101
query58 261 223 232 223
query59 3176 2836 2846 2836
query60 296 285 270 270
query61 100 100 101 100
query62 878 664 673 664
query63 220 185 188 185
query64 4925 639 614 614
query65 3338 3188 3156 3156
query66 1341 303 312 303
query67 15909 15826 15578 15578
query68 4830 575 562 562
query69 521 326 296 296
query70 1150 1128 1132 1128
query71 346 292 278 278
query72 7121 3953 4000 3953
query73 767 351 353 351
query74 10476 9140 8994 8994
query75 3435 2708 2700 2700
query76 3005 887 822 822
query77 596 299 297 297
query78 10530 9604 9528 9528
query79 3657 600 607 600
query80 1802 436 460 436
query81 588 241 240 240
query82 677 141 143 141
query83 307 132 134 132
query84 275 80 78 78
query85 1846 290 283 283
query86 457 300 307 300
query87 4389 4256 4261 4256
query88 4006 2404 2389 2389
query89 411 284 286 284
query90 2058 188 185 185
query91 170 144 146 144
query92 69 47 47 47
query93 2996 547 553 547
query94 1082 293 298 293
query95 365 250 246 246
query96 629 284 278 278
query97 3254 3184 3122 3122
query98 218 201 197 197
query99 1527 1317 1298 1298
Total cold run time: 305233 ms
Total hot run time: 191807 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org