You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "SWJTU-ZhangLei (via GitHub)" <gi...@apache.org> on 2024/07/05 03:03:02 UTC
[PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
SWJTU-ZhangLei opened a new pull request, #37328:
URL: https://github.com/apache/doris/pull/37328
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "SWJTU-ZhangLei (via GitHub)" <gi...@apache.org>.
SWJTU-ZhangLei commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2209915381
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2210082296
<details>
<summary>TPC-DS: <b>Total hot run time: 174279 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit db725071533a8cca4acbc6417a435cd768b8d56e, data reload: false
query1 926 384 368 368
query2 6452 2472 2300 2300
query3 6630 209 222 209
query4 28947 17897 17518 17518
query5 3653 480 489 480
query6 280 181 185 181
query7 4595 290 305 290
query8 324 291 305 291
query9 8540 2322 2307 2307
query10 568 288 275 275
query11 10675 10337 10344 10337
query12 119 85 80 80
query13 1629 370 364 364
query14 10099 7894 6830 6830
query15 226 181 185 181
query16 7758 314 302 302
query17 1781 556 516 516
query18 1950 287 283 283
query19 208 156 160 156
query20 91 85 85 85
query21 217 138 131 131
query22 4570 4289 4257 4257
query23 34158 33590 33720 33590
query24 11108 2917 2955 2917
query25 604 389 409 389
query26 737 165 157 157
query27 2355 325 330 325
query28 6159 2107 2088 2088
query29 897 639 634 634
query30 247 157 159 157
query31 1024 764 789 764
query32 98 61 57 57
query33 769 301 306 301
query34 908 505 496 496
query35 758 650 653 650
query36 1140 956 974 956
query37 142 77 79 77
query38 3006 2797 2756 2756
query39 838 832 799 799
query40 209 125 122 122
query41 47 52 50 50
query42 124 97 103 97
query43 609 547 529 529
query44 1236 721 728 721
query45 192 161 166 161
query46 1090 727 732 727
query47 1859 1800 1788 1788
query48 386 311 300 300
query49 846 411 419 411
query50 780 389 396 389
query51 6944 6768 6749 6749
query52 105 93 96 93
query53 363 293 287 287
query54 949 449 438 438
query55 74 75 74 74
query56 293 285 285 285
query57 1146 1055 1065 1055
query58 262 243 240 240
query59 3478 3234 3222 3222
query60 347 279 277 277
query61 101 94 95 94
query62 608 452 445 445
query63 325 292 285 285
query64 8521 2251 1766 1766
query65 3152 3100 3109 3100
query66 741 342 345 342
query67 15406 15058 15087 15058
query68 5475 537 538 537
query69 670 488 358 358
query70 1210 1064 1161 1064
query71 458 345 280 280
query72 7265 5352 5597 5352
query73 782 327 325 325
query74 6257 5653 5590 5590
query75 3551 2646 2684 2646
query76 3168 906 920 906
query77 631 300 301 300
query78 9638 9158 9789 9158
query79 3178 515 514 514
query80 2346 478 475 475
query81 599 222 224 222
query82 1438 109 111 109
query83 280 176 173 173
query84 279 97 90 90
query85 1297 322 301 301
query86 339 327 317 317
query87 3332 3103 3101 3101
query88 4219 2450 2432 2432
query89 475 384 385 384
query90 1396 184 192 184
query91 132 102 104 102
query92 58 51 49 49
query93 2951 500 496 496
query94 557 210 211 210
query95 389 308 316 308
query96 616 270 272 270
query97 3209 3061 3047 3047
query98 223 207 200 200
query99 1154 820 865 820
Total cold run time: 282951 ms
Total hot run time: 174279 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2210090969
<details>
<summary>ClickBench: <b>Total hot run time: 30.37 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit db725071533a8cca4acbc6417a435cd768b8d56e, data reload: false
query1 0.04 0.04 0.03
query2 0.08 0.04 0.04
query3 0.23 0.05 0.05
query4 1.68 0.07 0.06
query5 0.51 0.48 0.50
query6 1.13 0.72 0.74
query7 0.02 0.01 0.02
query8 0.05 0.04 0.05
query9 0.54 0.49 0.50
query10 0.55 0.54 0.55
query11 0.16 0.10 0.11
query12 0.14 0.12 0.12
query13 0.59 0.59 0.58
query14 0.77 0.80 0.77
query15 0.86 0.81 0.81
query16 0.37 0.35 0.36
query17 1.03 1.03 1.03
query18 0.23 0.25 0.28
query19 1.78 1.78 1.80
query20 0.01 0.01 0.01
query21 15.40 0.79 0.66
query22 4.32 7.36 1.75
query23 18.26 1.37 1.26
query24 2.09 0.21 0.23
query25 0.16 0.08 0.08
query26 0.29 0.21 0.21
query27 0.47 0.24 0.22
query28 13.32 1.01 1.00
query29 12.66 3.30 3.25
query30 0.25 0.06 0.06
query31 2.86 0.38 0.38
query32 3.28 0.47 0.46
query33 2.90 2.85 2.96
query34 16.88 4.32 4.43
query35 4.43 4.38 4.41
query36 0.65 0.46 0.46
query37 0.18 0.15 0.15
query38 0.15 0.14 0.15
query39 0.04 0.03 0.04
query40 0.15 0.11 0.13
query41 0.10 0.05 0.05
query42 0.06 0.05 0.04
query43 0.04 0.04 0.04
Total cold run time: 109.71 s
Total hot run time: 30.37 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2210079442
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2209907161
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2210048333
<details>
<summary>TPC-H: <b>Total hot run time: 39618 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit db725071533a8cca4acbc6417a435cd768b8d56e, data reload: false
------ Round 1 ----------------------------------
q1 17608 4416 4298 4298
q2 2023 196 186 186
q3 10485 1229 1164 1164
q4 10194 903 767 767
q5 7491 2640 2539 2539
q6 221 135 136 135
q7 944 599 606 599
q8 9218 2060 2067 2060
q9 8771 6485 6481 6481
q10 8985 3732 3738 3732
q11 454 233 235 233
q12 431 224 224 224
q13 17760 2961 2958 2958
q14 262 228 231 228
q15 530 479 475 475
q16 501 375 369 369
q17 950 631 651 631
q18 8008 7507 7370 7370
q19 5455 1402 1511 1402
q20 695 313 330 313
q21 4906 3120 3779 3120
q22 391 334 340 334
Total cold run time: 116283 ms
Total hot run time: 39618 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4372 4264 4227 4227
q2 367 265 282 265
q3 2995 2769 2915 2769
q4 1983 1728 1692 1692
q5 5685 5557 5459 5459
q6 233 133 128 128
q7 2173 1851 1874 1851
q8 3246 3421 3389 3389
q9 8737 8632 8803 8632
q10 4042 3902 3690 3690
q11 592 509 512 509
q12 804 644 654 644
q13 16130 3160 3121 3121
q14 330 277 281 277
q15 532 487 495 487
q16 504 434 414 414
q17 1831 1521 1502 1502
q18 8129 8024 7759 7759
q19 1788 1610 1687 1610
q20 2194 1934 1850 1850
q21 5076 4896 4935 4896
q22 646 537 569 537
Total cold run time: 72389 ms
Total hot run time: 55708 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2210079507
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "gavinchou (via GitHub)" <gi...@apache.org>.
gavinchou commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2210740663
pls describe what the metrics is like, list an example here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "SWJTU-ZhangLei (via GitHub)" <gi...@apache.org>.
SWJTU-ZhangLei commented on PR #37328:
URL: https://github.com/apache/doris/pull/37328#issuecomment-2209907189
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](fe) Add a counter metric for recording large editlog write [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #37328:
URL: https://github.com/apache/doris/pull/37328
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org