You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Jibing-Li (via GitHub)" <gi...@apache.org> on 2024/02/20 09:46:03 UTC
[PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Jibing-Li opened a new pull request, #31162:
URL: https://github.com/apache/doris/pull/31162
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953889294
<details>
<summary>TPC-DS: <b>Total hot run time: 177886 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 662ecec2783bd3ae9df7783193f05953a8a9db38, data reload: false
query1 910 352 342 342
query2 6515 1688 1721 1688
query3 6700 203 205 203
query4 23013 21134 21065 21065
query5 4229 462 455 455
query6 263 172 171 171
query7 4610 295 300 295
query8 251 210 223 210
query9 8405 2873 2844 2844
query10 429 231 247 231
query11 14979 14468 14402 14402
query12 142 82 82 82
query13 1678 421 425 421
query14 9159 7628 7712 7628
query15 211 184 185 184
query16 7608 262 268 262
query17 1379 560 543 543
query18 1958 273 266 266
query19 185 153 149 149
query20 95 84 83 83
query21 189 112 120 112
query22 4996 4780 4705 4705
query23 32640 31572 31608 31572
query24 12746 3488 3447 3447
query25 627 369 376 369
query26 1815 154 162 154
query27 3053 321 323 321
query28 6687 1843 1835 1835
query29 1130 621 626 621
query30 273 137 147 137
query31 932 753 762 753
query32 99 67 58 58
query33 731 234 242 234
query34 1062 495 501 495
query35 935 835 825 825
query36 1011 917 924 917
query37 135 61 61 61
query38 3257 3166 3186 3166
query39 1380 1328 1311 1311
query40 284 105 103 103
query41 37 34 34 34
query42 108 103 109 103
query43 472 444 439 439
query44 1083 703 715 703
query45 201 180 176 176
query46 1028 781 737 737
query47 1685 1523 1510 1510
query48 431 346 364 346
query49 1160 306 306 306
query50 771 392 380 380
query51 5336 5180 5146 5146
query52 111 92 92 92
query53 397 304 297 297
query54 290 234 235 234
query55 84 84 79 79
query56 231 210 203 203
query57 1057 914 924 914
query58 225 205 199 199
query59 2188 2043 2163 2043
query60 249 214 221 214
query61 94 97 85 85
query62 609 372 376 372
query63 333 283 288 283
query64 6477 3107 3146 3107
query65 3287 3300 3254 3254
query66 1339 331 321 321
query67 14511 14363 14327 14327
query68 4853 571 565 565
query69 494 357 352 352
query70 1282 1199 1283 1199
query71 334 256 257 256
query72 6417 2816 2643 2643
query73 714 313 315 313
query74 6778 6497 6470 6470
query75 3156 2547 2532 2532
query76 3046 1123 1205 1123
query77 346 248 241 241
query78 9451 8811 8778 8778
query79 1065 511 512 511
query80 699 361 351 351
query81 442 206 204 204
query82 1249 89 85 85
query83 237 124 121 121
query84 229 81 77 77
query85 1161 355 352 352
query86 314 321 309 309
query87 3502 3267 3290 3267
query88 2694 2273 2287 2273
query89 445 354 366 354
query90 2126 169 166 166
query91 159 125 135 125
query92 59 50 49 49
query93 1046 499 519 499
query94 1195 184 186 184
query95 8727 8534 391 391
query96 582 265 267 265
query97 4473 4275 4309 4275
query98 211 210 195 195
query99 1142 752 737 737
Total cold run time: 279123 ms
Total hot run time: 177886 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953899248
<details>
<summary>ClickBench: <b>Total hot run time: 30.93 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 662ecec2783bd3ae9df7783193f05953a8a9db38, data reload: false
query1 0.02 0.02 0.02
query2 0.07 0.02 0.02
query3 0.24 0.08 0.07
query4 1.62 0.09 0.08
query5 0.49 0.49 0.49
query6 1.38 0.61 0.62
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.53 0.45 0.46
query10 0.50 0.50 0.50
query11 0.14 0.10 0.10
query12 0.12 0.11 0.10
query13 0.60 0.59 0.58
query14 0.77 0.79 0.79
query15 0.83 0.80 0.80
query16 0.33 0.33 0.33
query17 0.92 0.93 0.93
query18 0.19 0.17 0.19
query19 1.83 1.66 1.69
query20 0.01 0.02 0.02
query21 15.44 0.67 0.59
query22 3.58 3.74 2.30
query23 17.48 1.18 0.94
query24 2.19 0.37 0.38
query25 0.62 0.06 0.06
query26 0.16 0.15 0.14
query27 0.06 0.06 0.05
query28 11.90 0.81 0.82
query29 12.58 3.38 3.28
query30 0.53 0.48 0.48
query31 2.78 0.36 0.37
query32 3.29 0.47 0.47
query33 3.11 3.22 3.14
query34 15.36 4.51 4.45
query35 4.48 4.50 4.52
query36 1.08 0.98 0.96
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.01
query40 0.18 0.14 0.14
query41 0.07 0.02 0.01
query42 0.02 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 105.72 s
Total hot run time: 30.93 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953868692
<details>
<summary>TPC-H: <b>Total hot run time: 41607 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 662ecec2783bd3ae9df7783193f05953a8a9db38, data reload: false
------ Round 1 ----------------------------------
q1 6040 4887 4894 4887
q2 398 146 139 139
q3 1430 1020 1032 1020
q4 1172 992 1002 992
q5 3043 3305 3266 3266
q6 192 136 138 136
q7 1265 929 819 819
q8 1960 2061 2059 2059
q9 6703 6709 6655 6655
q10 3208 2669 2639 2639
q11 336 213 204 204
q12 507 336 342 336
q13 4591 3726 3677 3677
q14 293 259 265 259
q15 584 515 503 503
q16 473 409 411 409
q17 910 870 875 870
q18 7246 6726 6648 6648
q19 1487 1502 1494 1494
q20 565 333 354 333
q21 4306 3961 3920 3920
q22 402 359 342 342
Total cold run time: 47111 ms
Total hot run time: 41607 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4860 4839 4831 4831
q2 292 197 187 187
q3 3628 3589 3606 3589
q4 2513 2522 2532 2522
q5 5789 5765 5770 5765
q6 210 131 130 130
q7 2266 1654 1674 1654
q8 3002 3071 3106 3071
q9 8682 8690 8729 8690
q10 4152 4241 4248 4241
q11 539 394 379 379
q12 781 553 558 553
q13 4164 3439 3403 3403
q14 269 234 227 227
q15 626 496 498 496
q16 480 443 442 442
q17 1711 1626 1630 1626
q18 8305 7666 7603 7603
q19 1621 1632 1626 1626
q20 2132 1852 1866 1852
q21 6634 6227 6235 6227
q22 587 537 532 532
Total cold run time: 63243 ms
Total hot run time: 59646 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953835513
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953904770
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 662ecec2783bd3ae9df7783193f05953a8a9db38 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953869325
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953869369
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31162:
URL: https://github.com/apache/doris/pull/31162#issuecomment-1953834348
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](feut)Fix load stats cache FE ut case. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li merged PR #31162:
URL: https://github.com/apache/doris/pull/31162
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org