You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "freemandealer (via GitHub)" <gi...@apache.org> on 2023/12/31 12:27:12 UTC
[PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
freemandealer opened a new pull request, #29354:
URL: https://github.com/apache/doris/pull/29354
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1874869452
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1874869428
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1872938137
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #29354:
URL: https://github.com/apache/doris/pull/29354
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1872943105
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.67 seconds
stream load tsv: 563 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 27.9 seconds inserted 10000000 Rows, about 358K ops/s
storage size: 17183826818 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1872944748
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit 080ccc1df52d531096e23a322c4a5436ab1efba2, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 944 367 345 345
query2 6438 2132 2142 2132
query3 6650 212 204 204
query4 28120 22551 22469 22469
query5 5778 592 550 550
query6 274 182 182 182
query7 4598 273 267 267
query8 232 207 211 207
query9 8247 2634 2602 2602
query10 442 260 243 243
query11 16267 15493 15686 15493
query12 135 86 78 78
query13 1651 340 328 328
query14 11968 7242 7222 7222
query15 245 193 189 189
query16 6377 282 287 282
query17 1800 503 501 501
query18 1949 268 263 263
query19 278 154 136 136
query20 95 80 83 80
query21 189 101 96 96
query22 4879 4704 4802 4704
query23 32355 31299 31044 31044
query24 11920 2827 2782 2782
query25 581 353 352 352
query26 1713 144 148 144
query27 2840 280 285 280
query28 7107 1982 1978 1978
query29 2017 391 398 391
query30 288 142 147 142
query31 978 770 769 769
query32 86 61 62 61
query33 725 284 281 281
query34 870 447 438 438
query35 910 743 749 743
query36 1411 1241 1243 1241
query37 185 79 75 75
query38 3404 3302 3261 3261
query39 1322 1286 1275 1275
query40 304 100 95 95
query41 39 35 36 35
query42 96 92 96 92
query43 557 535 530 530
query44 1140 726 727 726
query45 201 190 189 189
query46 1079 664 648 648
query47 1679 1635 1599 1599
query48 338 271 261 261
query49 1204 336 336 336
query50 824 341 345 341
query51 5353 5325 5222 5222
query52 99 84 101 84
query53 224 162 156 156
query54 1339 584 620 584
query55 100 87 93 87
query56 210 211 205 205
query57 993 941 913 913
query58 227 210 211 210
query59 2983 2755 2792 2755
query60 264 237 239 237
query61 91 85 90 85
query62 638 466 469 466
query63 166 155 151 151
query64 5924 1788 1773 1773
query65 3374 3264 3294 3264
query66 1275 341 332 332
query67 15812 15166 15467 15166
query68 12781 528 533 528
query69 510 263 261 261
query70 1714 1555 1568 1555
query71 498 239 236 236
query72 5619 3612 3658 3612
query73 2927 318 311 311
query74 7033 6443 6366 6366
query75 5166 2314 2280 2280
query76 6270 1124 1129 1124
query77 663 290 286 286
query78 9148 8941 8658 8658
query79 1026 531 521 521
query80 575 379 374 374
query81 452 210 211 210
query82 209 112 109 109
query83 168 139 142 139
query84 248 56 55 55
query85 954 289 282 282
query86 460 406 386 386
query87 3571 3339 3358 3339
query88 2941 2272 2275 2272
query89 350 260 257 257
query90 1869 217 205 205
query91 120 90 98 90
query92 63 57 55 55
query93 1576 500 494 494
query94 795 196 194 194
query95 479 441 435 435
query96 622 324 354 324
query97 4263 4148 4192 4148
query98 206 212 197 197
query99 1108 862 854 854
Total cold run time: 297185 ms
Total hot run time: 180529 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1872942181
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 080ccc1df52d531096e23a322c4a5436ab1efba2, data reload: false
------ Round 1 ----------------------------------
q1 17641 5125 5067 5067
q2 2010 163 145 145
q3 10532 1068 1131 1068
q4 10186 836 823 823
q5 7797 2881 2842 2842
q6 209 126 134 126
q7 922 552 492 492
q8 9231 2007 2000 2000
q9 6746 6332 6346 6332
q10 8238 2992 2995 2992
q11 433 226 204 204
q12 387 231 230 230
q13 18004 3632 3611 3611
q14 239 214 198 198
q15 585 549 527 527
q16 449 394 396 394
q17 950 485 530 485
q18 7195 6665 6713 6665
q19 1589 1345 1373 1345
q20 708 325 353 325
q21 2776 2355 2379 2355
q22 363 325 340 325
Total cold run time: 107190 ms
Total hot run time: 38551 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5139 5054 5040 5040
q2 336 245 246 245
q3 3282 3268 3244 3244
q4 2103 1991 1991 1991
q5 5749 5754 5743 5743
q6 213 123 123 123
q7 2285 1864 1850 1850
q8 3351 3384 3476 3384
q9 8732 8746 8680 8680
q10 3780 3813 3822 3813
q11 582 486 483 483
q12 811 676 618 618
q13 7606 3176 3160 3160
q14 300 275 268 268
q15 608 541 536 536
q16 562 488 518 488
q17 1924 1752 1735 1735
q18 8641 8379 8260 8260
q19 1615 1536 1545 1536
q20 2185 1974 1961 1961
q21 5485 5319 5247 5247
q22 556 455 489 455
Total cold run time: 65845 ms
Total hot run time: 58860 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1872940990
TeamCity be ut coverage result:
Function Coverage: 36.62% (8614/23520)
Line Coverage: 28.68% (70008/244101)
Region Coverage: 27.67% (36238/130970)
Branch Coverage: 24.37% (18516/75982)
Coverage Report: http://coverage.selectdb-in.cc/coverage/080ccc1df52d531096e23a322c4a5436ab1efba2_080ccc1df52d531096e23a322c4a5436ab1efba2/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [regression](move-memtable) test LoadStream on_idle_timeout [doris]
Posted by "freemandealer (via GitHub)" <gi...@apache.org>.
freemandealer commented on PR #29354:
URL: https://github.com/apache/doris/pull/29354#issuecomment-1872936661
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org