You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hello-stephen (via GitHub)" <gi...@apache.org> on 2023/12/28 13:05:00 UTC
[PR] [ci](trigger) support "run performance" [doris]
hello-stephen opened a new pull request, #29259:
URL: https://github.com/apache/doris/pull/29259
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871648528
run external
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871663169
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871717261
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 7901ff2fa826bfe05b6d3bbda48fe778eb67f012, data reload: false
------ Round 1 ----------------------------------
q1 17648 5165 5155 5155
q2 2013 159 149 149
q3 10525 1065 1182 1065
q4 10194 784 824 784
q5 7801 2899 3054 2899
q6 216 136 136 136
q7 903 540 553 540
q8 9272 2019 2012 2012
q9 6790 6378 6375 6375
q10 8269 3113 3047 3047
q11 427 231 222 222
q12 397 239 245 239
q13 17999 3601 3610 3601
q14 248 213 210 210
q15 603 550 543 543
q16 452 394 394 394
q17 958 511 491 491
q18 7232 6653 6683 6653
q19 1622 1397 1368 1368
q20 738 334 368 334
q21 2848 2397 2507 2397
q22 380 318 319 318
Total cold run time: 107535 ms
Total hot run time: 38932 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5093 5101 5124 5101
q2 345 250 260 250
q3 3299 3291 3267 3267
q4 2128 1992 2004 1992
q5 5759 5735 5748 5735
q6 221 131 129 129
q7 2294 1891 1875 1875
q8 3383 3418 3466 3418
q9 8766 8781 8816 8781
q10 3796 3851 3836 3836
q11 575 493 501 493
q12 797 672 699 672
q13 6965 3225 3210 3210
q14 299 304 278 278
q15 598 552 555 552
q16 568 529 505 505
q17 1928 1762 1759 1759
q18 8658 8297 8286 8286
q19 1624 1603 1636 1603
q20 2218 1959 1957 1957
q21 5560 5201 5382 5201
q22 517 478 485 478
Total cold run time: 65391 ms
Total hot run time: 59378 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871189550
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871720824
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit 7901ff2fa826bfe05b6d3bbda48fe778eb67f012, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 910 374 344 344
query2 6411 1849 1927 1849
query3 6650 220 217 217
query4 26433 22413 22345 22345
query5 5198 575 554 554
query6 285 190 190 190
query7 4574 284 278 278
query8 229 202 203 202
query9 8120 2705 2643 2643
query10 444 267 237 237
query11 16320 15548 15517 15517
query12 140 80 78 78
query13 1680 337 340 337
query14 12208 7241 7256 7241
query15 243 185 199 185
query16 6467 298 294 294
query17 1746 496 502 496
query18 1921 271 267 267
query19 234 142 142 142
query20 87 77 79 77
query21 189 99 98 98
query22 5291 5070 4878 4878
query23 32242 31395 31296 31296
query24 11836 2819 2899 2819
query25 587 358 350 350
query26 1689 147 149 147
query27 2856 284 290 284
query28 7237 1975 1984 1975
query29 2051 416 402 402
query30 288 138 154 138
query31 973 790 765 765
query32 93 64 64 64
query33 725 280 275 275
query34 856 453 462 453
query35 933 787 778 778
query36 1324 1130 1271 1130
query37 199 85 88 85
query38 3442 3346 3278 3278
query39 1307 1306 1267 1267
query40 299 97 92 92
query41 39 37 35 35
query42 100 89 94 89
query43 528 526 503 503
query44 1109 764 766 764
query45 204 187 183 183
query46 1100 651 656 651
query47 1714 1553 1641 1553
query48 339 272 280 272
query49 1192 341 340 340
query50 752 342 380 342
query51 5333 5249 5415 5249
query52 93 91 92 91
query53 222 153 156 153
query54 1361 593 605 593
query55 99 91 90 90
query56 219 209 205 205
query57 1063 1022 979 979
query58 243 212 210 210
query59 2795 2633 2666 2633
query60 271 243 239 239
query61 91 90 102 90
query62 639 472 471 471
query63 180 171 160 160
query64 5941 1777 1764 1764
query65 3356 3272 3242 3242
query66 1320 342 336 336
query67 15455 15387 15796 15387
query68 12087 537 516 516
query69 606 264 262 262
query70 1552 1508 1497 1497
query71 582 233 231 231
query72 5616 3585 3558 3558
query73 1649 330 330 330
query74 7122 6441 6579 6441
query75 5671 2310 2292 2292
query76 5558 1149 1111 1111
query77 871 272 292 272
query78 9256 8703 8717 8703
query79 6031 504 513 504
query80 2529 373 378 373
query81 518 204 207 204
query82 371 124 119 119
query83 306 142 137 137
query84 264 54 56 54
query85 1655 295 290 290
query86 398 363 382 363
query87 3589 3382 3404 3382
query88 2844 2392 2387 2387
query89 351 261 265 261
query90 1712 255 247 247
query91 123 95 91 91
query92 80 53 55 53
query93 2965 516 451 451
query94 625 215 213 213
query95 521 466 469 466
query96 652 332 322 322
query97 4258 4106 4164 4106
query98 211 204 182 182
query99 1096 859 864 859
Total cold run time: 302144 ms
Total hot run time: 180968 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871648576
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871679763
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.67 seconds
stream load tsv: 577 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.1 seconds inserted 10000000 Rows, about 355K ops/s
storage size: 17184095946 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871210460
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871755776
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871675255
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 7901ff2fa826bfe05b6d3bbda48fe778eb67f012, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5439 5187 5198 5187
q2 391 203 197 197
q3 1482 1160 1245 1160
q4 1086 843 816 816
q5 3113 3183 3170 3170
q6 229 138 133 133
q7 989 573 521 521
q8 2161 2295 2220 2220
q9 6736 6686 6651 6651
q10 3185 3178 3091 3091
q11 359 231 222 222
q12 390 251 243 243
q13 4414 3618 3656 3618
q14 247 218 224 218
q15 623 589 572 572
q16 475 420 393 393
q17 1067 549 540 540
q18 7103 6769 6812 6769
q19 1656 1540 1530 1530
q20 624 374 344 344
q21 2968 2514 2485 2485
q22 396 336 346 336
Total cold run time: 45133 ms
Total hot run time: 40416 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5102 5112 5077 5077
q2 341 255 260 255
q3 3415 3340 3309 3309
q4 2155 2062 2043 2043
q5 5974 5937 5947 5937
q6 236 132 132 132
q7 2371 1930 1931 1930
q8 3568 3644 3654 3644
q9 9097 9047 9010 9010
q10 3875 3928 3920 3920
q11 576 508 479 479
q12 811 640 621 621
q13 3920 3196 3191 3191
q14 292 294 295 294
q15 637 583 569 569
q16 563 511 518 511
q17 2008 1793 1815 1793
q18 8793 8327 8293 8293
q19 1758 1704 1751 1704
q20 2284 1988 2001 1988
q21 5678 5295 5298 5295
q22 563 475 532 475
Total cold run time: 64017 ms
Total hot run time: 60470 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 merged PR #29259:
URL: https://github.com/apache/doris/pull/29259
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](trigger) support "run performance" [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871160613
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org