You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hello-stephen (via GitHub)" <gi...@apache.org> on 2024/01/06 02:12:05 UTC
[PR] [ci](perf) adjust performance pipeline [doris]
hello-stephen opened a new pull request, #29622:
URL: https://github.com/apache/doris/pull/29622
1. remove old tpch trigger
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883410357
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 27c3387788ad3a3143305aa5f51845839fd07584 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.2 seconds inserted 10000000 Rows, about 704K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883394952
<details>
<summary>TPC-DS: <b>Total hot run time: 178768 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 27c3387788ad3a3143305aa5f51845839fd07584, data reload: false
query1 958 351 339 339
query2 6602 2100 1888 1888
query3 6703 217 212 212
query4 26125 22180 22673 22180
query5 5395 559 525 525
query6 276 187 180 180
query7 4615 279 272 272
query8 228 202 205 202
query9 8738 2652 2631 2631
query10 443 241 279 241
query11 16278 15300 15464 15300
query12 135 77 76 76
query13 1634 334 348 334
query14 12298 7279 7201 7201
query15 229 195 199 195
query16 6559 277 265 265
query17 1906 495 493 493
query18 1939 269 262 262
query19 276 140 141 140
query20 86 80 76 76
query21 188 90 94 90
query22 5036 4731 4761 4731
query23 32256 31079 31192 31079
query24 10849 2871 2792 2792
query25 582 338 336 336
query26 1555 156 151 151
query27 2819 274 285 274
query28 7022 1917 1897 1897
query29 1563 375 389 375
query30 278 146 146 146
query31 966 762 796 762
query32 91 58 56 56
query33 722 250 294 250
query34 865 441 441 441
query35 865 746 759 746
query36 1429 1344 1306 1306
query37 100 66 67 66
query38 3412 3248 3248 3248
query39 1331 1294 1281 1281
query40 191 95 91 91
query41 44 35 33 33
query42 100 87 91 87
query43 549 499 494 494
query44 1107 696 710 696
query45 202 192 196 192
query46 1057 654 680 654
query47 1653 1513 1544 1513
query48 403 319 316 316
query49 1120 303 313 303
query50 723 330 364 330
query51 5364 5258 5288 5258
query52 96 86 80 80
query53 236 158 153 153
query54 1386 566 587 566
query55 92 86 81 81
query56 215 193 197 193
query57 1042 953 944 944
query58 232 216 213 213
query59 2816 2613 2614 2613
query60 230 216 246 216
query61 81 80 79 79
query62 662 462 473 462
query63 170 146 145 145
query64 4944 1695 1665 1665
query65 3343 3242 3237 3237
query66 1178 345 353 345
query67 15726 15433 15151 15151
query68 11283 536 531 531
query69 541 272 283 272
query70 1765 1557 1589 1557
query71 495 203 230 203
query72 5552 3470 3424 3424
query73 2099 326 325 325
query74 6996 6419 6496 6419
query75 4931 2261 2258 2258
query76 6321 904 1078 904
query77 675 264 286 264
query78 9647 8579 8815 8579
query79 1004 506 521 506
query80 568 339 332 332
query81 454 214 212 212
query82 205 89 86 86
query83 159 144 139 139
query84 265 57 55 55
query85 966 288 273 273
query86 401 412 403 403
query87 3535 3424 3431 3424
query88 3100 2314 2302 2302
query89 331 261 251 251
query90 1870 202 205 202
query91 168 131 142 131
query92 60 54 52 52
query93 1123 433 431 431
query94 756 190 190 190
query95 466 422 418 418
query96 637 343 333 333
query97 4275 4151 4165 4151
query98 203 187 184 184
query99 1064 814 808 808
Total cold run time: 290229 ms
Total hot run time: 178768 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882732127
<details>
<summary>TPC-H: <b>Total hot run time: 39443 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b7114bbaa9df0b3feffac876697de6ecd8e8b9cb, data reload: false
------ Round 1 ----------------------------------
q1 13736 5527 5585 5527
q2 416 159 151 151
q3 1413 1184 1100 1100
q4 1059 768 883 768
q5 3070 2983 3008 2983
q6 207 162 131 131
q7 904 541 498 498
q8 1914 1950 1995 1950
q9 6411 6420 6399 6399
q10 3059 2998 2954 2954
q11 329 223 229 223
q12 382 247 236 236
q13 4239 3506 3466 3466
q14 238 216 204 204
q15 548 523 505 505
q16 451 410 398 398
q17 916 770 683 683
q18 7189 6805 6713 6713
q19 1540 1522 1526 1522
q20 550 321 317 317
q21 2706 2386 2409 2386
q22 372 346 329 329
Total cold run time: 51649 ms
Total hot run time: 39443 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5553 5522 5486 5486
q2 360 273 263 263
q3 3386 3316 3292 3292
q4 2117 2096 2092 2092
q5 5859 5879 5830 5830
q6 207 123 126 123
q7 2334 1888 1907 1888
q8 3472 3502 3560 3502
q9 8942 8887 8889 8887
q10 3773 3831 3877 3831
q11 607 526 511 511
q12 818 628 636 628
q13 3928 3301 3242 3242
q14 296 278 252 252
q15 551 513 514 513
q16 551 510 527 510
q17 2389 2375 2380 2375
q18 8554 8623 8389 8389
q19 1578 1632 1622 1622
q20 2193 1959 1962 1959
q21 5685 5430 5308 5308
q22 584 552 532 532
Total cold run time: 63737 ms
Total hot run time: 61035 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882651224
run performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882696812
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1884054243
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883374514
<details>
<summary>TPC-H: <b>Total hot run time: 38699 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 27c3387788ad3a3143305aa5f51845839fd07584, data reload: false
------ Round 1 ----------------------------------
q1 17903 5139 5018 5018
q2 2045 147 140 140
q3 10735 1118 1192 1118
q4 10287 780 804 780
q5 7820 3130 3211 3130
q6 200 124 128 124
q7 874 508 490 490
q8 9232 2002 1995 1995
q9 7062 6513 6435 6435
q10 8237 3073 3040 3040
q11 408 209 218 209
q12 362 202 197 197
q13 18069 3469 3454 3454
q14 241 216 209 209
q15 567 518 509 509
q16 431 389 384 384
q17 959 535 502 502
q18 7404 6700 6642 6642
q19 1593 1300 1385 1300
q20 538 287 310 287
q21 2816 2408 2417 2408
q22 360 328 334 328
Total cold run time: 108143 ms
Total hot run time: 38699 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4973 4982 4957 4957
q2 311 196 198 196
q3 3355 3315 3322 3315
q4 2263 2258 2257 2257
q5 5827 5809 5811 5809
q6 193 119 120 119
q7 2325 1847 1874 1847
q8 3460 3557 3574 3557
q9 8897 8833 8859 8833
q10 3741 3814 3854 3814
q11 550 415 411 411
q12 784 604 627 604
q13 4040 3255 3244 3244
q14 291 262 272 262
q15 566 509 512 509
q16 497 456 456 456
q17 2040 2019 2017 2017
q18 8814 8325 8278 8278
q19 1625 1617 1601 1601
q20 2162 1936 1949 1936
q21 6099 5799 5760 5760
q22 571 488 492 488
Total cold run time: 63384 ms
Total hot run time: 60270 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882637884
<details>
<summary>TPC-DS: <b>Total hot run time: 186985 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c7456c220340d7fbad903a33f7453f621e78a1f, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 952 346 334 334
query2 6880 2056 2029 2029
query3 6732 237 232 232
query4 27479 22621 22543 22543
query5 4092 589 633 589
query6 318 231 214 214
query7 4638 303 318 303
query8 285 249 247 247
query9 9703 3261 3312 3261
query10 576 353 337 337
query11 16055 15567 15787 15567
query12 188 122 134 122
query13 1655 336 369 336
query14 12529 7715 7526 7526
query15 273 240 219 219
query16 6498 354 337 337
query17 1744 548 546 546
query18 1971 338 317 317
query19 239 179 178 178
query20 122 117 120 117
query21 190 103 98 98
query22 4760 4651 4490 4490
query23 32078 31387 31469 31387
query24 12456 3065 3044 3044
query25 630 390 391 390
query26 1827 200 183 183
query27 2872 326 308 308
query28 6919 2115 2116 2115
query29 2118 446 450 446
query30 295 148 144 144
query31 1075 840 907 840
query32 135 110 95 95
query33 852 381 361 361
query34 868 513 505 505
query35 1073 911 921 911
query36 1426 1325 1287 1287
query37 236 113 116 113
query38 3500 3453 3388 3388
query39 1353 1321 1342 1321
query40 306 101 95 95
query41 40 39 39 39
query42 126 110 114 110
query43 603 577 577 577
query44 1276 848 838 838
query45 222 203 210 203
query46 1064 688 694 688
query47 1700 1722 1673 1673
query48 365 288 313 288
query49 1228 339 330 330
query50 819 325 376 325
query51 5496 5472 5401 5401
query52 133 106 123 106
query53 238 183 177 177
query54 1456 728 720 720
query55 124 103 108 103
query56 338 298 285 285
query57 1065 1019 1041 1019
query58 359 340 341 340
query59 3378 3162 3053 3053
query60 362 328 333 328
query61 149 169 153 153
query62 613 487 508 487
query63 231 189 196 189
query64 6063 1828 1724 1724
query65 3484 3423 3401 3401
query66 1499 415 402 402
query67 15859 15442 15757 15442
query68 13043 566 559 559
query69 620 373 372 372
query70 1857 1757 1766 1757
query71 620 303 308 303
query72 5315 3509 3510 3509
query73 2872 347 337 337
query74 7059 6622 6676 6622
query75 5324 2310 2323 2310
query76 6479 1051 1231 1051
query77 785 377 371 371
query78 9100 8923 8653 8653
query79 2133 538 548 538
query80 579 385 374 374
query81 476 214 222 214
query82 238 132 129 129
query83 198 149 145 145
query84 260 58 63 58
query85 937 286 284 284
query86 444 459 456 456
query87 3675 3553 3485 3485
query88 3544 2583 2557 2557
query89 383 324 309 309
query90 2145 274 275 274
query91 131 95 98 95
query92 113 91 89 89
query93 1447 436 487 436
query94 937 269 265 265
query95 579 536 524 524
query96 667 335 369 335
query97 4383 4274 4201 4201
query98 255 220 213 213
query99 1188 905 884 884
Total cold run time: 303974 ms
Total hot run time: 186985 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882752065
<details>
<summary>TPC-DS: <b>Total hot run time: 189584 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b7114bbaa9df0b3feffac876697de6ecd8e8b9cb, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 938 344 336 336
query2 6904 2069 2077 2069
query3 6731 230 222 222
query4 25210 22590 22502 22502
query5 5597 575 592 575
query6 357 219 213 213
query7 4585 321 323 321
query8 277 261 237 237
query9 9607 3295 3272 3272
query10 521 384 307 307
query11 16217 15509 15498 15498
query12 181 119 126 119
query13 1568 339 340 339
query14 12239 7968 7930 7930
query15 353 294 259 259
query16 6400 348 312 312
query17 1695 556 574 556
query18 1985 324 316 316
query19 230 179 192 179
query20 133 128 118 118
query21 197 100 94 94
query22 4733 4580 4482 4482
query23 32531 31518 31510 31510
query24 12909 3562 3558 3558
query25 654 413 400 400
query26 1550 197 196 196
query27 2754 321 326 321
query28 6624 2163 2156 2156
query29 1756 443 451 443
query30 316 154 148 148
query31 1145 889 884 884
query32 156 101 88 88
query33 806 372 351 351
query34 935 503 476 476
query35 1080 879 845 845
query36 1515 1354 1339 1339
query37 216 117 104 104
query38 3534 3446 3361 3361
query39 1380 1314 1322 1314
query40 314 101 95 95
query41 40 36 35 35
query42 124 113 115 113
query43 606 548 571 548
query44 1230 821 840 821
query45 274 258 261 258
query46 1296 863 819 819
query47 1753 1675 1702 1675
query48 395 308 303 303
query49 1231 325 326 325
query50 1227 956 976 956
query51 5500 5340 5406 5340
query52 114 116 105 105
query53 228 215 208 208
query54 1406 720 783 720
query55 109 100 103 100
query56 289 311 301 301
query57 1117 1063 1017 1017
query58 359 327 352 327
query59 3352 3183 3159 3159
query60 408 323 319 319
query61 134 155 148 148
query62 1358 531 554 531
query63 229 223 211 211
query64 5971 1745 1708 1708
query65 3466 3407 3379 3379
query66 1133 406 380 380
query67 15689 15364 15268 15268
query68 11992 571 576 571
query69 642 380 365 365
query70 1831 1760 1763 1760
query71 637 300 321 300
query72 6139 4173 4191 4173
query73 2317 351 336 336
query74 7098 6622 6613 6613
query75 5222 2338 2274 2274
query76 6461 1332 1278 1278
query77 782 394 379 379
query78 9119 8860 8619 8619
query79 1315 580 560 560
query80 701 402 372 372
query81 495 223 226 223
query82 217 127 129 127
query83 202 144 145 144
query84 253 61 57 57
query85 890 292 286 286
query86 444 469 462 462
query87 3739 3502 3495 3495
query88 3811 2560 2524 2524
query89 413 391 350 350
query90 1804 280 272 272
query91 132 99 104 99
query92 105 102 90 90
query93 2594 431 476 431
query94 808 274 268 268
query95 568 529 525 525
query96 705 345 336 336
query97 4393 4217 4207 4207
query98 254 225 217 217
query99 1636 952 964 952
Total cold run time: 303590 ms
Total hot run time: 189584 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883404936
<details>
<summary>ClickBench: <b>Total hot run time: 30.17 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 27c3387788ad3a3143305aa5f51845839fd07584, data reload: false
query1 0.08 0.04 0.04
query2 0.06 0.03 0.03
query3 0.23 0.10 0.09
query4 1.72 0.10 0.08
query5 0.51 0.51 0.52
query6 1.37 0.62 0.63
query7 0.02 0.02 0.01
query8 0.04 0.02 0.02
query9 0.53 0.48 0.48
query10 0.53 0.53 0.55
query11 0.13 0.10 0.09
query12 0.12 0.09 0.09
query13 0.61 0.59 0.60
query14 0.77 0.79 0.78
query15 0.83 0.79 0.79
query16 0.34 0.34 0.34
query17 0.97 0.97 0.97
query18 0.23 0.25 0.25
query19 1.89 1.69 1.70
query20 0.01 0.01 0.01
query21 15.40 0.57 0.55
query22 2.73 2.53 1.69
query23 17.41 0.77 0.72
query24 5.90 1.11 0.72
query25 1.97 0.14 0.14
query26 0.13 0.13 0.14
query27 0.16 0.14 0.15
query28 9.80 0.79 0.77
query29 12.54 3.16 3.17
query30 0.52 0.49 0.49
query31 2.78 0.35 0.37
query32 3.36 0.49 0.49
query33 3.18 3.23 3.23
query34 15.81 4.16 4.14
query35 4.13 4.19 4.16
query36 1.10 1.03 1.03
query37 0.07 0.05 0.05
query38 0.04 0.03 0.02
query39 0.02 0.01 0.01
query40 0.16 0.14 0.13
query41 0.07 0.01 0.02
query42 0.02 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 108.32 s
Total hot run time: 30.17 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883086723
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882573932
run performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882620789
<details>
<summary>TPC-H: <b>Total hot run time: 39394 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c7456c220340d7fbad903a33f7453f621e78a1f, data reload: false
------ Round 1 ----------------------------------
q1 18289 5539 5527 5527
q2 2047 153 142 142
q3 10647 1140 1141 1140
q4 10229 828 802 802
q5 7821 2965 2926 2926
q6 204 136 131 131
q7 910 515 502 502
q8 9350 1995 1995 1995
q9 6577 6408 6397 6397
q10 8254 3073 2989 2989
q11 434 222 233 222
q12 392 228 231 228
q13 18266 3472 3451 3451
q14 242 213 207 207
q15 557 523 506 506
q16 458 402 409 402
q17 924 715 612 612
q18 7360 6686 6669 6669
q19 1554 1517 1515 1515
q20 755 317 309 309
q21 2771 2455 2398 2398
q22 370 324 329 324
Total cold run time: 108411 ms
Total hot run time: 39394 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5548 5497 5496 5496
q2 355 262 248 248
q3 3376 3297 3316 3297
q4 2120 2087 2053 2053
q5 5853 5800 5850 5800
q6 206 122 125 122
q7 2305 1918 1914 1914
q8 3401 3554 3505 3505
q9 8945 8866 8879 8866
q10 3836 3867 3871 3867
q11 609 519 511 511
q12 799 610 626 610
q13 6640 3247 3274 3247
q14 291 284 287 284
q15 547 520 506 506
q16 538 504 507 504
q17 2373 2375 2363 2363
q18 8741 8563 8550 8550
q19 1619 1604 1609 1604
q20 2218 1980 1948 1948
q21 5642 5390 5435 5390
q22 611 551 522 522
Total cold run time: 66573 ms
Total hot run time: 61207 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883397190
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.82 seconds
stream load tsv: 575 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
storage size: 17184206379 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882723095
<details>
<summary>TPC-DS: <b>Total hot run time: 182867 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b82c8d37c46a746dae07eb2c6f2918aec8a1e012, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 574 343 342 342
query2 2233 2111 2147 2111
query3 450 217 223 217
query4 23213 22610 22307 22307
query5 907 587 589 587
query6 234 199 189 189
query7 469 291 295 291
query8 242 216 215 215
query9 3158 2979 2783 2783
query10 637 352 357 352
query11 15620 15671 15609 15609
query12 143 108 94 94
query13 492 335 341 335
query14 7997 7623 7550 7550
query15 247 221 205 205
query16 584 328 323 323
query17 693 508 514 508
query18 409 298 301 298
query19 201 152 169 152
query20 110 107 111 107
query21 120 99 96 96
query22 5037 4733 4953 4733
query23 31562 31278 31062 31062
query24 3359 2953 2991 2953
query25 486 381 369 369
query26 599 168 178 168
query27 484 312 322 312
query28 2328 2187 2151 2151
query29 676 407 425 407
query30 216 139 149 139
query31 929 822 792 792
query32 95 73 80 73
query33 407 356 311 311
query34 799 462 494 462
query35 957 900 863 863
query36 1339 1220 1238 1220
query37 115 96 82 82
query38 3549 3365 3344 3344
query39 1340 1278 1294 1278
query40 120 92 87 87
query41 39 39 36 36
query42 109 106 105 105
query43 547 523 524 523
query44 1126 796 805 796
query45 227 207 202 202
query46 1069 701 665 665
query47 1772 1629 1660 1629
query48 387 293 281 281
query49 588 313 336 313
query50 735 313 333 313
query51 5455 5282 5331 5282
query52 110 100 97 97
query53 234 166 171 166
query54 1010 628 672 628
query55 106 97 94 94
query56 286 286 248 248
query57 1026 966 976 966
query58 303 256 266 256
query59 3015 2929 2767 2767
query60 346 303 312 303
query61 151 137 155 137
query62 552 468 465 465
query63 195 192 185 185
query64 2547 1712 1669 1669
query65 3445 3331 3365 3331
query66 535 389 392 389
query67 15676 14755 15326 14755
query68 19322 535 547 535
query69 659 327 320 320
query70 1708 1500 1539 1500
query71 632 303 297 297
query72 6354 3504 3490 3490
query73 5142 359 344 344
query74 6993 6582 6586 6582
query75 6941 2246 2222 2222
query76 8873 1190 1129 1129
query77 734 332 336 332
query78 9021 8562 8626 8562
query79 4118 527 515 515
query80 631 332 356 332
query81 412 213 213 213
query82 194 111 103 103
query83 215 146 139 139
query84 259 57 58 57
query85 789 279 267 267
query86 422 435 435 435
query87 3696 3463 3462 3462
query88 2939 2506 2521 2506
query89 397 275 308 275
query90 1735 265 233 233
query91 123 94 95 94
query92 81 67 78 67
query93 1975 488 481 481
query94 738 246 248 246
query95 559 503 487 487
query96 650 339 341 339
query97 4323 4198 4200 4198
query98 238 217 203 203
query99 1007 824 891 824
Total cold run time: 246601 ms
Total hot run time: 182867 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883273223
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1884069221
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883137696
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882761930
<details>
<summary>ClickBench: <b>Total hot run time: 31.53 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b7114bbaa9df0b3feffac876697de6ecd8e8b9cb, data reload: false
query1 0.08 0.07 0.07
query2 0.07 0.03 0.03
query3 0.31 0.21 0.21
query4 1.74 0.19 0.19
query5 0.52 0.53 0.52
query6 1.58 0.68 0.69
query7 0.01 0.01 0.01
query8 0.03 0.03 0.03
query9 0.60 0.56 0.56
query10 0.62 0.61 0.61
query11 0.18 0.12 0.11
query12 0.16 0.12 0.12
query13 0.61 0.61 0.60
query14 0.78 0.79 0.76
query15 0.80 0.79 0.80
query16 0.35 0.35 0.35
query17 1.00 0.98 0.98
query18 0.24 0.26 0.25
query19 1.83 1.75 1.86
query20 0.01 0.01 0.01
query21 15.40 0.56 0.55
query22 2.45 3.70 1.36
query23 17.55 1.07 0.97
query24 10.07 0.80 0.34
query25 1.80 0.15 0.16
query26 0.16 0.17 0.16
query27 0.17 0.18 0.17
query28 5.67 0.87 0.86
query29 13.03 3.38 3.43
query30 0.56 0.55 0.51
query31 2.92 0.37 0.39
query32 3.32 0.49 0.48
query33 3.21 3.19 3.26
query34 16.80 4.52 4.49
query35 4.52 4.63 4.58
query36 1.15 1.09 1.08
query37 0.07 0.05 0.05
query38 0.04 0.02 0.02
query39 0.02 0.01 0.01
query40 0.15 0.14 0.14
query41 0.07 0.02 0.01
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 110.69 s
Total hot run time: 31.53 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1882758108
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.03 seconds
stream load tsv: 567 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 27.9 seconds inserted 10000000 Rows, about 358K ops/s
storage size: 17183534459 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly merged PR #29622:
URL: https://github.com/apache/doris/pull/29622
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) adjust performance pipeline [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29622:
URL: https://github.com/apache/doris/pull/29622#issuecomment-1883208975
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.87 seconds
stream load tsv: 579 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
storage size: 17184032103 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org