You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Gabriel39 (via GitHub)" <gi...@apache.org> on 2024/01/12 02:18:05 UTC
[PR] [pipelineX](test) enable pipelineX by default [doris]
Gabriel39 opened a new pull request, #29894:
URL: https://github.com/apache/doris/pull/29894
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1893036116
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 1181dacf8eac2b744df6e55be7d19ff244c7a1b4 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.5 seconds inserted 10000000 Rows, about 740K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1890843035
<details>
<summary>TPC-H: <b>Total hot run time: 40029 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 476f019a27e3680d2293dc6d87de538687a6d8ef, data reload: false
------ Round 1 ----------------------------------
q1 17978 5595 5197 5197
q2 2050 151 139 139
q3 10652 1153 1215 1153
q4 10253 790 825 790
q5 7835 3282 3268 3268
q6 206 125 130 125
q7 986 583 564 564
q8 9428 1984 2077 1984
q9 7554 6644 6654 6644
q10 8887 3737 3750 3737
q11 451 231 221 221
q12 365 198 200 198
q13 18100 3206 3186 3186
q14 253 221 215 215
q15 563 529 514 514
q16 439 384 375 375
q17 971 551 482 482
q18 7543 6845 6789 6789
q19 1652 1387 1455 1387
q20 531 300 302 300
q21 3011 2429 2624 2429
q22 408 332 340 332
Total cold run time: 110116 ms
Total hot run time: 40029 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5099 4993 5020 4993
q2 359 254 253 253
q3 3229 3084 3167 3084
q4 2148 2105 2017 2017
q5 5840 5848 5825 5825
q6 199 124 131 124
q7 2403 2042 1987 1987
q8 3683 3717 3850 3717
q9 9164 9110 9173 9110
q10 4622 4524 4506 4506
q11 600 469 463 463
q12 812 622 622 622
q13 17003 2935 2897 2897
q14 285 257 275 257
q15 558 518 514 514
q16 492 434 442 434
q17 2070 1935 1896 1896
q18 9440 9754 8769 8769
q19 17490 1602 1570 1570
q20 2286 1977 1955 1955
q21 15513 5831 6452 5831
q22 894 743 595 595
Total cold run time: 104189 ms
Total hot run time: 61419 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891260359
TeamCity be ut coverage result:
Function Coverage: 36.68% (8647/23576)
Line Coverage: 28.70% (70438/245437)
Region Coverage: 27.62% (36408/131813)
Branch Coverage: 24.34% (18625/76510)
Coverage Report: http://coverage.selectdb-in.cc/coverage/cb23f975a39a3322f4cbee7239e64cbf73e240cd_cb23f975a39a3322f4cbee7239e64cbf73e240cd/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1893012240
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](conf) enable pipelineX by default [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #29894:
URL: https://github.com/apache/doris/pull/29894
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1893031116
<details>
<summary>TPC-DS: <b>Total hot run time: 186686 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1181dacf8eac2b744df6e55be7d19ff244c7a1b4, data reload: false
query1 972 358 347 347
query2 6672 2152 2063 2063
query3 6734 216 209 209
query4 30135 22345 22290 22290
query5 6993 646 644 644
query6 282 212 205 205
query7 4636 311 293 293
query8 242 200 196 196
query9 9069 2765 2739 2739
query10 657 261 267 261
query11 16333 15181 15214 15181
query12 149 91 86 86
query13 1710 382 403 382
query14 11956 8150 8382 8150
query15 243 198 216 198
query16 4639 284 266 266
query17 956 536 524 524
query18 1815 303 291 291
query19 193 163 166 163
query20 94 96 87 87
query21 202 134 131 131
query22 4777 4583 4619 4583
query23 33466 32349 32262 32262
query24 12775 2915 2921 2915
query25 617 371 385 371
query26 1880 161 166 161
query27 3494 337 331 331
query28 7172 1846 1851 1846
query29 2325 674 696 674
query30 309 155 149 149
query31 992 785 779 779
query32 101 67 69 67
query33 753 280 286 280
query34 1228 504 498 498
query35 944 827 815 815
query36 1295 1191 1153 1153
query37 204 75 77 75
query38 3598 3438 3422 3422
query39 1476 1409 1431 1409
query40 349 122 111 111
query41 50 43 43 43
query42 107 106 105 105
query43 533 479 498 479
query44 1118 748 738 738
query45 224 200 204 200
query46 1170 696 716 696
query47 1716 1650 1645 1645
query48 443 332 333 332
query49 1270 368 365 365
query50 808 343 341 341
query51 7781 7559 7573 7559
query52 112 96 99 96
query53 394 312 305 305
query54 956 513 494 494
query55 94 94 93 93
query56 243 241 225 225
query57 1091 1023 1023 1023
query58 247 239 238 238
query59 3053 2770 2861 2770
query60 290 315 263 263
query61 110 99 98 98
query62 644 437 422 422
query63 343 299 313 299
query64 6204 1695 1677 1677
query65 3433 3317 3324 3317
query66 1462 346 327 327
query67 15838 14911 15088 14911
query68 11982 552 532 532
query69 683 386 371 371
query70 1578 1402 1341 1341
query71 624 283 274 274
query72 5101 2775 2714 2714
query73 2076 324 332 324
query74 7681 6714 6560 6560
query75 5611 2597 2535 2535
query76 6876 1077 1199 1077
query77 979 315 327 315
query78 10170 9628 9510 9510
query79 3911 552 546 546
query80 849 384 388 384
query81 480 226 228 226
query82 230 106 104 104
query83 189 145 155 145
query84 282 81 86 81
query85 1098 344 339 339
query86 493 376 392 376
query87 3781 3561 3599 3561
query88 3855 2235 2231 2231
query89 501 376 372 372
query90 2149 234 216 216
query91 164 141 133 133
query92 70 61 60 60
query93 3241 460 465 460
query94 1276 221 217 217
query95 551 484 491 484
query96 688 319 317 317
query97 4374 4229 4233 4229
query98 228 213 203 203
query99 1127 781 782 781
Total cold run time: 315069 ms
Total hot run time: 186686 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1888311572
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1890844979
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.56 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.9 seconds inserted 10000000 Rows, about 456K ops/s
storage size: 17183333697 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891260398
<details>
<summary>TPC-H: <b>Total hot run time: 39117 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cb23f975a39a3322f4cbee7239e64cbf73e240cd, data reload: false
------ Round 1 ----------------------------------
q1 7216 4942 5159 4942
q2 1628 150 142 142
q3 1487 1208 1186 1186
q4 6182 792 791 791
q5 7816 3269 3206 3206
q6 201 124 127 124
q7 972 593 570 570
q8 9439 2001 2068 2001
q9 7536 6688 6617 6617
q10 8344 3126 3068 3068
q11 423 235 216 216
q12 372 201 199 199
q13 18110 3177 3165 3165
q14 256 219 223 219
q15 559 520 512 512
q16 442 365 360 360
q17 953 541 497 497
q18 7793 7025 6766 6766
q19 2196 1368 1429 1368
q20 545 289 320 289
q21 3103 2561 2640 2561
q22 371 318 339 318
Total cold run time: 85944 ms
Total hot run time: 39117 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4997 4923 5054 4923
q2 364 226 230 226
q3 3249 3238 3202 3202
q4 2260 2093 2203 2093
q5 5843 5859 5854 5854
q6 212 124 130 124
q7 2432 1993 1987 1987
q8 3704 3727 3798 3727
q9 9200 9111 9170 9111
q10 4009 3925 3905 3905
q11 593 464 465 464
q12 831 658 664 658
q13 17022 2926 2904 2904
q14 300 258 258 258
q15 546 499 507 499
q16 478 410 423 410
q17 2021 1839 1894 1839
q18 9377 10085 9124 9124
q19 9793 1569 1516 1516
q20 2300 1992 1944 1944
q21 17341 5876 5840 5840
q22 924 700 593 593
Total cold run time: 97796 ms
Total hot run time: 61201 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891267552
<details>
<summary>TPC-DS: <b>Total hot run time: 187850 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cb23f975a39a3322f4cbee7239e64cbf73e240cd, data reload: false
query1 978 353 346 346
query2 6681 2105 2106 2105
query3 6713 214 211 211
query4 29666 22360 22354 22354
query5 6968 587 633 587
query6 279 208 198 198
query7 4644 292 288 288
query8 236 192 193 192
query9 9121 2743 2952 2743
query10 443 266 260 260
query11 16527 15309 15347 15309
query12 151 86 85 85
query13 1713 399 387 387
query14 11931 8157 8274 8157
query15 235 194 201 194
query16 4633 280 276 276
query17 951 540 537 537
query18 1816 294 297 294
query19 186 167 155 155
query20 105 84 86 84
query21 218 132 132 132
query22 4747 4637 4585 4585
query23 33345 32566 32474 32474
query24 11477 2874 2897 2874
query25 619 366 384 366
query26 1676 165 168 165
query27 3266 336 334 334
query28 6976 1892 1873 1873
query29 1724 674 693 674
query30 297 153 149 149
query31 1009 800 803 800
query32 99 66 66 66
query33 744 284 289 284
query34 1057 492 493 492
query35 922 859 781 781
query36 1204 1172 1142 1142
query37 113 87 76 76
query38 3553 3577 3467 3467
query39 1431 1408 1434 1408
query40 234 116 112 112
query41 49 42 42 42
query42 102 107 102 102
query43 517 479 472 472
query44 1150 743 728 728
query45 218 204 205 204
query46 1108 690 681 681
query47 1706 1651 1654 1651
query48 433 320 323 320
query49 1176 348 370 348
query50 734 333 342 333
query51 7811 7722 7541 7541
query52 113 95 112 95
query53 385 317 299 299
query54 955 505 506 505
query55 94 93 96 93
query56 271 226 234 226
query57 1070 1078 1024 1024
query58 251 233 235 233
query59 3164 2929 2965 2929
query60 304 272 252 252
query61 108 112 101 101
query62 640 432 431 431
query63 334 302 302 302
query64 5168 1713 1803 1713
query65 3450 3314 3335 3314
query66 1344 363 340 340
query67 15818 15486 15392 15392
query68 7814 540 528 528
query69 602 369 375 369
query70 1495 1433 1435 1433
query71 533 270 268 268
query72 4193 2789 2754 2754
query73 762 320 325 320
query74 7575 6729 6665 6665
query75 4090 2584 2650 2584
query76 5222 1034 1102 1034
query77 686 301 322 301
query78 10232 9586 9498 9498
query79 3542 531 533 531
query80 857 387 402 387
query81 510 225 224 224
query82 597 101 106 101
query83 207 150 145 145
query84 289 83 79 79
query85 1595 362 351 351
query86 431 391 376 376
query87 3760 3605 3557 3557
query88 4366 2277 2247 2247
query89 483 370 368 368
query90 1946 237 214 214
query91 170 142 139 139
query92 69 64 59 59
query93 4432 415 442 415
query94 1162 207 212 207
query95 526 503 492 492
query96 646 325 328 325
query97 4331 4209 4245 4209
query98 233 216 206 206
query99 1087 778 777 777
Total cold run time: 301604 ms
Total hot run time: 187850 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891249291
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970599210
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1888383554
<details>
<summary>TPC-H: <b>Total hot run time: 39996 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 476f019a27e3680d2293dc6d87de538687a6d8ef, data reload: false
------ Round 1 ----------------------------------
q1 17922 5032 4958 4958
q2 2050 153 142 142
q3 11231 1179 1158 1158
q4 10561 870 825 825
q5 8336 3314 3281 3281
q6 205 144 138 138
q7 986 592 589 589
q8 9775 2080 2094 2080
q9 8124 6738 6702 6702
q10 8861 3740 3700 3700
q11 432 223 222 222
q12 373 202 201 201
q13 18142 3210 3189 3189
q14 256 224 215 215
q15 565 534 523 523
q16 460 379 381 379
q17 950 575 516 516
q18 7388 6791 6738 6738
q19 1590 1337 1456 1337
q20 555 306 291 291
q21 2909 2500 2559 2500
q22 368 312 313 312
Total cold run time: 112039 ms
Total hot run time: 39996 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4934 4976 4898 4898
q2 329 208 209 208
q3 3311 3303 3310 3303
q4 2252 2274 2271 2271
q5 5830 5834 5830 5830
q6 199 120 125 120
q7 2450 1962 1976 1962
q8 3654 3639 3691 3639
q9 9281 9215 9206 9206
q10 4516 4557 4537 4537
q11 584 449 450 449
q12 782 611 603 603
q13 3848 2997 2998 2997
q14 290 268 276 268
q15 566 520 512 512
q16 488 426 416 416
q17 2045 1919 1835 1835
q18 8826 8359 8325 8325
q19 1619 1589 1553 1553
q20 2242 1927 1969 1927
q21 6072 5839 5794 5794
q22 635 457 465 457
Total cold run time: 64753 ms
Total hot run time: 61110 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1890464812
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891165566
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1888360598
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.09 seconds
stream load tsv: 557 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.7 seconds inserted 10000000 Rows, about 460K ops/s
storage size: 17183646903 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891199615
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.73 seconds
stream load tsv: 559 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
storage size: 17183717495 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1893034250
<details>
<summary>ClickBench: <b>Total hot run time: 31.55 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1181dacf8eac2b744df6e55be7d19ff244c7a1b4, data reload: false
query1 0.05 0.06 0.05
query2 0.06 0.02 0.02
query3 0.24 0.12 0.10
query4 1.77 0.12 0.11
query5 0.53 0.53 0.53
query6 1.26 0.62 0.62
query7 0.02 0.02 0.01
query8 0.04 0.02 0.03
query9 0.56 0.50 0.50
query10 0.56 0.56 0.55
query11 0.13 0.09 0.09
query12 0.12 0.10 0.09
query13 0.61 0.62 0.62
query14 0.79 0.78 0.80
query15 0.81 0.79 0.78
query16 0.36 0.41 0.37
query17 1.02 0.92 1.04
query18 0.21 0.26 0.23
query19 1.89 1.76 1.81
query20 0.02 0.01 0.01
query21 15.41 0.59 0.55
query22 3.08 2.32 1.87
query23 17.51 0.79 0.77
query24 2.50 1.61 1.10
query25 0.38 0.20 0.18
query26 0.52 0.16 0.15
query27 0.05 0.06 0.06
query28 11.21 0.84 0.82
query29 12.59 3.21 3.16
query30 0.62 0.53 0.56
query31 2.79 0.35 0.35
query32 3.39 0.50 0.49
query33 3.36 3.29 3.30
query34 16.11 4.48 4.36
query35 4.44 4.36 4.39
query36 1.11 1.08 1.07
query37 0.07 0.06 0.05
query38 0.04 0.03 0.03
query39 0.03 0.02 0.02
query40 0.17 0.14 0.13
query41 0.07 0.02 0.01
query42 0.02 0.02 0.02
query43 0.03 0.03 0.02
Total cold run time: 106.55 s
Total hot run time: 31.55 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970318324
<details>
<summary>TPC-H: <b>Total hot run time: 37508 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 16b0d2c909ca677d98ac11f62a50c952e4b5b8fe, data reload: false
------ Round 1 ----------------------------------
q1 17669 4035 4012 4012
q2 2046 150 143 143
q3 10559 931 929 929
q4 4662 916 930 916
q5 7609 2811 2989 2811
q6 178 121 121 121
q7 1292 816 809 809
q8 9493 2257 2067 2067
q9 7289 6456 6438 6438
q10 8201 2549 2531 2531
q11 424 217 209 209
q12 828 318 299 299
q13 17977 2886 2955 2886
q14 276 261 253 253
q15 479 444 430 430
q16 457 385 386 385
q17 935 866 820 820
q18 6549 5777 5857 5777
q19 1570 1514 1517 1514
q20 552 276 272 272
q21 7468 3588 3673 3588
q22 788 314 298 298
Total cold run time: 107301 ms
Total hot run time: 37508 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4011 4005 3989 3989
q2 314 213 219 213
q3 2913 2906 2890 2890
q4 1817 1762 1747 1747
q5 5209 5218 5187 5187
q6 201 116 115 115
q7 2212 1842 1848 1842
q8 3174 3263 3257 3257
q9 8487 8480 8466 8466
q10 6170 3752 3709 3709
q11 543 448 442 442
q12 675 535 544 535
q13 13738 2773 2797 2773
q14 283 250 248 248
q15 465 452 430 430
q16 475 403 412 403
q17 1693 1640 1618 1618
q18 7991 7411 7304 7304
q19 1636 1592 1598 1592
q20 1920 1747 1746 1746
q21 4784 4751 4790 4751
q22 506 430 466 430
Total cold run time: 69217 ms
Total hot run time: 53687 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](conf) enable pipelineX by default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970613378
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891271427
<details>
<summary>ClickBench: <b>Total hot run time: 31.2 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cb23f975a39a3322f4cbee7239e64cbf73e240cd, data reload: false
query1 0.06 0.05 0.06
query2 0.06 0.02 0.03
query3 0.24 0.12 0.11
query4 1.76 0.11 0.11
query5 0.55 0.54 0.53
query6 1.28 0.62 0.63
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.57 0.50 0.51
query10 0.57 0.55 0.56
query11 0.12 0.09 0.09
query12 0.12 0.10 0.09
query13 0.61 0.61 0.60
query14 0.77 0.82 0.78
query15 0.80 0.80 0.79
query16 0.40 0.40 0.40
query17 0.96 1.05 0.99
query18 0.23 0.25 0.26
query19 1.80 1.68 1.69
query20 0.02 0.01 0.01
query21 15.40 0.55 0.55
query22 2.10 2.83 2.18
query23 17.17 0.77 0.71
query24 2.91 1.63 0.38
query25 1.97 0.15 0.15
query26 0.15 0.14 0.14
query27 0.16 0.15 0.15
query28 10.65 0.78 0.78
query29 12.56 3.15 3.13
query30 0.62 0.60 0.58
query31 2.81 0.36 0.36
query32 3.38 0.49 0.49
query33 3.34 3.31 3.32
query34 16.07 4.38 4.37
query35 4.40 4.40 4.35
query36 1.12 1.07 1.08
query37 0.07 0.06 0.06
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.16 0.13 0.13
query41 0.07 0.02 0.02
query42 0.03 0.02 0.02
query43 0.03 0.02 0.02
Total cold run time: 106.21 s
Total hot run time: 31.2 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1893023873
<details>
<summary>TPC-H: <b>Total hot run time: 39364 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1181dacf8eac2b744df6e55be7d19ff244c7a1b4, data reload: false
------ Round 1 ----------------------------------
q1 17902 5417 5126 5126
q2 2062 153 147 147
q3 10648 1140 1200 1140
q4 11182 807 804 804
q5 8127 3293 3273 3273
q6 209 127 127 127
q7 996 598 591 591
q8 9608 2055 2092 2055
q9 7701 6752 6597 6597
q10 8229 3147 3173 3147
q11 422 223 215 215
q12 372 208 200 200
q13 18113 3187 3203 3187
q14 250 225 218 218
q15 551 516 507 507
q16 430 356 358 356
q17 946 523 523 523
q18 7498 6919 6717 6717
q19 1627 1299 1303 1299
q20 591 293 316 293
q21 3012 2522 2521 2521
q22 362 321 325 321
Total cold run time: 110838 ms
Total hot run time: 39364 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5061 4898 5005 4898
q2 372 233 227 227
q3 3244 3177 3197 3177
q4 2210 2184 2175 2175
q5 5812 5822 5823 5822
q6 204 121 131 121
q7 2395 2003 1938 1938
q8 3683 3729 3744 3729
q9 9160 9080 9075 9075
q10 3968 3871 3890 3871
q11 577 475 455 455
q12 798 632 637 632
q13 16713 2904 2864 2864
q14 280 268 269 268
q15 544 511 502 502
q16 461 424 439 424
q17 2032 1862 1774 1774
q18 9414 8860 8662 8662
q19 21056 1611 1569 1569
q20 2749 1969 1961 1961
q21 14891 5675 5931 5675
q22 874 770 587 587
Total cold run time: 106498 ms
Total hot run time: 60406 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891250550
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970603712
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1888348942
<details>
<summary>TPC-H: <b>Total hot run time: 39470 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 476f019a27e3680d2293dc6d87de538687a6d8ef, data reload: false
------ Round 1 ----------------------------------
q1 17979 4866 4982 4866
q2 2066 149 149 149
q3 10624 1138 1152 1138
q4 10240 786 868 786
q5 7785 3229 3201 3201
q6 222 128 128 128
q7 974 577 559 559
q8 9418 2052 2051 2051
q9 7604 6686 6651 6651
q10 8869 3695 3674 3674
q11 420 251 212 212
q12 364 195 194 194
q13 18106 3197 3154 3154
q14 247 216 216 216
q15 561 510 510 510
q16 449 381 383 381
q17 945 565 525 525
q18 7315 6605 6610 6605
q19 1588 1326 1516 1326
q20 524 299 315 299
q21 2913 2535 2556 2535
q22 363 321 310 310
Total cold run time: 109576 ms
Total hot run time: 39470 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4902 4862 4988 4862
q2 329 205 210 205
q3 3316 3301 3283 3283
q4 2281 2249 2256 2249
q5 5815 5840 5808 5808
q6 197 121 124 121
q7 2412 1990 1966 1966
q8 3577 3614 3625 3614
q9 9207 9151 9152 9151
q10 4461 4516 4522 4516
q11 574 451 451 451
q12 780 597 598 597
q13 4595 2977 2931 2931
q14 297 263 271 263
q15 569 506 525 506
q16 482 426 425 425
q17 2048 1926 1925 1925
q18 8740 8388 8281 8281
q19 1631 1568 1560 1560
q20 2241 1963 1984 1963
q21 6028 5762 5685 5685
q22 561 436 443 436
Total cold run time: 65043 ms
Total hot run time: 60798 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](conf) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970627937
<details>
<summary>TPC-H: <b>Total hot run time: 38155 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a750c9c07e95005045a4f242c59f33c1ed097f4a, data reload: false
------ Round 1 ----------------------------------
q1 17917 4170 4134 4134
q2 3075 152 153 152
q3 11343 977 965 965
q4 5145 994 973 973
q5 7984 2867 3025 2867
q6 180 121 121 121
q7 1307 823 819 819
q8 9492 2075 2080 2075
q9 7687 6605 6485 6485
q10 8230 2594 2585 2585
q11 425 238 218 218
q12 787 311 310 310
q13 17989 3023 2950 2950
q14 278 252 257 252
q15 476 439 436 436
q16 460 392 390 390
q17 946 865 878 865
q18 6548 6014 5853 5853
q19 1586 1503 1529 1503
q20 558 278 277 277
q21 7518 3634 3664 3634
q22 792 329 291 291
Total cold run time: 110723 ms
Total hot run time: 38155 ms
----- Round 2, with runtime_filter_mode=off -----
q1 3994 3983 3966 3966
q2 316 229 229 229
q3 2967 2948 2890 2890
q4 1853 1813 1794 1794
q5 5228 5263 5242 5242
q6 198 114 115 114
q7 2251 1832 1808 1808
q8 3193 3251 3277 3251
q9 8499 8522 8496 8496
q10 6230 3734 3697 3697
q11 524 430 447 430
q12 685 545 541 541
q13 5186 2800 2848 2800
q14 274 246 257 246
q15 469 428 431 428
q16 446 403 418 403
q17 1690 1650 1672 1650
q18 7840 7430 7388 7388
q19 1669 1617 1618 1617
q20 1953 1697 1716 1697
q21 4921 4678 4778 4678
q22 537 466 473 466
Total cold run time: 60923 ms
Total hot run time: 53831 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970603751
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](conf) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970647316
TeamCity be ut coverage result:
Function Coverage: 35.68% (8550/23964)
Line Coverage: 27.48% (69378/252460)
Region Coverage: 26.64% (35983/135086)
Branch Coverage: 23.44% (18384/78438)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a750c9c07e95005045a4f242c59f33c1ed097f4a_a750c9c07e95005045a4f242c59f33c1ed097f4a/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891245918
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891273398
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit cb23f975a39a3322f4cbee7239e64cbf73e240cd with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 15.0 seconds inserted 10000000 Rows, about 666K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1970294770
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1888367937
run performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891189356
<details>
<summary>TPC-H: <b>Total hot run time: 39636 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 476f019a27e3680d2293dc6d87de538687a6d8ef, data reload: false
------ Round 1 ----------------------------------
q1 18035 5105 5092 5092
q2 2067 146 138 138
q3 10655 1102 1159 1102
q4 10250 765 801 765
q5 7830 3121 3176 3121
q6 209 125 123 123
q7 1018 580 557 557
q8 9415 1996 2050 1996
q9 7473 6643 6597 6597
q10 8811 3704 3707 3704
q11 431 219 215 215
q12 364 188 192 188
q13 18115 3189 3166 3166
q14 252 232 220 220
q15 559 518 520 518
q16 438 372 370 370
q17 949 552 541 541
q18 7715 6856 6745 6745
q19 2070 1397 1441 1397
q20 605 284 291 284
q21 2970 2516 2476 2476
q22 373 321 328 321
Total cold run time: 110604 ms
Total hot run time: 39636 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5014 5089 5130 5089
q2 372 243 225 225
q3 3212 3188 3169 3169
q4 2103 2012 2009 2009
q5 5829 5801 5779 5779
q6 200 122 127 122
q7 2400 1984 1982 1982
q8 3711 3732 3708 3708
q9 9158 9093 9101 9093
q10 4552 4453 4447 4447
q11 575 470 447 447
q12 783 608 664 608
q13 17206 2919 2919 2919
q14 273 254 265 254
q15 557 508 511 508
q16 476 445 429 429
q17 2115 1797 1762 1762
q18 9229 8829 8797 8797
q19 20209 1636 1615 1615
q20 2251 1996 2002 1996
q21 16138 5676 6311 5676
q22 1122 668 586 586
Total cold run time: 107485 ms
Total hot run time: 61220 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1891273873
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.92 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 21.5 seconds inserted 10000000 Rows, about 465K ops/s
storage size: 17183987855 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](test) enable pipelineX by default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29894:
URL: https://github.com/apache/doris/pull/29894#issuecomment-1890587300
<details>
<summary>TPC-H: <b>Total hot run time: 40072 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 476f019a27e3680d2293dc6d87de538687a6d8ef, data reload: false
------ Round 1 ----------------------------------
q1 17960 5176 5065 5065
q2 2074 153 144 144
q3 10643 1112 1132 1112
q4 10395 843 848 843
q5 7854 3197 3239 3197
q6 210 128 129 128
q7 1015 587 566 566
q8 9427 2110 2100 2100
q9 7544 6671 6692 6671
q10 8851 3756 3747 3747
q11 422 229 215 215
q12 368 192 198 192
q13 18113 3207 3149 3149
q14 260 213 218 213
q15 561 532 518 518
q16 443 372 372 372
q17 967 556 519 519
q18 7515 6869 6915 6869
q19 1705 1375 1420 1375
q20 538 303 296 296
q21 3035 2460 2578 2460
q22 375 321 339 321
Total cold run time: 110275 ms
Total hot run time: 40072 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5141 5105 5079 5079
q2 374 268 236 236
q3 3245 3222 3228 3222
q4 2156 1989 2036 1989
q5 5871 5854 5798 5798
q6 202 122 125 122
q7 2461 1973 1968 1968
q8 3755 3730 3777 3730
q9 9236 9183 9242 9183
q10 4624 4510 4503 4503
q11 598 477 483 477
q12 825 625 626 625
q13 17027 2954 2913 2913
q14 285 268 261 261
q15 566 509 521 509
q16 502 445 442 442
q17 2129 1892 1849 1849
q18 9170 8961 9599 8961
q19 12513 1633 1574 1574
q20 2346 1989 1977 1977
q21 15647 5801 6294 5801
q22 798 713 593 593
Total cold run time: 99471 ms
Total hot run time: 61812 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org