You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2024/01/02 05:06:15 UTC
[PR] [opt](config) create custom conf dir if not exists [doris]
morningman opened a new pull request, #29391:
URL: https://github.com/apache/doris/pull/29391
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1873699030
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit 3466993c85f7b1ec560a931e8e1d79001e357aa7, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 936 347 333 333
query2 6433 1859 1876 1859
query3 6648 207 198 198
query4 27112 22387 22271 22271
query5 4622 576 511 511
query6 268 179 184 179
query7 4586 272 263 263
query8 228 207 204 204
query9 8239 2705 2572 2572
query10 454 240 267 240
query11 16187 15462 15514 15462
query12 136 80 73 73
query13 1644 338 335 335
query14 11408 7061 7039 7039
query15 239 184 187 184
query16 6496 272 266 266
query17 1834 503 493 493
query18 1936 272 274 272
query19 268 143 136 136
query20 82 78 76 76
query21 186 93 94 93
query22 5192 4578 4941 4578
query23 31820 31167 31315 31167
query24 12171 2810 2828 2810
query25 585 348 346 346
query26 1693 140 144 140
query27 2931 274 289 274
query28 6964 1917 1937 1917
query29 2117 406 385 385
query30 289 144 148 144
query31 948 795 758 758
query32 88 59 64 59
query33 724 274 271 271
query34 860 437 447 437
query35 873 758 718 718
query36 1410 1248 1233 1233
query37 184 71 72 71
query38 3446 3325 3282 3282
query39 1311 1298 1289 1289
query40 297 95 89 89
query41 36 36 34 34
query42 97 90 90 90
query43 549 495 506 495
query44 1046 706 713 706
query45 193 194 188 188
query46 1052 626 634 626
query47 1652 1637 1622 1622
query48 344 271 256 256
query49 1199 322 319 319
query50 740 318 359 318
query51 5352 5238 5229 5229
query52 91 82 86 82
query53 219 152 152 152
query54 1377 581 564 564
query55 96 88 89 88
query56 209 195 198 195
query57 1018 964 980 964
query58 224 205 202 202
query59 2762 2557 2512 2512
query60 273 251 244 244
query61 88 110 86 86
query62 705 448 428 428
query63 163 148 146 146
query64 5939 1748 1707 1707
query65 3328 3248 3253 3248
query66 1362 345 321 321
query67 15834 15511 15100 15100
query68 12566 548 520 520
query69 543 245 256 245
query70 1693 1567 1547 1547
query71 497 233 224 224
query72 5608 3541 3551 3541
query73 2854 325 312 312
query74 7118 6547 6440 6440
query75 5303 2270 2272 2270
query76 6323 1148 1178 1148
query77 661 289 299 289
query78 9141 8837 8718 8718
query79 1537 513 509 509
query80 633 381 352 352
query81 462 206 207 206
query82 211 100 105 100
query83 163 138 138 138
query84 248 56 53 53
query85 934 281 295 281
query86 405 383 360 360
query87 3641 3447 3384 3384
query88 3372 2259 2260 2259
query89 347 256 266 256
query90 1892 189 189 189
query91 121 92 97 92
query92 58 53 51 51
query93 1794 513 494 494
query94 794 188 186 186
query95 451 418 403 403
query96 627 313 319 313
query97 4296 4194 4149 4149
query98 230 192 183 183
query99 1144 791 817 791
Total cold run time: 295460 ms
Total hot run time: 178952 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1876281818
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1873695942
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 3466993c85f7b1ec560a931e8e1d79001e357aa7, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5473 5137 5183 5137
q2 390 165 159 159
q3 1474 1153 1230 1153
q4 1088 860 875 860
q5 3066 3089 3137 3089
q6 228 143 129 129
q7 970 567 502 502
q8 2152 2278 2222 2222
q9 6706 6670 6634 6634
q10 3145 3121 3156 3121
q11 336 214 222 214
q12 384 231 232 231
q13 4389 3624 3598 3598
q14 249 212 220 212
q15 608 546 552 546
q16 445 392 421 392
q17 1042 490 576 490
q18 7147 6695 7591 6695
q19 1631 1565 1452 1452
q20 572 347 358 347
q21 2938 2486 2495 2486
q22 387 309 317 309
Total cold run time: 44820 ms
Total hot run time: 39978 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5124 5143 5093 5093
q2 341 247 232 232
q3 3374 3310 3304 3304
q4 2121 2002 1979 1979
q5 5930 5901 5916 5901
q6 225 125 122 122
q7 2399 1926 1911 1911
q8 3557 3641 3674 3641
q9 9043 8994 8968 8968
q10 3882 3887 3905 3887
q11 569 462 477 462
q12 809 656 654 654
q13 3897 3214 3172 3172
q14 299 275 284 275
q15 598 539 535 535
q16 530 491 507 491
q17 2054 1841 1802 1802
q18 8734 8483 8346 8346
q19 1734 1662 1679 1662
q20 2287 1974 1999 1974
q21 5726 5219 5197 5197
q22 558 484 486 484
Total cold run time: 63791 ms
Total hot run time: 60092 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1873691721
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 3466993c85f7b1ec560a931e8e1d79001e357aa7, data reload: false
------ Round 1 ----------------------------------
q1 17659 5054 5058 5054
q2 2036 156 142 142
q3 10548 1121 1095 1095
q4 10178 765 770 765
q5 7799 2912 2835 2835
q6 209 133 129 129
q7 916 531 509 509
q8 9270 2014 2001 2001
q9 6808 6402 6303 6303
q10 8229 3032 3025 3025
q11 438 221 216 216
q12 389 229 232 229
q13 17981 3598 3584 3584
q14 246 214 214 214
q15 584 536 515 515
q16 455 389 382 382
q17 947 453 487 453
q18 7277 6649 6633 6633
q19 1574 1341 1310 1310
q20 732 343 332 332
q21 2739 2352 2396 2352
q22 363 340 322 322
Total cold run time: 107377 ms
Total hot run time: 38400 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5093 5070 5096 5070
q2 355 249 246 246
q3 3321 3259 3242 3242
q4 2086 1982 1980 1980
q5 5781 5747 5722 5722
q6 210 122 121 121
q7 2311 1920 1911 1911
q8 3338 3412 3442 3412
q9 8734 8703 8670 8670
q10 3762 3821 3835 3821
q11 579 494 482 482
q12 777 639 628 628
q13 7096 3164 3188 3164
q14 298 262 286 262
q15 588 532 528 528
q16 532 517 493 493
q17 1891 1748 1752 1748
q18 8610 8390 8278 8278
q19 1613 1568 1581 1568
q20 2184 1978 1939 1939
q21 5618 5228 5356 5228
q22 546 496 504 496
Total cold run time: 65323 ms
Total hot run time: 59009 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #29391:
URL: https://github.com/apache/doris/pull/29391
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1873703940
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.64 seconds
stream load tsv: 575 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.2 seconds inserted 10000000 Rows, about 354K ops/s
storage size: 17184058512 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1873674993
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](config) create custom conf dir if not exists [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29391:
URL: https://github.com/apache/doris/pull/29391#issuecomment-1876281833
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org