You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2024/03/21 09:17:35 UTC
[PR] [opt](paimon) add split num and partition num #32597 [doris]
morningman opened a new pull request, #32621:
URL: https://github.com/apache/doris/pull/32621
bp #32597
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](paimon) add split num and partition num #32597 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32621:
URL: https://github.com/apache/doris/pull/32621#issuecomment-2011713137
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](paimon) add split num and partition num #32597 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32621:
URL: https://github.com/apache/doris/pull/32621#issuecomment-2011761103
<details>
<summary>TPC-H: <b>Total hot run time: 50347 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 19f0e9d4bb9abb9e269f4c834fafee7bf508a25a, data reload: false
------ Round 1 ----------------------------------
q1 17659 4359 4364 4359
q2 2060 150 143 143
q3 10347 1931 1946 1931
q4 10176 1345 1324 1324
q5 8452 4021 3950 3950
q6 221 121 126 121
q7 2024 1615 1617 1615
q8 9540 2733 2724 2724
q9 14345 10807 10685 10685
q10 8605 3526 3532 3526
q11 412 230 250 230
q12 463 295 300 295
q13 18362 3980 4036 3980
q14 355 325 325 325
q15 515 460 451 451
q16 701 595 593 593
q17 1131 929 899 899
q18 7290 6901 6933 6901
q19 1655 1564 1518 1518
q20 542 299 294 294
q21 4445 4083 4103 4083
q22 514 416 400 400
Total cold run time: 119814 ms
Total hot run time: 50347 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4360 4294 4328 4294
q2 316 230 218 218
q3 4222 4153 4206 4153
q4 2741 2765 2750 2750
q5 7340 7228 7259 7228
q6 235 117 118 117
q7 3206 2847 2885 2847
q8 4349 4481 4494 4481
q9 17576 17313 17075 17075
q10 4228 4256 4239 4239
q11 765 677 679 677
q12 1038 871 849 849
q13 7227 3738 3739 3738
q14 443 421 428 421
q15 498 458 452 452
q16 742 709 701 701
q17 3876 3850 3794 3794
q18 8788 8683 8915 8683
q19 1720 1658 1689 1658
q20 2424 2162 2134 2134
q21 8593 8608 8592 8592
q22 1034 972 1019 972
Total cold run time: 85721 ms
Total hot run time: 80073 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](paimon) add split num and partition num #32597 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32621:
URL: https://github.com/apache/doris/pull/32621#issuecomment-2011785740
<details>
<summary>TPC-DS: <b>Total hot run time: 201617 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 19f0e9d4bb9abb9e269f4c834fafee7bf508a25a, data reload: false
query1 914 387 375 375
query2 6547 2089 2100 2089
query3 6914 208 208 208
query4 20030 17941 17935 17935
query5 19725 6512 6518 6512
query6 294 217 227 217
query7 4147 296 298 296
query8 261 235 248 235
query9 3166 2752 2644 2644
query10 423 288 306 288
query11 11328 10739 10771 10739
query12 124 77 71 71
query13 5571 642 630 630
query14 17943 13381 13486 13381
query15 351 225 240 225
query16 6440 280 264 264
query17 1715 1452 867 867
query18 2326 401 399 399
query19 213 149 149 149
query20 80 78 77 77
query21 186 98 97 97
query22 5274 4953 4995 4953
query23 32351 31864 32088 31864
query24 6979 6528 6448 6448
query25 542 418 424 418
query26 523 158 155 155
query27 1887 291 287 287
query28 6149 2304 2265 2265
query29 2916 2838 2717 2717
query30 243 164 162 162
query31 900 735 758 735
query32 71 58 56 56
query33 390 238 248 238
query34 842 470 484 470
query35 1138 941 991 941
query36 1285 1209 1109 1109
query37 92 62 57 57
query38 3098 2893 2990 2893
query39 1388 1334 1319 1319
query40 200 95 93 93
query41 36 31 31 31
query42 85 79 89 79
query43 593 606 542 542
query44 1115 739 730 730
query45 235 224 239 224
query46 1255 973 975 973
query47 1812 2041 1684 1684
query48 990 668 674 668
query49 609 365 360 360
query50 868 665 647 647
query51 4748 4716 4752 4716
query52 86 78 76 76
query53 442 312 312 312
query54 2627 2479 2484 2479
query55 92 74 84 74
query56 218 209 199 199
query57 1188 1145 1103 1103
query58 211 196 198 196
query59 3585 3379 3089 3089
query60 213 195 200 195
query61 85 82 80 80
query62 795 462 479 462
query63 467 332 328 328
query64 2370 1514 1417 1417
query65 3668 3556 3579 3556
query66 747 371 363 363
query67 16036 15242 16682 15242
query68 8223 640 664 640
query69 546 339 344 339
query70 1588 1632 1385 1385
query71 385 305 304 304
query72 6437 3469 3406 3406
query73 731 322 336 322
query74 6293 5880 5895 5880
query75 4512 3717 3670 3670
query76 4677 1134 1200 1134
query77 590 250 245 245
query78 12805 11929 15284 11929
query79 10199 646 643 643
query80 2033 397 387 387
query81 513 227 229 227
query82 765 99 93 93
query83 184 137 127 127
query84 261 68 68 68
query85 1305 292 288 288
query86 353 290 310 290
query87 3229 3027 3032 3027
query88 4877 2356 2371 2356
query89 413 292 325 292
query90 1769 193 212 193
query91 147 119 115 115
query92 57 52 48 48
query93 4283 553 598 553
query94 842 206 208 206
query95 1108 1080 1054 1054
query96 641 337 339 337
query97 6585 6360 6527 6360
query98 192 165 163 163
query99 2675 931 833 833
Total cold run time: 309360 ms
Total hot run time: 201617 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](paimon) add split num and partition num #32597 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32621:
URL: https://github.com/apache/doris/pull/32621#issuecomment-2011792036
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 19f0e9d4bb9abb9e269f4c834fafee7bf508a25a with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.3 seconds inserted 10000000 Rows, about 448K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](paimon) add split num and partition num #32597 [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #32621:
URL: https://github.com/apache/doris/pull/32621#issuecomment-2011714473
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](paimon) add split num and partition num #32597 [doris]
Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #32621:
URL: https://github.com/apache/doris/pull/32621
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org