You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wsjz (via GitHub)" <gi...@apache.org> on 2024/02/05 07:10:19 UTC
[PR] [fix](multi-catalog)enable use self splitter default [doris]
wsjz opened a new pull request, #30846:
URL: https://github.com/apache/doris/pull/30846
## Proposed changes
remove use self splitter config
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928769051
<details>
<summary>ClickBench: <b>Total hot run time: 30 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a6387aee3538e6fea9819eafd963860cabd3ef59, data reload: false
query1 0.03 0.03 0.02
query2 0.06 0.02 0.02
query3 0.24 0.06 0.06
query4 1.67 0.10 0.10
query5 0.53 0.51 0.52
query6 1.20 0.64 0.68
query7 0.01 0.01 0.01
query8 0.04 0.03 0.03
query9 0.55 0.51 0.50
query10 0.56 0.55 0.54
query11 0.12 0.09 0.09
query12 0.11 0.09 0.09
query13 0.61 0.61 0.60
query14 0.78 0.79 0.80
query15 0.79 0.78 0.77
query16 0.36 0.38 0.39
query17 1.01 1.01 1.02
query18 0.21 0.30 0.25
query19 1.87 1.76 1.78
query20 0.01 0.01 0.01
query21 15.42 0.57 0.58
query22 2.54 2.41 1.36
query23 17.30 0.85 0.77
query24 2.36 1.77 0.46
query25 0.33 0.13 0.11
query26 0.68 0.13 0.14
query27 0.05 0.04 0.06
query28 12.35 0.83 0.84
query29 12.51 3.18 3.09
query30 0.69 0.56 0.53
query31 2.79 0.34 0.36
query32 3.37 0.49 0.47
query33 3.19 3.23 3.22
query34 15.83 4.35 4.32
query35 4.34 4.28 4.33
query36 1.11 1.05 1.06
query37 0.06 0.05 0.05
query38 0.04 0.02 0.04
query39 0.03 0.01 0.01
query40 0.16 0.13 0.13
query41 0.07 0.02 0.01
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 106.02 s
Total hot run time: 30 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1926550017
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1926352651
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1926549950
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928636115
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928765110
<details>
<summary>TPC-DS: <b>Total hot run time: 181067 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a6387aee3538e6fea9819eafd963860cabd3ef59, data reload: false
query1 926 337 341 337
query2 6537 1919 1875 1875
query3 6697 214 213 213
query4 31896 22100 22010 22010
query5 4214 358 349 349
query6 261 164 169 164
query7 4599 284 272 272
query8 238 167 177 167
query9 9126 2282 2276 2276
query10 419 212 212 212
query11 18126 15363 15328 15328
query12 133 74 73 73
query13 1624 415 413 413
query14 9694 6760 6821 6760
query15 234 178 178 178
query16 8092 258 243 243
query17 1866 537 497 497
query18 2108 266 259 259
query19 360 138 138 138
query20 79 82 80 80
query21 192 123 117 117
query22 4860 4665 4687 4665
query23 30919 30007 29953 29953
query24 10421 2727 2750 2727
query25 540 338 335 335
query26 812 144 146 144
query27 2298 300 297 297
query28 6862 1850 1820 1820
query29 899 621 624 621
query30 279 131 142 131
query31 917 670 691 670
query32 90 51 50 50
query33 718 218 215 215
query34 1133 442 457 442
query35 864 745 754 745
query36 980 891 909 891
query37 96 61 55 55
query38 3207 3136 3101 3101
query39 1298 1233 1247 1233
query40 182 97 94 94
query41 38 34 34 34
query42 91 90 86 86
query43 528 477 474 474
query44 1099 681 698 681
query45 192 180 171 171
query46 1049 659 638 638
query47 1576 1511 1503 1503
query48 423 356 335 335
query49 1090 293 280 280
query50 752 377 368 368
query51 5272 5152 5135 5135
query52 101 85 92 85
query53 328 263 263 263
query54 295 218 215 215
query55 78 77 74 74
query56 216 197 201 197
query57 973 909 916 909
query58 201 178 185 178
query59 2459 2307 2360 2307
query60 240 207 204 204
query61 83 83 83 83
query62 676 355 343 343
query63 309 266 272 266
query64 5041 3723 3449 3449
query65 3249 3238 3222 3222
query66 820 329 309 309
query67 14246 14123 14194 14123
query68 4474 535 540 535
query69 468 320 307 307
query70 1282 1167 1184 1167
query71 321 239 246 239
query72 5995 2855 2695 2695
query73 720 331 327 327
query74 6582 6260 6231 6231
query75 3000 2360 2321 2321
query76 2555 915 893 893
query77 349 223 219 219
query78 9145 8791 8460 8460
query79 2897 479 488 479
query80 2164 356 334 334
query81 544 195 197 195
query82 883 82 81 81
query83 242 121 127 121
query84 280 78 84 78
query85 2242 341 330 330
query86 481 311 285 285
query87 3368 3219 3214 3214
query88 4442 2338 2319 2319
query89 427 373 365 365
query90 2054 161 162 161
query91 172 145 125 125
query92 52 41 42 41
query93 4387 470 494 470
query94 1280 172 172 172
query95 7880 7658 7700 7658
query96 593 268 274 268
query97 4247 4092 4117 4092
query98 218 190 191 190
query99 1176 698 613 613
Total cold run time: 291141 ms
Total hot run time: 181067 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #30846:
URL: https://github.com/apache/doris/pull/30846
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928955971
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1926548555
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928736186
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928756865
<details>
<summary>TPC-H: <b>Total hot run time: 36651 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a6387aee3538e6fea9819eafd963860cabd3ef59, data reload: false
------ Round 1 ----------------------------------
q1 17643 4420 4367 4367
q2 2036 141 131 131
q3 10598 927 934 927
q4 4648 742 684 684
q5 7674 2759 2828 2759
q6 180 121 122 121
q7 1155 733 720 720
q8 9250 1976 1996 1976
q9 7237 6309 6334 6309
q10 8069 2470 2415 2415
q11 417 196 206 196
q12 739 279 286 279
q13 18011 3269 3307 3269
q14 284 256 251 251
q15 531 488 490 488
q16 496 398 398 398
q17 926 508 498 498
q18 6767 5985 5871 5871
q19 1561 1357 1389 1357
q20 579 351 317 317
q21 6778 3077 3029 3029
q22 800 310 289 289
Total cold run time: 106379 ms
Total hot run time: 36651 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4445 4341 4415 4341
q2 321 236 230 230
q3 2956 2874 2786 2786
q4 1836 1629 1667 1629
q5 5107 5201 5190 5190
q6 191 113 115 113
q7 2147 1748 1752 1748
q8 3078 3212 3189 3189
q9 8255 8291 8250 8250
q10 5761 3592 3572 3572
q11 553 455 453 453
q12 764 571 558 558
q13 12606 3060 3070 3060
q14 277 252 262 252
q15 534 481 491 481
q16 519 470 460 460
q17 1826 1690 1683 1683
q18 7905 7784 7496 7496
q19 10180 1500 1489 1489
q20 2121 1897 1913 1897
q21 4777 4471 4481 4471
q22 548 429 453 429
Total cold run time: 76707 ms
Total hot run time: 53777 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](multi-catalog)enable use self splitter default [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30846:
URL: https://github.com/apache/doris/pull/30846#issuecomment-1928771304
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit a6387aee3538e6fea9819eafd963860cabd3ef59 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 14.0 seconds inserted 10000000 Rows, about 714K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org