You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HHoflittlefish777 (via GitHub)" <gi...@apache.org> on 2023/11/26 02:16:38 UTC
[PR] [improve](routine_load) move log from write lock [doris]
HHoflittlefish777 opened a new pull request, #27576:
URL: https://github.com/apache/doris/pull/27576
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](routine_load) move log from write lock [doris]
Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #27576:
URL: https://github.com/apache/doris/pull/27576#issuecomment-1826469785
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](routine_load) move log from write lock [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #27576:
URL: https://github.com/apache/doris/pull/27576
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](routine_load) move log from write lock [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27576:
URL: https://github.com/apache/doris/pull/27576#issuecomment-1826747605
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](routine_load) move log from write lock [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27576:
URL: https://github.com/apache/doris/pull/27576#issuecomment-1826500187
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.43 seconds
stream load tsv: 566 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 27 seconds loaded 2358488459 Bytes, about 83 MB/s
stream load orc: 71 seconds loaded 1101869774 Bytes, about 14 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17096147223 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](routine_load) move log from write lock [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27576:
URL: https://github.com/apache/doris/pull/27576#issuecomment-1826484915
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 5da5d4234b7d830aa46277eb48eb4cbf775bfb27, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4918 4681 4662 4662
q2 353 162 158 158
q3 2040 1956 1962 1956
q4 1381 1226 1259 1226
q5 3980 3986 4049 3986
q6 255 134 131 131
q7 1425 898 898 898
q8 2792 2808 2796 2796
q9 9584 9567 10146 9567
q10 3435 3532 3502 3502
q11 383 256 251 251
q12 435 286 292 286
q13 4550 3820 3812 3812
q14 324 287 295 287
q15 594 531 531 531
q16 668 587 574 574
q17 1155 1007 944 944
q18 7634 7335 7422 7335
q19 1682 1700 1692 1692
q20 571 309 295 295
q21 4363 3994 3953 3953
q22 476 377 370 370
Total cold run time: 52998 ms
Total hot run time: 49212 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4558 4611 4597 4597
q2 337 221 254 221
q3 3996 3987 3990 3987
q4 2702 2677 2678 2677
q5 9707 9733 9659 9659
q6 243 125 123 123
q7 3038 2464 2459 2459
q8 4473 4401 4456 4401
q9 12962 12822 12895 12822
q10 4061 4164 4186 4164
q11 769 628 658 628
q12 981 809 820 809
q13 4305 3599 3573 3573
q14 383 358 358 358
q15 582 535 520 520
q16 729 680 672 672
q17 3968 3835 3877 3835
q18 9497 9055 8892 8892
q19 1847 1795 1823 1795
q20 2398 2038 2029 2029
q21 8786 8546 8638 8546
q22 933 811 787 787
Total cold run time: 81255 ms
Total hot run time: 77554 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](routine_load) move log from write lock [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27576:
URL: https://github.com/apache/doris/pull/27576#issuecomment-1826747599
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org