You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wangbo (via GitHub)" <gi...@apache.org> on 2023/11/16 08:19:43 UTC
[PR] [feature](stream-load)select coordinator node from user's tag when exec streaming load [doris]
wangbo opened a new pull request, #27106:
URL: https://github.com/apache/doris/pull/27106
## Proposed changes
select coordinator node from user's tag when exec streaming load
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](stream-load)select coordinator node from user's tag when exec streaming load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27106:
URL: https://github.com/apache/doris/pull/27106#issuecomment-1814101949
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.63 seconds
stream load tsv: 569 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17099229951 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](stream-load)select coordinator node from user's tag when exec streaming load [doris]
Posted by "wangbo (via GitHub)" <gi...@apache.org>.
wangbo commented on PR #27106:
URL: https://github.com/apache/doris/pull/27106#issuecomment-1813979841
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](stream-load)select coordinator node from user's tag when exec streaming load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27106:
URL: https://github.com/apache/doris/pull/27106#issuecomment-1813990000
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](stream-load)select coordinator node from user's tag when exec streaming load [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27106:
URL: https://github.com/apache/doris/pull/27106#issuecomment-1814168423
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit a37f2b35fcec09e1f16027abf542c36d1021ee07, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4899 4682 4688 4682
q2 366 151 160 151
q3 2050 1926 1942 1926
q4 1377 1242 1220 1220
q5 3961 3955 4030 3955
q6 253 130 132 130
q7 1375 871 884 871
q8 2751 2781 2759 2759
q9 10043 9569 9626 9569
q10 3483 3551 3522 3522
q11 369 252 251 251
q12 437 296 295 295
q13 4555 3829 3769 3769
q14 313 288 300 288
q15 571 541 532 532
q16 666 585 587 585
q17 1132 966 925 925
q18 7802 7476 7471 7471
q19 1689 1679 1673 1673
q20 539 324 305 305
q21 4377 3991 3986 3986
q22 474 372 366 366
Total cold run time: 53482 ms
Total hot run time: 49231 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4631 4556 4571 4556
q2 345 219 235 219
q3 4021 4023 4002 4002
q4 2699 2692 2685 2685
q5 9674 9646 9673 9646
q6 238 123 121 121
q7 2587 2262 2276 2262
q8 4427 4433 4470 4433
q9 13222 13009 13249 13009
q10 4088 4191 4197 4191
q11 808 709 641 641
q12 977 825 820 820
q13 4281 3560 3516 3516
q14 383 352 343 343
q15 579 526 520 520
q16 732 652 693 652
q17 3834 3847 3847 3847
q18 9635 9145 9036 9036
q19 1798 1742 1768 1742
q20 2377 2088 2061 2061
q21 8812 8509 8590 8509
q22 889 786 775 775
Total cold run time: 81037 ms
Total hot run time: 77586 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](stream-load)select coordinator node from user's tag when exec streaming load [doris]
Posted by "wangbo (via GitHub)" <gi...@apache.org>.
wangbo merged PR #27106:
URL: https://github.com/apache/doris/pull/27106
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](stream-load)select coordinator node from user's tag when exec streaming load [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27106:
URL: https://github.com/apache/doris/pull/27106#issuecomment-1813990049
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org