You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "kaijchen (via GitHub)" <gi...@apache.org> on 2023/12/20 13:06:46 UTC

[PR] [improve](move-memtable) limit task num in load stream flush token [doris]

kaijchen opened a new pull request, #28748:
URL: https://github.com/apache/doris/pull/28748

   ## Proposed changes
   
   Limit task num in load stream flush token, so IOBuf memory won't pile up here.
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "kaijchen (via GitHub)" <gi...@apache.org>.
kaijchen commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864445679

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864956397

   TeamCity be ut coverage result:
    Function Coverage: 36.48% (8537/23404) 
    Line Coverage: 28.60% (69420/242724)
    Region Coverage: 27.62% (35921/130043)
    Branch Coverage: 24.36% (18351/75346)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/8762ee556b7e7db3c26e81623435d45fef1f305c_8762ee556b7e7db3c26e81623435d45fef1f305c/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864454476

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864973518

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 8762ee556b7e7db3c26e81623435d45fef1f305c, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4668	4457	4439	4439
   q2	370	144	159	144
   q3	1468	1268	1197	1197
   q4	1107	901	919	901
   q5	3160	3149	3179	3149
   q6	246	129	126	126
   q7	985	497	484	484
   q8	2204	2233	2188	2188
   q9	6765	6710	6670	6670
   q10	3261	3298	3302	3298
   q11	309	189	192	189
   q12	359	220	212	212
   q13	4587	3818	3809	3809
   q14	248	224	210	210
   q15	571	534	529	529
   q16	452	405	393	393
   q17	1014	558	539	539
   q18	7189	7027	6906	6906
   q19	1522	1400	1434	1400
   q20	542	326	316	316
   q21	3094	2672	2690	2672
   q22	355	292	305	292
   Total cold run time: 44476 ms
   Total hot run time: 40063 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4349	4393	4385	4385
   q2	275	169	175	169
   q3	3539	3522	3526	3522
   q4	2390	2382	2381	2381
   q5	5734	5777	5750	5750
   q6	239	120	121	120
   q7	2387	1880	1883	1880
   q8	3521	3535	3530	3530
   q9	9086	9032	9045	9032
   q10	3975	3979	4023	3979
   q11	488	375	384	375
   q12	773	606	591	591
   q13	4301	3564	3602	3564
   q14	293	258	262	258
   q15	573	523	525	523
   q16	535	450	464	450
   q17	1894	1865	1875	1865
   q18	8774	8267	8194	8194
   q19	1734	1771	1758	1758
   q20	2269	1955	1959	1955
   q21	6558	6235	6186	6186
   q22	529	435	426	426
   Total cold run time: 64216 ms
   Total hot run time: 60893 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864590025

   TeamCity be ut coverage result:
    Function Coverage: 36.48% (8537/23404) 
    Line Coverage: 28.60% (69418/242724)
    Region Coverage: 27.62% (35922/130043)
    Branch Coverage: 24.36% (18358/75346)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/657bc5ef6e654470764aa2efd9f116524359e0b0_657bc5ef6e654470764aa2efd9f116524359e0b0/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1865454684

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864613949

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 657bc5ef6e654470764aa2efd9f116524359e0b0, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4677	4439	4393	4393
   q2	368	147	158	147
   q3	1457	1261	1250	1250
   q4	1128	896	911	896
   q5	3127	3161	3174	3161
   q6	251	129	126	126
   q7	1008	482	479	479
   q8	2182	2245	2198	2198
   q9	6656	6650	6718	6650
   q10	3237	3273	3302	3273
   q11	306	189	185	185
   q12	354	202	209	202
   q13	4579	3811	3803	3803
   q14	242	218	215	215
   q15	563	525	520	520
   q16	443	395	393	393
   q17	1000	571	560	560
   q18	7224	6927	6852	6852
   q19	1513	1400	1386	1386
   q20	505	334	288	288
   q21	3041	2621	2699	2621
   q22	357	278	288	278
   Total cold run time: 44218 ms
   Total hot run time: 39876 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4321	4348	4381	4348
   q2	268	167	170	167
   q3	3525	3526	3518	3518
   q4	2380	2374	2372	2372
   q5	5753	5757	5759	5757
   q6	247	118	122	118
   q7	2407	1876	1876	1876
   q8	3542	3530	3525	3525
   q9	9056	9002	9037	9002
   q10	3938	4028	4021	4021
   q11	486	384	372	372
   q12	765	605	600	600
   q13	4298	3573	3557	3557
   q14	295	250	251	250
   q15	563	525	514	514
   q16	514	448	470	448
   q17	1894	1861	1873	1861
   q18	8649	8336	8131	8131
   q19	1749	1769	1730	1730
   q20	2253	1958	1950	1950
   q21	6540	6163	6172	6163
   q22	521	422	444	422
   Total cold run time: 63964 ms
   Total hot run time: 60702 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864589728

   TeamCity be ut coverage result:
    Function Coverage: 36.48% (8538/23404) 
    Line Coverage: 28.60% (69417/242724)
    Region Coverage: 27.62% (35913/130043)
    Branch Coverage: 24.37% (18359/75346)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/657bc5ef6e654470764aa2efd9f116524359e0b0_657bc5ef6e654470764aa2efd9f116524359e0b0/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864733527

   TeamCity be ut coverage result:
    Function Coverage: 36.47% (8536/23404) 
    Line Coverage: 28.59% (69392/242724)
    Region Coverage: 27.61% (35906/130043)
    Branch Coverage: 24.35% (18348/75346)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/664dc224043545959770c05514b6a1610089b607_664dc224043545959770c05514b6a1610089b607/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864672905

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864765954

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 664dc224043545959770c05514b6a1610089b607, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4720	4427	4440	4427
   q2	368	156	159	156
   q3	1467	1265	1238	1238
   q4	1116	935	882	882
   q5	3181	3158	3161	3158
   q6	247	127	128	127
   q7	994	496	493	493
   q8	2209	2223	2191	2191
   q9	6706	6680	6691	6680
   q10	3233	3314	3327	3314
   q11	307	199	194	194
   q12	367	215	222	215
   q13	4574	3825	3910	3825
   q14	247	216	219	216
   q15	575	523	527	523
   q16	456	390	396	390
   q17	1014	609	636	609
   q18	7248	6891	6986	6891
   q19	1523	1386	1401	1386
   q20	505	311	309	309
   q21	3106	2625	2685	2625
   q22	359	304	298	298
   Total cold run time: 44522 ms
   Total hot run time: 40147 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4357	4336	4379	4336
   q2	274	165	173	165
   q3	3533	3529	3538	3529
   q4	2400	2393	2390	2390
   q5	5756	5741	5764	5741
   q6	239	120	122	120
   q7	2394	1869	1905	1869
   q8	3546	3549	3548	3548
   q9	9081	9040	8993	8993
   q10	3952	4017	4030	4017
   q11	491	372	368	368
   q12	776	590	619	590
   q13	4291	3554	3607	3554
   q14	284	269	257	257
   q15	577	523	518	518
   q16	532	458	487	458
   q17	1891	1857	1853	1853
   q18	8657	8202	8293	8202
   q19	1742	1784	1759	1759
   q20	2260	1948	1952	1948
   q21	6541	6229	6261	6229
   q22	520	441	427	427
   Total cold run time: 64094 ms
   Total hot run time: 60871 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864635648

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.35 seconds
    stream load tsv:          570 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.6 seconds inserted 10000000 Rows, about 349K ops/s
    storage size: 17184197885 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864784107

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 43.72 seconds
    stream load tsv:          572 seconds loaded 74807831229 Bytes, about 124 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
    storage size: 17184213725 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864673017

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #28748:
URL: https://github.com/apache/doris/pull/28748


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864709792

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "kaijchen (via GitHub)" <gi...@apache.org>.
kaijchen commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864692197

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "kaijchen (via GitHub)" <gi...@apache.org>.
kaijchen commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864453598

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "kaijchen (via GitHub)" <gi...@apache.org>.
kaijchen commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864918683

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864927450

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](move-memtable) limit task num in load stream flush token [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28748:
URL: https://github.com/apache/doris/pull/28748#issuecomment-1864987182

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.03 seconds
    stream load tsv:          569 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.3 seconds inserted 10000000 Rows, about 353K ops/s
    storage size: 17183840391 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org