You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hello-stephen (via GitHub)" <gi...@apache.org> on 2023/12/28 13:05:00 UTC

[PR] [ci](trigger) support "run performance" [doris]

hello-stephen opened a new pull request, #29259:
URL: https://github.com/apache/doris/pull/29259

   ## Proposed changes
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871648528

   run external


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871663169

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871717261

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 7901ff2fa826bfe05b6d3bbda48fe778eb67f012, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17648	5165	5155	5155
   q2	2013	159	149	149
   q3	10525	1065	1182	1065
   q4	10194	784	824	784
   q5	7801	2899	3054	2899
   q6	216	136	136	136
   q7	903	540	553	540
   q8	9272	2019	2012	2012
   q9	6790	6378	6375	6375
   q10	8269	3113	3047	3047
   q11	427	231	222	222
   q12	397	239	245	239
   q13	17999	3601	3610	3601
   q14	248	213	210	210
   q15	603	550	543	543
   q16	452	394	394	394
   q17	958	511	491	491
   q18	7232	6653	6683	6653
   q19	1622	1397	1368	1368
   q20	738	334	368	334
   q21	2848	2397	2507	2397
   q22	380	318	319	318
   Total cold run time: 107535 ms
   Total hot run time: 38932 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5093	5101	5124	5101
   q2	345	250	260	250
   q3	3299	3291	3267	3267
   q4	2128	1992	2004	1992
   q5	5759	5735	5748	5735
   q6	221	131	129	129
   q7	2294	1891	1875	1875
   q8	3383	3418	3466	3418
   q9	8766	8781	8816	8781
   q10	3796	3851	3836	3836
   q11	575	493	501	493
   q12	797	672	699	672
   q13	6965	3225	3210	3210
   q14	299	304	278	278
   q15	598	552	555	552
   q16	568	529	505	505
   q17	1928	1762	1759	1759
   q18	8658	8297	8286	8286
   q19	1624	1603	1636	1603
   q20	2218	1959	1957	1957
   q21	5560	5201	5382	5201
   q22	517	478	485	478
   Total cold run time: 65391 ms
   Total hot run time: 59378 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871189550

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871720824

   
   TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
   ```
   TPC-DS sf100 test result on commit 7901ff2fa826bfe05b6d3bbda48fe778eb67f012, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	910	374	344	344
   query2	6411	1849	1927	1849
   query3	6650	220	217	217
   query4	26433	22413	22345	22345
   query5	5198	575	554	554
   query6	285	190	190	190
   query7	4574	284	278	278
   query8	229	202	203	202
   query9	8120	2705	2643	2643
   query10	444	267	237	237
   query11	16320	15548	15517	15517
   query12	140	80	78	78
   query13	1680	337	340	337
   query14	12208	7241	7256	7241
   query15	243	185	199	185
   query16	6467	298	294	294
   query17	1746	496	502	496
   query18	1921	271	267	267
   query19	234	142	142	142
   query20	87	77	79	77
   query21	189	99	98	98
   query22	5291	5070	4878	4878
   query23	32242	31395	31296	31296
   query24	11836	2819	2899	2819
   query25	587	358	350	350
   query26	1689	147	149	147
   query27	2856	284	290	284
   query28	7237	1975	1984	1975
   query29	2051	416	402	402
   query30	288	138	154	138
   query31	973	790	765	765
   query32	93	64	64	64
   query33	725	280	275	275
   query34	856	453	462	453
   query35	933	787	778	778
   query36	1324	1130	1271	1130
   query37	199	85	88	85
   query38	3442	3346	3278	3278
   query39	1307	1306	1267	1267
   query40	299	97	92	92
   query41	39	37	35	35
   query42	100	89	94	89
   query43	528	526	503	503
   query44	1109	764	766	764
   query45	204	187	183	183
   query46	1100	651	656	651
   query47	1714	1553	1641	1553
   query48	339	272	280	272
   query49	1192	341	340	340
   query50	752	342	380	342
   query51	5333	5249	5415	5249
   query52	93	91	92	91
   query53	222	153	156	153
   query54	1361	593	605	593
   query55	99	91	90	90
   query56	219	209	205	205
   query57	1063	1022	979	979
   query58	243	212	210	210
   query59	2795	2633	2666	2633
   query60	271	243	239	239
   query61	91	90	102	90
   query62	639	472	471	471
   query63	180	171	160	160
   query64	5941	1777	1764	1764
   query65	3356	3272	3242	3242
   query66	1320	342	336	336
   query67	15455	15387	15796	15387
   query68	12087	537	516	516
   query69	606	264	262	262
   query70	1552	1508	1497	1497
   query71	582	233	231	231
   query72	5616	3585	3558	3558
   query73	1649	330	330	330
   query74	7122	6441	6579	6441
   query75	5671	2310	2292	2292
   query76	5558	1149	1111	1111
   query77	871	272	292	272
   query78	9256	8703	8717	8703
   query79	6031	504	513	504
   query80	2529	373	378	373
   query81	518	204	207	204
   query82	371	124	119	119
   query83	306	142	137	137
   query84	264	54	56	54
   query85	1655	295	290	290
   query86	398	363	382	363
   query87	3589	3382	3404	3382
   query88	2844	2392	2387	2387
   query89	351	261	265	261
   query90	1712	255	247	247
   query91	123	95	91	91
   query92	80	53	55	53
   query93	2965	516	451	451
   query94	625	215	213	213
   query95	521	466	469	466
   query96	652	332	322	322
   query97	4258	4106	4164	4106
   query98	211	204	182	182
   query99	1096	859	864	859
   Total cold run time: 302144 ms
   Total hot run time: 180968 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871648576

   run pipelinex_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871679763

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.67 seconds
    stream load tsv:          577 seconds loaded 74807831229 Bytes, about 123 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.1 seconds inserted 10000000 Rows, about 355K ops/s
    storage size: 17184095946 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871210460

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871755776

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871675255

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 7901ff2fa826bfe05b6d3bbda48fe778eb67f012, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5439	5187	5198	5187
   q2	391	203	197	197
   q3	1482	1160	1245	1160
   q4	1086	843	816	816
   q5	3113	3183	3170	3170
   q6	229	138	133	133
   q7	989	573	521	521
   q8	2161	2295	2220	2220
   q9	6736	6686	6651	6651
   q10	3185	3178	3091	3091
   q11	359	231	222	222
   q12	390	251	243	243
   q13	4414	3618	3656	3618
   q14	247	218	224	218
   q15	623	589	572	572
   q16	475	420	393	393
   q17	1067	549	540	540
   q18	7103	6769	6812	6769
   q19	1656	1540	1530	1530
   q20	624	374	344	344
   q21	2968	2514	2485	2485
   q22	396	336	346	336
   Total cold run time: 45133 ms
   Total hot run time: 40416 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5102	5112	5077	5077
   q2	341	255	260	255
   q3	3415	3340	3309	3309
   q4	2155	2062	2043	2043
   q5	5974	5937	5947	5937
   q6	236	132	132	132
   q7	2371	1930	1931	1930
   q8	3568	3644	3654	3644
   q9	9097	9047	9010	9010
   q10	3875	3928	3920	3920
   q11	576	508	479	479
   q12	811	640	621	621
   q13	3920	3196	3191	3191
   q14	292	294	295	294
   q15	637	583	569	569
   q16	563	511	518	511
   q17	2008	1793	1815	1793
   q18	8793	8327	8293	8293
   q19	1758	1704	1751	1704
   q20	2284	1988	2001	1988
   q21	5678	5295	5298	5295
   q22	563	475	532	475
   Total cold run time: 64017 ms
   Total hot run time: 60470 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 merged PR #29259:
URL: https://github.com/apache/doris/pull/29259


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [ci](trigger) support "run performance" [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #29259:
URL: https://github.com/apache/doris/pull/29259#issuecomment-1871160613

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org