You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Jibing-Li (via GitHub)" <gi...@apache.org> on 2024/02/29 11:43:12 UTC

[PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Jibing-Li opened a new pull request, #31619:
URL: https://github.com/apache/doris/pull/31619

   Log one bdbje record for one load transaction. Reduce the log bdbje operation for load. 
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1970989850

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971109620

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.75 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.06	0.02	0.02
   query3	0.23	0.06	0.06
   query4	1.67	0.09	0.09
   query5	0.53	0.51	0.52
   query6	1.27	0.68	0.66
   query7	0.01	0.02	0.01
   query8	0.03	0.02	0.03
   query9	0.56	0.52	0.51
   query10	0.59	0.57	0.56
   query11	0.13	0.10	0.10
   query12	0.13	0.10	0.11
   query13	0.62	0.61	0.62
   query14	0.79	0.79	0.80
   query15	0.84	0.81	0.82
   query16	0.38	0.38	0.37
   query17	0.97	0.95	0.97
   query18	0.26	0.26	0.24
   query19	1.79	1.70	1.66
   query20	0.01	0.01	0.01
   query21	15.41	0.67	0.62
   query22	3.03	4.16	2.32
   query23	17.75	1.09	0.97
   query24	2.22	0.20	0.35
   query25	0.25	0.11	0.05
   query26	0.17	0.15	0.14
   query27	0.03	0.02	0.03
   query28	12.47	0.84	0.83
   query29	12.62	3.29	3.23
   query30	0.61	0.54	0.54
   query31	2.80	0.35	0.36
   query32	3.34	0.49	0.47
   query33	3.18	3.16	3.26
   query34	15.35	4.73	4.71
   query35	4.75	4.72	4.71
   query36	1.13	1.06	1.07
   query37	0.06	0.05	0.05
   query38	0.04	0.03	0.02
   query39	0.02	0.02	0.01
   query40	0.18	0.14	0.15
   query41	0.07	0.01	0.02
   query42	0.03	0.01	0.02
   query43	0.03	0.02	0.02
   Total cold run time: 106.45 s
   Total hot run time: 31.75 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972693820

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971081624

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38206 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17667	5816	4143	4143
   q2	2053	142	136	136
   q3	10979	970	969	969
   q4	4704	980	992	980
   q5	8670	2880	3055	2880
   q6	180	125	123	123
   q7	1255	774	768	768
   q8	9297	1990	2048	1990
   q9	7252	6348	6276	6276
   q10	8193	2502	2492	2492
   q11	432	214	195	195
   q12	739	312	316	312
   q13	17981	3215	3224	3215
   q14	277	242	281	242
   q15	532	499	484	484
   q16	523	389	406	389
   q17	951	872	857	857
   q18	6316	6180	6190	6180
   q19	1580	1517	1516	1516
   q20	477	283	268	268
   q21	5812	3519	3591	3519
   q22	796	286	272	272
   Total cold run time: 106666 ms
   Total hot run time: 38206 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4101	4006	4013	4006
   q2	302	216	210	210
   q3	2992	2931	2932	2931
   q4	1848	1811	1783	1783
   q5	5114	5158	5121	5121
   q6	205	115	116	115
   q7	2113	1730	1744	1730
   q8	3130	3237	3222	3222
   q9	8230	8259	8217	8217
   q10	6200	3652	3641	3641
   q11	513	430	425	425
   q12	674	534	525	525
   q13	3743	3063	3062	3062
   q14	275	270	244	244
   q15	545	502	493	493
   q16	499	484	461	461
   q17	1705	1688	1704	1688
   q18	7784	7597	7355	7355
   q19	1741	1641	1642	1641
   q20	2093	1904	1893	1893
   q21	4745	4642	4917	4642
   q22	500	437	436	436
   Total cold run time: 59052 ms
   Total hot run time: 53841 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972717263

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 27.11 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit b18e49935ed898751995c35b91593bd382da247e, data reload: false
   
   query1	0.06	0.04	0.04
   query2	0.10	0.04	0.03
   query3	0.27	0.06	0.07
   query4	1.60	0.09	0.09
   query5	0.51	0.51	0.51
   query6	1.57	1.01	0.99
   query7	0.03	0.02	0.02
   query8	0.06	0.04	0.04
   query9	0.70	0.66	0.69
   query10	0.70	0.71	0.68
   query11	0.21	0.15	0.16
   query12	0.20	0.15	0.15
   query13	0.50	0.49	0.46
   query14	0.75	0.71	0.70
   query15	0.92	0.86	0.86
   query16	0.41	0.39	0.40
   query17	1.19	1.18	1.31
   query18	0.33	0.29	0.29
   query19	2.21	2.04	2.08
   query20	0.02	0.02	0.02
   query21	15.38	1.06	0.98
   query22	0.61	0.59	0.59
   query23	13.65	0.66	0.65
   query24	0.60	0.19	0.18
   query25	0.05	0.05	0.05
   query26	0.21	0.20	0.20
   query27	0.05	0.05	0.04
   query28	1.37	0.75	0.76
   query29	13.06	4.69	4.76
   query30	0.88	0.78	0.83
   query31	0.86	0.40	0.40
   query32	3.24	0.41	0.40
   query33	2.50	2.30	2.26
   query34	2.23	2.20	2.20
   query35	2.22	2.19	2.19
   query36	1.02	1.02	1.00
   query37	0.08	0.06	0.06
   query38	0.05	0.04	0.04
   query39	0.03	0.03	0.03
   query40	0.21	0.16	0.17
   query41	0.09	0.03	0.03
   query42	0.04	0.04	0.03
   query43	0.04	0.04	0.05
   Total cold run time: 70.81 s
   Total hot run time: 27.11 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972693860

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1970960259

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972574118

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971100383

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 168346 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d, data reload: false
   
   query1	923	354	334	334
   query2	6526	1749	1677	1677
   query3	6701	209	202	202
   query4	23258	20466	20562	20466
   query5	4250	366	350	350
   query6	260	163	173	163
   query7	4605	287	294	287
   query8	262	188	193	188
   query9	8510	2302	2282	2282
   query10	418	211	225	211
   query11	14483	14300	14033	14033
   query12	139	81	79	79
   query13	1651	424	414	414
   query14	8593	6242	6477	6242
   query15	204	163	172	163
   query16	7086	255	248	248
   query17	1045	530	499	499
   query18	1895	270	269	269
   query19	186	149	152	149
   query20	83	82	81	81
   query21	198	120	115	115
   query22	4565	4531	4629	4531
   query23	30478	29945	29838	29838
   query24	11404	3070	3132	3070
   query25	621	353	350	350
   query26	1704	153	161	153
   query27	3025	303	317	303
   query28	7044	1855	1848	1848
   query29	1104	549	555	549
   query30	278	130	141	130
   query31	859	673	693	673
   query32	91	57	54	54
   query33	711	220	224	220
   query34	1043	481	480	480
   query35	854	735	729	729
   query36	945	898	885	885
   query37	139	64	62	62
   query38	3081	2955	2987	2955
   query39	1314	1272	1243	1243
   query40	280	101	100	100
   query41	42	36	36	36
   query42	104	96	97	96
   query43	458	420	428	420
   query44	1071	690	697	690
   query45	183	174	172	172
   query46	1039	789	777	777
   query47	1536	1417	1444	1417
   query48	419	347	348	347
   query49	1146	294	302	294
   query50	755	361	364	361
   query51	4387	4312	4276	4276
   query52	91	88	87	87
   query53	328	262	262	262
   query54	296	222	219	219
   query55	85	76	79	76
   query56	219	203	192	192
   query57	959	901	911	901
   query58	210	188	193	188
   query59	2015	1971	2072	1971
   query60	229	224	207	207
   query61	85	92	86	86
   query62	608	366	367	366
   query63	270	261	266	261
   query64	6602	2997	3144	2997
   query65	3231	3185	3195	3185
   query66	1436	315	315	315
   query67	14399	14173	13992	13992
   query68	4609	570	568	568
   query69	520	375	373	373
   query70	1248	1201	1239	1201
   query71	330	255	241	241
   query72	6294	2801	2661	2661
   query73	708	320	316	316
   query74	6348	5936	5962	5936
   query75	3041	2423	2403	2403
   query76	2723	1011	1122	1011
   query77	337	236	231	231
   query78	9019	8394	8539	8394
   query79	1287	526	523	523
   query80	1008	348	337	337
   query81	478	200	193	193
   query82	940	85	83	83
   query83	218	125	122	122
   query84	277	74	78	74
   query85	1342	353	345	345
   query86	357	306	306	306
   query87	3248	3080	3035	3035
   query88	2681	2285	2301	2285
   query89	374	349	327	327
   query90	1851	160	165	160
   query91	152	145	137	137
   query92	55	48	46	46
   query93	1128	515	500	500
   query94	1246	182	177	177
   query95	439	332	340	332
   query96	571	260	262	260
   query97	4223	4112	4121	4112
   query98	222	208	195	195
   query99	1042	646	689	646
   Total cold run time: 261335 ms
   Total hot run time: 168346 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972698093

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 31686 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b18e49935ed898751995c35b91593bd382da247e, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17929	4589	4605	4589
   q2	2186	228	220	220
   q3	10377	1063	1045	1045
   q4	4689	1081	1074	1074
   q5	7697	2043	2015	2015
   q6	159	137	107	107
   q7	1139	1042	1012	1012
   q8	9521	1058	1108	1058
   q9	6191	4992	4734	4734
   q10	7797	1949	1945	1945
   q11	524	319	326	319
   q12	791	391	399	391
   q13	18061	3102	2889	2889
   q14	308	312	278	278
   q15	353	334	330	330
   q16	519	482	524	482
   q17	811	330	332	330
   q18	5509	4811	4705	4705
   q19	1184	440	441	440
   q20	615	432	419	419
   q21	6063	2838	2851	2838
   q22	539	466	466	466
   Total cold run time: 102962 ms
   Total hot run time: 31686 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4579	4612	4676	4612
   q2	297	214	228	214
   q3	2124	1739	1746	1739
   q4	1540	1247	1215	1215
   q5	3078	2847	2833	2833
   q6	162	105	110	105
   q7	1803	1810	1781	1781
   q8	1839	1721	1715	1715
   q9	5273	5133	5113	5113
   q10	2590	2264	2322	2264
   q11	491	419	444	419
   q12	691	613	625	613
   q13	2942	2623	2651	2623
   q14	290	292	300	292
   q15	364	337	329	329
   q16	508	509	489	489
   q17	1190	783	778	778
   q18	5890	5397	5215	5215
   q19	1155	677	651	651
   q20	1495	1473	1424	1424
   q21	4640	4267	4188	4188
   q22	666	611	581	581
   Total cold run time: 43607 ms
   Total hot run time: 39193 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972711591

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 188550 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b18e49935ed898751995c35b91593bd382da247e, data reload: false
   
   query1	1036	402	386	386
   query2	7907	2449	2464	2449
   query3	6741	301	306	301
   query4	21156	22354	23156	22354
   query5	5614	947	752	752
   query6	380	279	280	279
   query7	4965	435	454	435
   query8	312	242	257	242
   query9	8697	3431	3390	3390
   query10	561	364	369	364
   query11	18214	19067	19697	19067
   query12	302	273	267	267
   query13	1714	646	664	646
   query14	11625	7941	7659	7659
   query15	324	231	249	231
   query16	8392	400	399	399
   query17	2200	727	724	724
   query18	2212	396	401	396
   query19	490	245	238	238
   query20	140	136	137	136
   query21	240	185	162	162
   query22	5138	5009	4963	4963
   query23	24071	23377	23936	23377
   query24	6882	2128	2100	2100
   query25	692	522	533	522
   query26	794	250	254	250
   query27	2258	492	499	492
   query28	3272	2872	2860	2860
   query29	958	780	765	765
   query30	410	187	199	187
   query31	1400	768	810	768
   query32	142	102	98	98
   query33	607	387	385	385
   query34	895	657	667	657
   query35	970	906	898	898
   query36	1238	1181	1172	1172
   query37	147	115	115	115
   query38	3186	3063	3006	3006
   query39	1122	1059	1114	1059
   query40	257	176	170	170
   query41	99	86	92	86
   query42	164	162	152	152
   query43	616	589	598	589
   query44	1285	1085	1059	1059
   query45	223	228	222	222
   query46	893	791	811	791
   query47	1637	1621	1626	1621
   query48	608	517	530	517
   query49	1115	499	472	472
   query50	666	563	565	563
   query51	11664	11295	11533	11295
   query52	154	144	149	144
   query53	350	337	335	335
   query54	383	356	373	356
   query55	166	138	130	130
   query56	364	355	346	346
   query57	1091	1044	1011	1011
   query58	371	351	338	338
   query59	3499	3360	3451	3360
   query60	408	387	424	387
   query61	172	194	171	171
   query62	543	432	422	422
   query63	353	347	332	332
   query64	4270	1849	1837	1837
   query65	2383	2399	2372	2372
   query66	900	398	393	393
   query67	15038	14939	14901	14901
   query68	4189	737	722	722
   query69	673	581	585	581
   query70	1628	1601	1590	1590
   query71	485	419	430	419
   query72	2878	2348	2380	2348
   query73	664	483	490	483
   query74	6956	7080	7049	7049
   query75	2962	2732	2718	2718
   query76	2230	662	656	656
   query77	567	415	414	414
   query78	6876	6170	6255	6170
   query79	1116	749	784	749
   query80	662	712	602	602
   query81	492	255	264	255
   query82	168	139	137	137
   query83	259	281	270	270
   query84	281	134	135	134
   query85	896	580	532	532
   query86	440	421	477	421
   query87	3445	3082	3149	3082
   query88	3747	3490	3455	3455
   query89	461	431	421	421
   query90	1054	232	238	232
   query91	220	208	219	208
   query92	88	87	85	85
   query93	1034	723	723	723
   query94	501	279	281	279
   query95	595	536	527	527
   query96	640	392	400	392
   query97	2976	2968	2974	2968
   query98	339	300	300	300
   query99	832	705	731	705
   Total cold run time: 257430 ms
   Total hot run time: 188550 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #31619:
URL: https://github.com/apache/doris/pull/31619


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972591125

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 37834 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 21b295a3eb54221f15be882424adb84bd92b1984, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17707	4166	3988	3988
   q2	2081	154	145	145
   q3	10653	933	934	933
   q4	4699	935	936	935
   q5	7647	2864	3001	2864
   q6	185	124	124	124
   q7	1288	816	824	816
   q8	9609	2071	2073	2071
   q9	7347	6445	6488	6445
   q10	8229	2570	2573	2570
   q11	434	217	217	217
   q12	836	309	310	309
   q13	17994	2963	2945	2945
   q14	296	253	254	253
   q15	474	463	436	436
   q16	455	387	390	387
   q17	933	850	819	819
   q18	6558	5934	5888	5888
   q19	1577	1504	1512	1504
   q20	539	281	262	262
   q21	7512	3622	3632	3622
   q22	799	305	301	301
   Total cold run time: 107852 ms
   Total hot run time: 37834 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	3970	3985	3979	3979
   q2	316	219	222	219
   q3	2912	2902	2896	2896
   q4	1832	1797	1795	1795
   q5	5195	5276	5199	5199
   q6	200	116	118	116
   q7	2244	1794	1781	1781
   q8	3178	3289	3274	3274
   q9	8470	8423	8469	8423
   q10	6156	3760	3705	3705
   q11	528	432	448	432
   q12	663	514	564	514
   q13	7806	2854	2818	2818
   q14	269	274	246	246
   q15	469	432	433	432
   q16	446	399	410	399
   q17	1687	1666	1651	1651
   q18	7890	7597	7312	7312
   q19	2623	1498	1602	1498
   q20	1917	1717	1725	1717
   q21	4901	4841	4685	4685
   q22	517	485	454	454
   Total cold run time: 64189 ms
   Total hot run time: 53545 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972639237

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971114714

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d with default session variables
   Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
   Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       18.1 seconds inserted 10000000 Rows, about 552K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org