You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org> on 2024/09/03 04:03:53 UTC

[PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

zhiqiang-hhhh opened a new pull request, #40302:
URL: https://github.com/apache/doris/pull/40302

   In previous, we use auto_profile_shreshold to control how many time duration will ProfileManager waiting for profile collection after query has finished. The default value of auto_profile_shreshold is -1, makes profile need to be reported immediately after query finished, or it will be not complete. So introduce a new config in fe.log to solve the problem.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #40302:
URL: https://github.com/apache/doris/pull/40302


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2332009637

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2332123045

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38205 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 82c96828c98b39feba1b54d85f57a99123aa6d9d, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17655	4401	4254	4254
   q2	2028	199	190	190
   q3	11728	960	1103	960
   q4	10565	800	734	734
   q5	7757	2907	2833	2833
   q6	227	139	137	137
   q7	957	624	608	608
   q8	9344	2078	2086	2078
   q9	7194	6563	6607	6563
   q10	7029	2218	2246	2218
   q11	449	248	236	236
   q12	389	224	224	224
   q13	18791	3110	3072	3072
   q14	294	232	229	229
   q15	547	500	489	489
   q16	524	440	425	425
   q17	985	649	705	649
   q18	7282	6971	6940	6940
   q19	1379	1124	1023	1023
   q20	677	358	344	344
   q21	3953	3200	2932	2932
   q22	1161	1101	1067	1067
   Total cold run time: 110915 ms
   Total hot run time: 38205 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4508	4433	4396	4396
   q2	381	284	280	280
   q3	3029	2859	2847	2847
   q4	2020	1699	1817	1699
   q5	5742	5724	5840	5724
   q6	237	133	130	130
   q7	2322	1835	1874	1835
   q8	3286	3469	3466	3466
   q9	8905	8802	8768	8768
   q10	3637	3351	3311	3311
   q11	614	509	501	501
   q12	851	675	674	674
   q13	16789	3335	3317	3317
   q14	306	306	292	292
   q15	542	493	494	493
   q16	528	486	497	486
   q17	1830	1578	1521	1521
   q18	8188	7896	7913	7896
   q19	1725	1556	1586	1556
   q20	2143	1947	1894	1894
   q21	5599	5466	5242	5242
   q22	1129	1069	1075	1069
   Total cold run time: 74311 ms
   Total hot run time: 57397 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2328229821

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on code in PR #40302:
URL: https://github.com/apache/doris/pull/40302#discussion_r1776806159


##########
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -2784,6 +2784,10 @@ public class Config extends ConfigBase {
     @ConfField
     public static long spilled_profile_storage_limit_bytes = 1 * 1024 * 1024 * 1024; // 1GB
 
+    // Profile will be spilled to storage after query has finished for this time.
+    @ConfField

Review Comment:
   add description field



##########
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -2784,6 +2784,10 @@ public class Config extends ConfigBase {
     @ConfField
     public static long spilled_profile_storage_limit_bytes = 1 * 1024 * 1024 * 1024; // 1GB
 
+    // Profile will be spilled to storage after query has finished for this time.
+    @ConfField

Review Comment:
   use `_second` as suffix, like other config item's name



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2376664936

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2333313414

   <img width="557" alt="image" src="https://github.com/user-attachments/assets/3ebeba19-1358-4607-b6c0-877c8f2c232b">
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2332159801

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.75 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 82c96828c98b39feba1b54d85f57a99123aa6d9d, data reload: false
   
   query1	0.05	0.04	0.04
   query2	0.08	0.04	0.04
   query3	0.22	0.05	0.05
   query4	1.68	0.07	0.07
   query5	0.54	0.50	0.51
   query6	1.13	0.75	0.73
   query7	0.02	0.01	0.01
   query8	0.05	0.04	0.05
   query9	0.53	0.49	0.49
   query10	0.55	0.56	0.54
   query11	0.15	0.12	0.11
   query12	0.16	0.12	0.13
   query13	0.60	0.59	0.58
   query14	1.41	1.44	1.44
   query15	0.83	0.81	0.85
   query16	0.37	0.37	0.38
   query17	1.04	1.05	1.04
   query18	0.21	0.21	0.19
   query19	1.94	1.81	1.86
   query20	0.01	0.01	0.00
   query21	15.40	0.67	0.65
   query22	4.27	6.90	2.15
   query23	18.29	1.39	1.34
   query24	2.09	0.24	0.23
   query25	0.15	0.08	0.08
   query26	0.27	0.19	0.19
   query27	0.08	0.08	0.08
   query28	13.19	1.01	1.00
   query29	12.64	3.31	3.33
   query30	0.24	0.06	0.06
   query31	2.90	0.39	0.38
   query32	3.25	0.47	0.48
   query33	2.98	3.03	2.99
   query34	17.02	4.40	4.43
   query35	4.47	4.39	4.47
   query36	0.66	0.47	0.49
   query37	0.19	0.15	0.16
   query38	0.16	0.15	0.14
   query39	0.04	0.04	0.03
   query40	0.16	0.13	0.14
   query41	0.09	0.05	0.05
   query42	0.05	0.04	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 110.21 s
   Total hot run time: 31.75 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2365025260

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on code in PR #40302:
URL: https://github.com/apache/doris/pull/40302#discussion_r1776864238


##########
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -2784,6 +2784,10 @@ public class Config extends ConfigBase {
     @ConfField
     public static long spilled_profile_storage_limit_bytes = 1 * 1024 * 1024 * 1024; // 1GB
 
+    // Profile will be spilled to storage after query has finished for this time.
+    @ConfField

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2330495187

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 37972 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 92b18e6b70dbb826d897a8463648eee9bf48bd8f, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17640	4676	4285	4285
   q2	2032	179	172	172
   q3	11420	922	1124	922
   q4	10524	791	658	658
   q5	7736	2831	2866	2831
   q6	226	139	137	137
   q7	947	635	612	612
   q8	9318	2046	2068	2046
   q9	7235	6539	6517	6517
   q10	7019	2272	2209	2209
   q11	467	241	232	232
   q12	392	221	220	220
   q13	19052	3062	3068	3062
   q14	281	244	235	235
   q15	529	499	498	498
   q16	630	505	514	505
   q17	995	666	776	666
   q18	7390	6922	6924	6922
   q19	1383	1033	1033	1033
   q20	666	336	321	321
   q21	3934	2942	2868	2868
   q22	1121	1062	1021	1021
   Total cold run time: 110937 ms
   Total hot run time: 37972 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4301	4248	4256	4248
   q2	384	288	276	276
   q3	2870	2625	2673	2625
   q4	1958	1650	1653	1650
   q5	5648	5675	5705	5675
   q6	232	137	140	137
   q7	2199	1849	1795	1795
   q8	3284	3407	3424	3407
   q9	8833	8861	8808	8808
   q10	3579	3368	3378	3368
   q11	603	522	514	514
   q12	801	646	662	646
   q13	14633	3195	3242	3195
   q14	311	296	300	296
   q15	537	501	490	490
   q16	637	594	567	567
   q17	1835	1535	1513	1513
   q18	8124	7984	8046	7984
   q19	1705	1614	1608	1608
   q20	2159	1898	1946	1898
   q21	5754	5332	5359	5332
   q22	1121	1064	1037	1037
   Total cold run time: 71508 ms
   Total hot run time: 57069 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2330505274

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 192797 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 92b18e6b70dbb826d897a8463648eee9bf48bd8f, data reload: false
   
   query1	1244	894	871	871
   query2	6328	1898	1921	1898
   query3	10607	4054	3928	3928
   query4	59855	26350	23275	23275
   query5	5485	488	513	488
   query6	411	189	159	159
   query7	5908	292	284	284
   query8	286	207	196	196
   query9	9005	2520	2491	2491
   query10	502	279	281	279
   query11	17930	15084	15365	15084
   query12	160	106	102	102
   query13	1574	411	414	411
   query14	11150	7290	7413	7290
   query15	239	178	178	178
   query16	7600	502	496	496
   query17	1162	583	562	562
   query18	2026	301	298	298
   query19	287	147	143	143
   query20	121	105	108	105
   query21	217	108	107	107
   query22	4925	4578	4524	4524
   query23	34220	33367	33524	33367
   query24	5914	2869	2850	2850
   query25	522	388	374	374
   query26	675	154	151	151
   query27	1795	276	280	276
   query28	3957	2065	2035	2035
   query29	693	409	403	403
   query30	211	151	151	151
   query31	937	760	764	760
   query32	85	52	53	52
   query33	467	280	277	277
   query34	877	477	478	477
   query35	848	728	729	728
   query36	1054	907	922	907
   query37	145	90	90	90
   query38	4062	3970	3895	3895
   query39	1460	1393	1405	1393
   query40	197	114	111	111
   query41	46	46	45	45
   query42	111	96	95	95
   query43	517	470	469	469
   query44	1093	731	734	731
   query45	197	167	163	163
   query46	1096	733	746	733
   query47	1910	1806	1822	1806
   query48	396	300	302	300
   query49	756	434	437	434
   query50	812	422	417	417
   query51	7048	6951	6932	6932
   query52	95	86	94	86
   query53	250	182	174	174
   query54	553	461	464	461
   query55	79	77	73	73
   query56	276	252	301	252
   query57	1215	1071	1077	1071
   query58	215	233	230	230
   query59	3008	2747	2746	2746
   query60	289	262	264	262
   query61	122	100	100	100
   query62	746	632	660	632
   query63	218	181	181	181
   query64	2818	673	720	673
   query65	3203	3130	3175	3130
   query66	696	334	335	334
   query67	15431	15372	15129	15129
   query68	3001	558	590	558
   query69	397	284	276	276
   query70	1119	1075	1145	1075
   query71	340	271	284	271
   query72	5248	4081	3860	3860
   query73	765	331	327	327
   query74	9146	8831	8857	8831
   query75	3356	2680	2682	2680
   query76	1451	993	1039	993
   query77	535	317	328	317
   query78	10348	9153	9167	9153
   query79	1045	534	519	519
   query80	675	503	494	494
   query81	499	234	234	234
   query82	235	142	143	142
   query83	169	202	149	149
   query84	256	77	78	77
   query85	681	279	274	274
   query86	323	303	277	277
   query87	4432	4285	4397	4285
   query88	3547	2378	2354	2354
   query89	371	284	294	284
   query90	1920	187	187	187
   query91	120	100	96	96
   query92	58	47	49	47
   query93	1050	532	537	532
   query94	708	291	293	291
   query95	333	255	258	255
   query96	585	281	274	274
   query97	3194	3094	3103	3094
   query98	216	204	191	191
   query99	1510	1275	1275	1275
   Total cold run time: 305970 ms
   Total hot run time: 192797 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2375607150

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2375607183

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2365029831

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei commented on code in PR #40302:
URL: https://github.com/apache/doris/pull/40302#discussion_r1768579074


##########
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##########
@@ -2768,6 +2768,10 @@ public class Config extends ConfigBase {
     @ConfField
     public static long spilled_profile_storage_limit_bytes = 1 * 1024 * 1024 * 1024; // 1GB
 
+    // Profile will be spilled to storage after query has finished for this time.
+    @ConfField
+    public static int profile_waiting_time_for_spill_s = 10;
+

Review Comment:
   _secs



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2332147431

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 191767 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 82c96828c98b39feba1b54d85f57a99123aa6d9d, data reload: false
   
   query1	1237	884	888	884
   query2	6477	1876	1808	1808
   query3	10595	3852	4039	3852
   query4	59135	24554	23086	23086
   query5	5492	498	483	483
   query6	422	157	165	157
   query7	5779	295	293	293
   query8	331	225	223	223
   query9	8784	2499	2479	2479
   query10	481	266	278	266
   query11	17970	14969	15101	14969
   query12	157	106	108	106
   query13	1530	410	378	378
   query14	11108	6699	7185	6699
   query15	240	176	163	163
   query16	7213	468	443	443
   query17	1134	560	585	560
   query18	1347	299	303	299
   query19	313	150	154	150
   query20	129	114	109	109
   query21	218	108	108	108
   query22	4659	4527	4445	4445
   query23	34120	33785	33378	33378
   query24	6014	2929	2819	2819
   query25	570	378	379	378
   query26	689	149	154	149
   query27	1795	275	276	275
   query28	3735	2032	2021	2021
   query29	637	404	408	404
   query30	229	148	157	148
   query31	939	763	784	763
   query32	84	50	56	50
   query33	487	286	284	284
   query34	865	470	471	470
   query35	839	711	709	709
   query36	1073	922	932	922
   query37	135	82	76	76
   query38	4012	3882	3844	3844
   query39	1456	1395	1380	1380
   query40	222	114	112	112
   query41	45	44	44	44
   query42	116	92	94	92
   query43	500	468	457	457
   query44	1103	751	736	736
   query45	194	161	162	161
   query46	1093	754	764	754
   query47	1938	1805	1832	1805
   query48	366	289	297	289
   query49	767	430	450	430
   query50	847	406	413	406
   query51	7007	6893	6853	6853
   query52	99	84	84	84
   query53	252	183	181	181
   query54	557	456	451	451
   query55	76	75	73	73
   query56	274	262	282	262
   query57	1178	1101	1074	1074
   query58	247	245	239	239
   query59	3143	2817	2843	2817
   query60	290	269	300	269
   query61	103	103	100	100
   query62	738	636	647	636
   query63	212	183	184	183
   query64	2874	673	652	652
   query65	3169	3149	3124	3124
   query66	684	344	345	344
   query67	15504	15155	15173	15155
   query68	2914	581	587	581
   query69	405	276	281	276
   query70	1175	1087	1080	1080
   query71	347	280	280	280
   query72	6123	4018	3987	3987
   query73	750	323	322	322
   query74	9229	8884	8808	8808
   query75	3368	2702	2701	2701
   query76	1481	1004	968	968
   query77	569	327	318	318
   query78	9605	10585	9427	9427
   query79	1044	536	526	526
   query80	681	494	501	494
   query81	455	227	231	227
   query82	242	136	140	136
   query83	170	149	150	149
   query84	254	81	79	79
   query85	689	299	285	285
   query86	310	303	287	287
   query87	4374	4493	4249	4249
   query88	3417	2325	2337	2325
   query89	375	280	282	280
   query90	1986	187	193	187
   query91	123	97	101	97
   query92	62	48	48	48
   query93	1048	537	528	528
   query94	720	292	299	292
   query95	346	255	255	255
   query96	579	266	263	263
   query97	3225	3048	3093	3048
   query98	230	203	193	193
   query99	1500	1260	1258	1258
   Total cold run time: 303824 ms
   Total hot run time: 191767 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2330466371

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2330510117

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 32.57 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 92b18e6b70dbb826d897a8463648eee9bf48bd8f, data reload: false
   
   query1	0.05	0.04	0.03
   query2	0.08	0.04	0.03
   query3	0.23	0.06	0.05
   query4	1.68	0.09	0.07
   query5	0.51	0.52	0.50
   query6	1.13	0.74	0.72
   query7	0.02	0.01	0.01
   query8	0.06	0.04	0.05
   query9	0.55	0.48	0.49
   query10	0.53	0.52	0.55
   query11	0.15	0.12	0.11
   query12	0.15	0.12	0.12
   query13	0.60	0.59	0.58
   query14	2.12	2.07	2.13
   query15	0.90	0.83	0.82
   query16	0.38	0.39	0.38
   query17	1.06	1.05	1.06
   query18	0.21	0.21	0.21
   query19	1.96	1.84	1.86
   query20	0.02	0.01	0.00
   query21	15.46	0.66	0.65
   query22	4.23	6.74	2.34
   query23	18.26	1.50	1.37
   query24	2.11	0.21	0.20
   query25	0.16	0.08	0.08
   query26	0.27	0.17	0.17
   query27	0.08	0.08	0.07
   query28	13.27	1.02	0.99
   query29	12.65	3.37	3.37
   query30	0.24	0.05	0.06
   query31	2.88	0.41	0.39
   query32	3.22	0.49	0.49
   query33	2.98	3.08	2.98
   query34	17.13	4.34	4.35
   query35	4.47	4.41	4.39
   query36	0.66	0.49	0.47
   query37	0.18	0.15	0.15
   query38	0.16	0.15	0.14
   query39	0.05	0.04	0.03
   query40	0.16	0.13	0.13
   query41	0.10	0.05	0.05
   query42	0.06	0.06	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 111.22 s
   Total hot run time: 32.57 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2325563470

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](profile) Add new config profile_waiting_time_for_spill_s [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #40302:
URL: https://github.com/apache/doris/pull/40302#issuecomment-2325564317

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org