You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2024/07/23 13:16:30 UTC

[PR] [feat](FE) add rest api to get last profile [doris]

englefly opened a new pull request, #38268:
URL: https://github.com/apache/doris/pull/38268

   ## Proposed changes
   if you want to get the profile of the query just executed, it not neccessary to find the query_id now.
   this is useful to get profiles in shell script, for example, we want to get all profiles of tpcds queries (103 query profile) in a shell script.
   
   before:
   curl http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091 > profile
   after:
   curl http://root:@127.0.0.1:8030/api/profile/text > profilex
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245229519

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly merged PR #38268:
URL: https://github.com/apache/doris/pull/38268


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245229370

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2247764417

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245327539

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.32 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.04	0.04
   query3	0.22	0.05	0.05
   query4	1.68	0.08	0.08
   query5	0.49	0.48	0.48
   query6	1.13	0.73	0.72
   query7	0.01	0.01	0.01
   query8	0.05	0.04	0.04
   query9	0.55	0.49	0.49
   query10	0.54	0.56	0.54
   query11	0.15	0.11	0.11
   query12	0.15	0.12	0.12
   query13	0.60	0.60	0.59
   query14	0.75	0.78	0.79
   query15	0.86	0.83	0.81
   query16	0.36	0.36	0.37
   query17	0.95	1.03	0.98
   query18	0.22	0.22	0.22
   query19	1.76	1.68	1.80
   query20	0.01	0.00	0.01
   query21	15.39	0.75	0.64
   query22	4.46	7.06	1.62
   query23	18.27	1.43	1.28
   query24	2.12	0.22	0.22
   query25	0.16	0.08	0.09
   query26	0.31	0.22	0.21
   query27	0.45	0.24	0.23
   query28	13.29	1.02	1.00
   query29	12.61	3.31	3.30
   query30	0.26	0.06	0.06
   query31	2.85	0.39	0.39
   query32	3.28	0.48	0.47
   query33	2.88	2.94	2.92
   query34	17.22	4.35	4.34
   query35	4.43	4.40	4.41
   query36	0.65	0.46	0.49
   query37	0.19	0.17	0.16
   query38	0.15	0.14	0.15
   query39	0.04	0.04	0.03
   query40	0.16	0.13	0.13
   query41	0.10	0.04	0.05
   query42	0.06	0.04	0.05
   query43	0.05	0.04	0.03
   Total cold run time: 109.98 s
   Total hot run time: 30.32 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2247764485

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245285021

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40118 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17962	4535	4326	4326
   q2	2019	188	183	183
   q3	10799	1260	1135	1135
   q4	10559	763	765	763
   q5	7920	2733	2730	2730
   q6	223	137	138	137
   q7	986	611	601	601
   q8	9575	2103	2091	2091
   q9	8990	6663	6690	6663
   q10	9465	3740	3774	3740
   q11	455	238	236	236
   q12	393	223	221	221
   q13	17799	3000	2957	2957
   q14	273	235	230	230
   q15	539	489	486	486
   q16	492	381	379	379
   q17	960	677	713	677
   q18	8062	7420	7540	7420
   q19	2094	1377	1317	1317
   q20	675	309	322	309
   q21	5020	3228	3282	3228
   q22	351	291	289	289
   Total cold run time: 115611 ms
   Total hot run time: 40118 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4429	4281	4259	4259
   q2	359	268	270	268
   q3	3000	2765	2914	2765
   q4	2004	1659	1687	1659
   q5	5587	5499	5520	5499
   q6	223	129	130	129
   q7	2201	1881	1846	1846
   q8	3324	3460	3430	3430
   q9	8770	8495	8698	8495
   q10	4092	3854	3795	3795
   q11	586	494	493	493
   q12	806	634	629	629
   q13	17848	3139	3217	3139
   q14	314	282	305	282
   q15	535	482	502	482
   q16	513	435	429	429
   q17	1807	1534	1536	1534
   q18	8071	8110	7750	7750
   q19	1746	1486	1587	1486
   q20	2097	1807	1788	1788
   q21	8302	4868	4810	4810
   q22	628	535	505	505
   Total cold run time: 77242 ms
   Total hot run time: 55472 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245314964

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 173778 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
   
   query1	909	384	361	361
   query2	6299	1857	1777	1777
   query3	6656	205	218	205
   query4	28183	17556	16992	16992
   query5	3716	474	480	474
   query6	277	170	158	158
   query7	4575	292	279	279
   query8	247	201	200	200
   query9	8533	2447	2424	2424
   query10	432	291	272	272
   query11	10620	10081	10129	10081
   query12	137	84	83	83
   query13	1649	380	371	371
   query14	10160	7628	7609	7609
   query15	220	170	165	165
   query16	7491	467	474	467
   query17	1156	586	546	546
   query18	1962	287	285	285
   query19	198	154	151	151
   query20	93	85	82	82
   query21	214	131	126	126
   query22	4290	4236	4025	4025
   query23	34065	33554	33689	33554
   query24	12358	2966	2962	2962
   query25	706	411	429	411
   query26	1831	160	155	155
   query27	2952	279	289	279
   query28	7781	2091	2092	2091
   query29	1249	667	667	667
   query30	290	151	156	151
   query31	971	775	785	775
   query32	99	53	57	53
   query33	789	357	356	356
   query34	931	509	505	505
   query35	865	762	766	762
   query36	1135	972	979	972
   query37	283	78	84	78
   query38	3001	2859	2899	2859
   query39	890	822	811	811
   query40	251	124	118	118
   query41	44	43	43	43
   query42	118	98	102	98
   query43	489	459	447	447
   query44	1186	726	729	726
   query45	201	156	161	156
   query46	1098	727	742	727
   query47	1847	1785	1774	1774
   query48	375	294	286	286
   query49	1012	398	406	398
   query50	785	383	380	380
   query51	6780	6734	6618	6618
   query52	102	89	94	89
   query53	356	288	287	287
   query54	862	450	457	450
   query55	74	72	73	72
   query56	292	278	267	267
   query57	1160	1016	1067	1016
   query58	244	257	261	257
   query59	2764	2742	2536	2536
   query60	310	272	269	269
   query61	107	93	110	93
   query62	802	649	652	649
   query63	311	283	282	282
   query64	10300	2224	1691	1691
   query65	3171	3152	3084	3084
   query66	1281	326	327	326
   query67	15788	14963	14958	14958
   query68	8515	554	544	544
   query69	700	408	362	362
   query70	1402	1138	1158	1138
   query71	547	278	274	274
   query72	9012	5807	5974	5807
   query73	2186	365	324	324
   query74	6250	5665	5630	5630
   query75	5413	2691	2662	2662
   query76	5254	926	904	904
   query77	765	309	301	301
   query78	11098	9117	8892	8892
   query79	11824	538	529	529
   query80	856	470	464	464
   query81	583	225	227	225
   query82	294	127	131	127
   query83	336	163	161	161
   query84	275	85	83	83
   query85	894	308	343	308
   query86	351	327	308	308
   query87	3372	3154	3103	3103
   query88	4932	2403	2398	2398
   query89	532	385	389	385
   query90	2202	193	190	190
   query91	128	102	97	97
   query92	61	48	53	48
   query93	6141	509	504	504
   query94	1418	297	276	276
   query95	419	317	318	317
   query96	604	277	286	277
   query97	3151	3010	3038	3010
   query98	216	198	204	198
   query99	1544	1261	1287	1261
   Total cold run time: 311598 ms
   Total hot run time: 173778 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2246659349

   run external


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feat](FE) add rest api to get last profile [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2246659209

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org