You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hust-hhb (via GitHub)" <gi...@apache.org> on 2024/06/04 10:25:17 UTC

[PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

hust-hhb opened a new pull request, #35869:
URL: https://github.com/apache/doris/pull/35869

   ## Proposed changes
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   Add profile for sync_rowsets while quering.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "hust-hhb (via GitHub)" <gi...@apache.org>.
hust-hhb commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147175419

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147238225

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #35869:
URL: https://github.com/apache/doris/pull/35869


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147265146

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 173363 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 76d46cc73f27e7932b9d84f2336c7a92697c618f, data reload: false
   
   query1	922	379	375	375
   query2	6455	2351	2469	2351
   query3	6648	212	213	212
   query4	19583	17341	17376	17341
   query5	4127	452	457	452
   query6	251	162	155	155
   query7	4586	303	301	301
   query8	313	281	292	281
   query9	8525	2487	2463	2463
   query10	457	296	308	296
   query11	10595	10226	10131	10131
   query12	141	90	88	88
   query13	1642	361	354	354
   query14	9395	6936	7544	6936
   query15	224	187	181	181
   query16	7830	277	282	277
   query17	1270	516	523	516
   query18	1962	270	269	269
   query19	194	153	160	153
   query20	96	84	85	84
   query21	203	131	129	129
   query22	4458	4313	3954	3954
   query23	33783	32975	33088	32975
   query24	11161	2919	2770	2770
   query25	616	350	364	350
   query26	1214	162	168	162
   query27	3009	342	327	327
   query28	7422	2093	2087	2087
   query29	887	625	605	605
   query30	306	149	152	149
   query31	934	726	714	714
   query32	86	50	52	50
   query33	748	296	293	293
   query34	928	502	487	487
   query35	754	613	610	610
   query36	1090	965	946	946
   query37	154	75	101	75
   query38	2857	2723	2726	2723
   query39	875	784	789	784
   query40	201	127	120	120
   query41	55	52	50	50
   query42	122	98	99	98
   query43	578	563	555	555
   query44	1250	726	747	726
   query45	194	169	177	169
   query46	1074	773	755	755
   query47	1861	1773	1776	1773
   query48	372	299	295	295
   query49	978	396	399	396
   query50	787	401	402	401
   query51	6830	6731	6801	6731
   query52	113	92	95	92
   query53	351	296	289	289
   query54	860	474	436	436
   query55	75	75	72	72
   query56	308	247	262	247
   query57	1131	1027	1067	1027
   query58	241	252	255	252
   query59	3543	3150	3207	3150
   query60	285	274	274	274
   query61	103	89	91	89
   query62	658	447	440	440
   query63	319	286	288	286
   query64	8856	2204	1713	1713
   query65	3182	3100	3120	3100
   query66	922	320	330	320
   query67	15301	14872	14786	14786
   query68	4463	548	560	548
   query69	458	327	314	314
   query70	1153	1131	1152	1131
   query71	387	283	280	280
   query72	7159	5731	6123	5731
   query73	745	336	332	332
   query74	5952	5510	5504	5504
   query75	3387	2673	2683	2673
   query76	2318	886	869	869
   query77	455	294	306	294
   query78	10225	9831	9773	9773
   query79	1266	508	511	508
   query80	2012	465	457	457
   query81	584	218	222	218
   query82	1271	103	101	101
   query83	291	170	167	167
   query84	272	87	83	83
   query85	884	267	273	267
   query86	341	318	335	318
   query87	3238	3109	3093	3093
   query88	3727	2483	2473	2473
   query89	490	410	394	394
   query90	1908	192	193	192
   query91	137	112	109	109
   query92	65	52	51	51
   query93	1072	513	509	509
   query94	1189	203	201	201
   query95	416	326	329	326
   query96	593	273	276	273
   query97	3202	3079	3093	3079
   query98	245	222	216	216
   query99	1293	868	831	831
   Total cold run time: 268449 ms
   Total hot run time: 173363 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147225149

   TeamCity be ut coverage result:
    Function Coverage: 37.38% (9280/24823) 
    Line Coverage: 28.72% (75987/264602)
    Region Coverage: 28.10% (39368/140089)
    Branch Coverage: 24.51% (19909/81224)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/76d46cc73f27e7932b9d84f2336c7a92697c618f_76d46cc73f27e7932b9d84f2336c7a92697c618f/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147206193

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147276877

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.45 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 76d46cc73f27e7932b9d84f2336c7a92697c618f, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.09	0.05	0.04
   query3	0.23	0.05	0.05
   query4	1.68	0.06	0.07
   query5	0.51	0.50	0.50
   query6	1.13	0.73	0.73
   query7	0.02	0.02	0.01
   query8	0.05	0.04	0.04
   query9	0.53	0.50	0.50
   query10	0.54	0.55	0.53
   query11	0.15	0.11	0.11
   query12	0.14	0.12	0.12
   query13	0.59	0.60	0.60
   query14	0.77	0.76	0.79
   query15	0.83	0.80	0.80
   query16	0.37	0.36	0.36
   query17	0.98	0.99	1.02
   query18	0.20	0.23	0.23
   query19	1.78	1.68	1.67
   query20	0.02	0.01	0.01
   query21	15.80	0.66	0.66
   query22	5.15	7.00	1.72
   query23	18.27	1.40	1.34
   query24	1.74	0.22	0.25
   query25	0.14	0.08	0.07
   query26	0.26	0.18	0.18
   query27	0.08	0.08	0.08
   query28	13.40	1.01	1.00
   query29	13.35	3.35	3.32
   query30	0.24	0.05	0.05
   query31	2.88	0.40	0.38
   query32	3.30	0.47	0.47
   query33	2.86	2.90	2.90
   query34	17.16	4.42	4.44
   query35	4.46	4.47	4.57
   query36	0.70	0.46	0.47
   query37	0.18	0.16	0.15
   query38	0.16	0.15	0.14
   query39	0.05	0.03	0.04
   query40	0.16	0.14	0.15
   query41	0.09	0.04	0.05
   query42	0.06	0.04	0.04
   query43	0.03	0.03	0.04
   Total cold run time: 111.17 s
   Total hot run time: 30.45 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147186656

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147246109

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 41134 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 76d46cc73f27e7932b9d84f2336c7a92697c618f, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17618	4274	4295	4274
   q2	2023	195	200	195
   q3	10448	1165	1185	1165
   q4	10191	853	893	853
   q5	7504	2694	2737	2694
   q6	232	138	137	137
   q7	966	615	625	615
   q8	9216	2138	2111	2111
   q9	9321	6694	6727	6694
   q10	9717	3909	3866	3866
   q11	429	241	247	241
   q12	466	249	234	234
   q13	17458	3247	3208	3208
   q14	269	225	231	225
   q15	513	479	480	479
   q16	515	391	395	391
   q17	973	603	629	603
   q18	8343	7715	7759	7715
   q19	2023	1407	1370	1370
   q20	660	324	329	324
   q21	5185	3398	4073	3398
   q22	418	343	342	342
   Total cold run time: 114488 ms
   Total hot run time: 41134 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4573	4475	4446	4446
   q2	375	272	261	261
   q3	3135	2887	2976	2887
   q4	1913	1635	1643	1635
   q5	5487	5503	5496	5496
   q6	223	125	125	125
   q7	2189	1798	1826	1798
   q8	3204	3378	3425	3378
   q9	8608	8596	8736	8596
   q10	4092	3795	3732	3732
   q11	587	487	497	487
   q12	769	599	607	599
   q13	17170	3166	3130	3130
   q14	304	281	284	281
   q15	518	493	484	484
   q16	472	422	413	413
   q17	1785	1502	1475	1475
   q18	8099	7538	7497	7497
   q19	1792	1687	1528	1528
   q20	3012	1801	1776	1776
   q21	4794	4624	4733	4624
   q22	613	540	525	525
   Total cold run time: 73714 ms
   Total hot run time: 55173 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147174938

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org