You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "airborne12 (via GitHub)" <gi...@apache.org> on 2024/09/03 09:22:52 UTC

[PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

airborne12 opened a new pull request, #40324:
URL: https://github.com/apache/doris/pull/40324

   ## Proposed changes
   Make profile metrics right after #38908 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326090904

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38220 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit eb741fae9a32f1641293364cb0add90c691b0ad4, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18223	4434	4306	4306
   q2	2026	177	178	177
   q3	10479	1173	1066	1066
   q4	10132	824	813	813
   q5	7709	2866	2795	2795
   q6	230	138	140	138
   q7	964	622	598	598
   q8	9328	2042	2077	2042
   q9	7008	6548	6540	6540
   q10	7000	2225	2174	2174
   q11	467	246	251	246
   q12	393	226	223	223
   q13	17994	3099	3150	3099
   q14	289	238	253	238
   q15	514	480	494	480
   q16	578	538	514	514
   q17	955	691	664	664
   q18	7397	6839	6770	6770
   q19	1375	1073	1114	1073
   q20	665	343	318	318
   q21	3809	3018	2952	2952
   q22	1125	994	1025	994
   Total cold run time: 108660 ms
   Total hot run time: 38220 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4309	4311	4342	4311
   q2	379	270	285	270
   q3	2901	2634	2654	2634
   q4	1936	1667	1639	1639
   q5	5447	5401	5395	5395
   q6	224	130	132	130
   q7	2094	1731	1771	1731
   q8	3223	3366	3333	3333
   q9	8470	8494	8444	8444
   q10	3452	3196	3160	3160
   q11	600	503	514	503
   q12	815	620	623	620
   q13	11975	3114	3089	3089
   q14	306	277	278	277
   q15	537	471	487	471
   q16	635	569	581	569
   q17	1792	1515	1453	1453
   q18	7725	7406	7553	7406
   q19	1660	1582	1549	1549
   q20	2063	1840	1824	1824
   q21	5445	5273	5224	5224
   q22	1166	1020	1053	1020
   Total cold run time: 67154 ms
   Total hot run time: 55052 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 merged PR #40324:
URL: https://github.com/apache/doris/pull/40324


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326051543

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326031711

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326127078

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 32.19 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit eb741fae9a32f1641293364cb0add90c691b0ad4, data reload: false
   
   query1	0.04	0.04	0.05
   query2	0.09	0.03	0.04
   query3	0.22	0.06	0.05
   query4	1.64	0.08	0.08
   query5	0.51	0.50	0.50
   query6	1.14	0.73	0.73
   query7	0.02	0.01	0.02
   query8	0.04	0.04	0.05
   query9	0.55	0.48	0.49
   query10	0.55	0.54	0.53
   query11	0.15	0.12	0.12
   query12	0.15	0.13	0.12
   query13	0.60	0.59	0.59
   query14	2.05	2.07	2.13
   query15	0.89	0.83	0.82
   query16	0.36	0.38	0.35
   query17	0.98	0.98	1.02
   query18	0.22	0.20	0.20
   query19	1.86	1.72	1.72
   query20	0.01	0.02	0.01
   query21	15.40	0.69	0.66
   query22	3.79	7.94	1.88
   query23	18.28	1.48	1.34
   query24	2.10	0.22	0.22
   query25	0.15	0.08	0.08
   query26	0.27	0.18	0.18
   query27	0.07	0.08	0.07
   query28	13.26	1.02	1.00
   query29	12.56	3.41	3.45
   query30	0.24	0.06	0.07
   query31	2.85	0.41	0.40
   query32	3.24	0.48	0.48
   query33	2.97	2.99	3.06
   query34	16.97	4.47	4.43
   query35	4.46	4.48	4.45
   query36	0.67	0.49	0.48
   query37	0.19	0.15	0.16
   query38	0.16	0.15	0.15
   query39	0.05	0.04	0.04
   query40	0.15	0.12	0.13
   query41	0.10	0.05	0.05
   query42	0.06	0.04	0.04
   query43	0.05	0.04	0.04
   Total cold run time: 110.11 s
   Total hot run time: 32.19 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326308782

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326031486

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326045260

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](inverted index) fix profile metrics for inverted index after refactor [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40324:
URL: https://github.com/apache/doris/pull/40324#issuecomment-2326114529

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 188525 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit eb741fae9a32f1641293364cb0add90c691b0ad4, data reload: false
   
   query1	925	375	367	367
   query2	6464	1923	1988	1923
   query3	6647	207	214	207
   query4	31080	23276	23283	23276
   query5	4155	521	500	500
   query6	255	164	163	163
   query7	4593	296	289	289
   query8	245	210	198	198
   query9	8648	2486	2462	2462
   query10	442	284	270	270
   query11	18039	15041	14977	14977
   query12	152	95	96	95
   query13	1628	383	367	367
   query14	8835	6961	7509	6961
   query15	270	165	175	165
   query16	7456	464	470	464
   query17	1620	560	561	560
   query18	1998	306	293	293
   query19	296	149	150	149
   query20	121	111	110	110
   query21	214	105	107	105
   query22	4492	4200	4186	4186
   query23	34259	33950	33593	33593
   query24	11318	2837	2873	2837
   query25	608	380	383	380
   query26	1200	154	173	154
   query27	2724	289	275	275
   query28	7421	2058	2034	2034
   query29	776	419	421	419
   query30	317	161	166	161
   query31	976	725	792	725
   query32	93	57	53	53
   query33	751	279	288	279
   query34	934	469	490	469
   query35	847	714	724	714
   query36	1095	941	951	941
   query37	164	95	95	95
   query38	4024	3841	3943	3841
   query39	1449	1411	1384	1384
   query40	201	117	113	113
   query41	49	46	71	46
   query42	115	91	98	91
   query43	520	474	477	474
   query44	1201	739	741	739
   query45	202	165	169	165
   query46	1113	724	748	724
   query47	1853	1783	1808	1783
   query48	377	292	287	287
   query49	1100	427	431	427
   query50	820	426	415	415
   query51	7048	6865	6885	6865
   query52	97	90	86	86
   query53	256	182	179	179
   query54	989	461	457	457
   query55	74	76	83	76
   query56	278	266	255	255
   query57	1189	1090	1077	1077
   query58	247	236	242	236
   query59	2965	2893	2774	2774
   query60	296	270	275	270
   query61	99	99	102	99
   query62	819	663	659	659
   query63	210	186	181	181
   query64	4441	673	734	673
   query65	3241	3168	3185	3168
   query66	1455	345	345	345
   query67	15636	15338	15296	15296
   query68	3123	583	571	571
   query69	452	291	278	278
   query70	1159	1179	1045	1045
   query71	343	272	278	272
   query72	6346	4061	4061	4061
   query73	735	324	339	324
   query74	9153	8921	8858	8858
   query75	3376	2693	2675	2675
   query76	1878	1022	968	968
   query77	513	320	324	320
   query78	11268	9392	9961	9392
   query79	1131	542	538	538
   query80	766	506	505	505
   query81	559	236	234	234
   query82	806	147	142	142
   query83	253	160	156	156
   query84	227	83	75	75
   query85	762	289	276	276
   query86	309	303	300	300
   query87	4443	4314	4389	4314
   query88	2990	2331	2324	2324
   query89	387	289	282	282
   query90	2038	197	199	197
   query91	131	102	103	102
   query92	61	49	49	49
   query93	1047	526	529	526
   query94	907	296	294	294
   query95	355	259	258	258
   query96	587	266	264	264
   query97	3243	3109	3055	3055
   query98	226	210	197	197
   query99	1459	1293	1272	1272
   Total cold run time: 285455 ms
   Total hot run time: 188525 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org