You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "xiaokang (via GitHub)" <gi...@apache.org> on 2024/02/08 16:12:45 UTC

[PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

xiaokang opened a new pull request, #31003:
URL: https://github.com/apache/doris/pull/31003

   cherry pick from #30950


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940339738

   run buildall 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940433292

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 50594 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	19328	4418	4347	4347
   q2	2032	148	139	139
   q3	10452	1909	1915	1909
   q4	10329	1222	1309	1222
   q5	8474	4024	4025	4024
   q6	229	121	124	121
   q7	2052	1604	1639	1604
   q8	9605	2731	2724	2724
   q9	11333	11059	10980	10980
   q10	8976	3549	3516	3516
   q11	430	239	232	232
   q12	488	310	317	310
   q13	19756	4048	4087	4048
   q14	360	326	338	326
   q15	512	452	455	452
   q16	703	596	575	575
   q17	1110	971	960	960
   q18	7158	6779	6872	6779
   q19	1660	1547	1551	1547
   q20	545	309	308	308
   q21	4397	4087	4077	4077
   q22	498	394	402	394
   Total cold run time: 120427 ms
   Total hot run time: 50594 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4303	4297	4271	4271
   q2	320	223	224	223
   q3	4120	4135	4137	4135
   q4	2753	2743	2738	2738
   q5	7396	7206	7198	7198
   q6	232	120	117	117
   q7	3271	2902	2800	2800
   q8	4362	4494	4475	4475
   q9	17694	17450	17287	17287
   q10	4222	4262	4218	4218
   q11	766	713	660	660
   q12	1035	866	844	844
   q13	7163	3755	3712	3712
   q14	473	426	443	426
   q15	500	447	454	447
   q16	746	692	718	692
   q17	3872	3768	3805	3768
   q18	8701	8854	8741	8741
   q19	1701	1688	1657	1657
   q20	2378	2169	2090	2090
   q21	8541	8449	8541	8449
   q22	1040	953	943	943
   Total cold run time: 85589 ms
   Total hot run time: 79891 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1935309063

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940372606

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 235113 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9, data reload: false
   
   query1	931	390	383	383
   query2	6516	2113	2023	2023
   query3	6916	200	198	198
   query4	19864	18000	18024	18000
   query5	19706	6496	6475	6475
   query6	290	210	230	210
   query7	4303	296	286	286
   query8	292	227	243	227
   query9	3035	2631	2561	2561
   query10	432	296	297	296
   query11	11288	10741	10563	10563
   query12	123	76	72	72
   query13	5586	638	616	616
   query14	18422	13567	13396	13396
   query15	378	225	250	225
   query16	6405	265	264	264
   query17	1712	1455	871	871
   query18	2305	397	411	397
   query19	199	146	143	143
   query20	78	74	77	74
   query21	190	93	87	87
   query22	5334	4926	5221	4926
   query23	32483	31905	31882	31882
   query24	6777	6478	6477	6477
   query25	522	418	395	395
   query26	533	170	156	156
   query27	1850	292	287	287
   query28	6053	2180	2166	2166
   query29	2948	2869	2729	2729
   query30	238	157	158	157
   query31	879	739	736	736
   query32	66	59	58	58
   query33	393	238	251	238
   query34	837	452	468	452
   query35	1083	911	925	911
   query36	1568	1472	1291	1291
   query37	91	58	63	58
   query38	3104	2968	2947	2947
   query39	1370	1339	1326	1326
   query40	208	90	95	90
   query41	33	31	31	31
   query42	90	78	85	78
   query43	633	599	549	549
   query44	1084	701	706	701
   query45	241	229	223	223
   query46	1237	985	966	966
   query47	2085	1794	1944	1794
   query48	960	672	656	656
   query49	622	363	355	355
   query50	872	645	606	606
   query51	5570	5446	5404	5404
   query52	91	85	68	68
   query53	436	311	311	311
   query54	2625	2445	2418	2418
   query55	95	75	82	75
   query56	225	204	197	197
   query57	1202	1147	1013	1013
   query58	215	195	208	195
   query59	3720	3342	3119	3119
   query60	206	192	192	192
   query61	84	83	87	83
   query62	824	486	483	483
   query63	469	341	334	334
   query64	2496	1479	1373	1373
   query65	3641	3574	3581	3574
   query66	760	364	359	359
   query67	17893	15468	15155	15155
   query68	10471	645	660	645
   query69	575	344	333	333
   query70	2338	1566	1627	1566
   query71	409	289	297	289
   query72	6478	3368	3424	3368
   query73	718	330	314	314
   query74	6331	5866	5822	5822
   query75	5462	3623	3776	3623
   query76	6909	1133	1205	1133
   query77	1182	250	253	250
   query78	32231	51827	45303	45303
   query79	15156	627	632	627
   query80	5003	375	374	374
   query81	563	228	233	228
   query82	761	96	91	91
   query83	324	138	130	130
   query84	261	67	67	67
   query85	2550	282	273	273
   query86	483	355	367	355
   query87	3220	3008	2956	2956
   query88	6269	2307	2304	2304
   query89	397	284	278	278
   query90	2491	211	196	196
   query91	146	115	117	115
   query92	66	51	51	51
   query93	4728	551	565	551
   query94	1850	207	204	204
   query95	1103	1056	1051	1051
   query96	636	322	317	317
   query97	6419	6265	6344	6265
   query98	186	170	175	170
   query99	3912	921	903	903
   Total cold run time: 353345 ms
   Total hot run time: 235113 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940377510

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1936817241

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1934561071

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 14e3351dd5487343318dc343ff982948b5089531 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          60 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1934518393

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 49601 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 14e3351dd5487343318dc343ff982948b5089531, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17768	4398	4353	4353
   q2	2036	153	135	135
   q3	10445	1923	1859	1859
   q4	10396	1231	1303	1231
   q5	8840	3907	3983	3907
   q6	235	123	126	123
   q7	2020	1587	1587	1587
   q8	9345	2725	2713	2713
   q9	10739	10539	10215	10215
   q10	8637	3487	3471	3471
   q11	425	231	242	231
   q12	470	303	307	303
   q13	18362	3936	4040	3936
   q14	350	331	330	330
   q15	516	446	464	446
   q16	697	598	585	585
   q17	1127	973	944	944
   q18	7327	6909	7013	6909
   q19	1685	1531	1511	1511
   q20	510	317	306	306
   q21	4440	4137	4111	4111
   q22	506	407	395	395
   Total cold run time: 116876 ms
   Total hot run time: 49601 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4325	4344	4299	4299
   q2	318	221	224	221
   q3	4140	4098	4141	4098
   q4	2759	2737	2751	2737
   q5	7278	7231	7217	7217
   q6	235	121	120	120
   q7	3212	2784	2838	2784
   q8	4358	4466	4413	4413
   q9	17023	16905	16879	16879
   q10	4196	4232	4284	4232
   q11	778	706	669	669
   q12	1026	832	854	832
   q13	6973	3758	3747	3747
   q14	453	425	423	423
   q15	507	449	455	449
   q16	749	697	695	695
   q17	3786	3910	3892	3892
   q18	8785	8654	8864	8654
   q19	1709	1693	1611	1611
   q20	2395	2085	2154	2085
   q21	8599	8520	8791	8520
   q22	1002	968	982	968
   Total cold run time: 84606 ms
   Total hot run time: 79545 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940452940

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9 with default session variables
   Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940332966

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940445187

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 239460 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9, data reload: false
   
   query1	918	386	378	378
   query2	6537	2127	1884	1884
   query3	6923	194	194	194
   query4	20442	17883	17937	17883
   query5	19723	6479	6510	6479
   query6	290	212	228	212
   query7	4148	309	291	291
   query8	256	234	242	234
   query9	3031	2658	2561	2561
   query10	411	298	290	290
   query11	11372	10752	10696	10696
   query12	118	72	72	72
   query13	5572	649	623	623
   query14	18107	13438	13384	13384
   query15	351	223	233	223
   query16	6430	260	264	260
   query17	1723	1459	851	851
   query18	2333	402	400	400
   query19	208	138	142	138
   query20	74	81	76	76
   query21	183	92	95	92
   query22	5375	5148	5131	5131
   query23	32380	31715	31751	31715
   query24	6903	6443	6519	6443
   query25	526	416	415	415
   query26	524	172	160	160
   query27	1863	290	298	290
   query28	6060	2201	2196	2196
   query29	3066	2829	2859	2829
   query30	240	160	161	160
   query31	876	722	749	722
   query32	62	63	60	60
   query33	387	252	247	247
   query34	842	452	470	452
   query35	1128	921	972	921
   query36	1737	1641	1384	1384
   query37	89	70	58	58
   query38	3045	2907	2947	2907
   query39	1353	1302	1315	1302
   query40	197	99	97	97
   query41	35	35	34	34
   query42	84	81	81	81
   query43	640	669	568	568
   query44	1097	716	712	712
   query45	238	227	227	227
   query46	1237	972	964	964
   query47	1783	1752	1854	1752
   query48	973	655	648	648
   query49	617	367	375	367
   query50	869	598	670	598
   query51	5523	5397	5436	5397
   query52	93	79	81	79
   query53	439	314	306	306
   query54	2622	2477	2445	2445
   query55	73	80	87	80
   query56	220	223	190	190
   query57	1276	1232	1033	1033
   query58	203	207	199	199
   query59	3518	3133	2990	2990
   query60	206	207	209	207
   query61	85	88	85	85
   query62	803	511	457	457
   query63	474	333	326	326
   query64	2493	1527	1305	1305
   query65	3605	3561	3552	3552
   query66	763	375	366	366
   query67	15425	15514	15115	15115
   query68	9153	644	654	644
   query69	574	340	345	340
   query70	1786	1933	1665	1665
   query71	411	295	311	295
   query72	6665	3488	3396	3396
   query73	717	315	320	315
   query74	6269	5986	5850	5850
   query75	5326	3700	3618	3618
   query76	5574	1139	1182	1139
   query77	942	252	251	251
   query78	31772	50988	49603	49603
   query79	15194	640	622	622
   query80	4666	392	377	377
   query81	571	228	231	228
   query82	1275	104	96	96
   query83	335	133	145	133
   query84	260	68	69	68
   query85	1703	285	282	282
   query86	445	361	345	345
   query87	3272	3041	2968	2968
   query88	6973	2279	2314	2279
   query89	416	289	294	289
   query90	2500	207	198	198
   query91	164	125	126	125
   query92	65	51	48	48
   query93	5488	586	545	545
   query94	1658	210	209	209
   query95	1104	1066	1055	1055
   query96	654	332	328	328
   query97	6667	6290	6437	6290
   query98	190	175	170	170
   query99	3660	896	954	896
   Total cold run time: 347646 ms
   Total hot run time: 239460 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1934555430

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.43 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 14e3351dd5487343318dc343ff982948b5089531, data reload: false
   
   query1	0.03	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.25	0.05	0.05
   query4	1.83	0.06	0.07
   query5	0.53	0.53	0.52
   query6	1.26	0.60	0.59
   query7	0.02	0.02	0.01
   query8	0.04	0.03	0.02
   query9	0.52	0.48	0.48
   query10	0.54	0.54	0.53
   query11	0.12	0.08	0.09
   query12	0.11	0.09	0.09
   query13	0.62	0.62	0.62
   query14	0.81	0.79	0.78
   query15	0.78	0.74	0.77
   query16	0.37	0.39	0.36
   query17	1.01	1.02	1.03
   query18	0.23	0.25	0.24
   query19	1.97	1.86	1.77
   query20	0.02	0.00	0.00
   query21	15.47	0.57	0.56
   query22	2.03	1.89	1.17
   query23	17.36	1.09	0.95
   query24	4.06	2.84	1.12
   query25	1.54	0.12	0.11
   query26	0.29	0.15	0.14
   query27	0.10	0.11	0.11
   query28	7.02	0.73	0.74
   query29	12.76	2.33	2.30
   query30	0.56	0.50	0.49
   query31	2.82	0.37	0.39
   query32	3.40	0.50	0.49
   query33	3.10	3.04	3.09
   query34	15.28	4.83	4.77
   query35	4.85	4.86	4.83
   query36	1.16	1.01	1.02
   query37	0.05	0.05	0.04
   query38	0.03	0.02	0.02
   query39	0.02	0.01	0.01
   query40	0.16	0.15	0.13
   query41	0.07	0.02	0.02
   query42	0.01	0.01	0.01
   query43	0.02	0.01	0.01
   Total cold run time: 103.28 s
   Total hot run time: 30.43 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940450316

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.25 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9, data reload: false
   
   query1	0.02	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.25	0.05	0.05
   query4	1.82	0.06	0.05
   query5	0.53	0.52	0.52
   query6	1.23	0.62	0.61
   query7	0.01	0.01	0.01
   query8	0.04	0.03	0.02
   query9	0.52	0.48	0.49
   query10	0.54	0.54	0.54
   query11	0.11	0.08	0.09
   query12	0.11	0.09	0.08
   query13	0.61	0.61	0.61
   query14	0.79	0.78	0.79
   query15	0.77	0.76	0.78
   query16	0.36	0.39	0.36
   query17	0.97	1.02	1.01
   query18	0.24	0.25	0.24
   query19	1.90	1.85	1.88
   query20	0.01	0.01	0.00
   query21	15.48	0.56	0.55
   query22	2.17	2.18	1.79
   query23	17.48	1.02	1.07
   query24	4.48	1.26	1.21
   query25	1.54	0.12	0.10
   query26	0.25	0.15	0.14
   query27	0.11	0.11	0.11
   query28	7.96	0.72	0.72
   query29	12.62	2.31	2.12
   query30	0.60	0.54	0.57
   query31	2.82	0.37	0.38
   query32	3.41	0.48	0.50
   query33	3.07	3.05	3.08
   query34	15.26	4.83	4.83
   query35	4.91	4.85	4.85
   query36	1.06	1.03	1.02
   query37	0.05	0.05	0.04
   query38	0.04	0.02	0.02
   query39	0.02	0.02	0.02
   query40	0.16	0.14	0.14
   query41	0.06	0.02	0.01
   query42	0.02	0.01	0.01
   query43	0.02	0.02	0.02
   Total cold run time: 104.48 s
   Total hot run time: 31.25 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940412653

   run buildall 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940363398

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 49817 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18306	4485	4324	4324
   q2	2021	145	141	141
   q3	10287	1885	1910	1885
   q4	10365	1247	1329	1247
   q5	8602	3943	3999	3943
   q6	226	124	122	122
   q7	2047	1611	1620	1611
   q8	9270	2697	2695	2695
   q9	10780	10571	10406	10406
   q10	8602	3509	3479	3479
   q11	435	238	243	238
   q12	471	302	307	302
   q13	18376	3965	4059	3965
   q14	347	328	321	321
   q15	510	452	458	452
   q16	688	580	582	580
   q17	1113	970	939	939
   q18	7272	6876	6885	6876
   q19	1680	1600	1505	1505
   q20	530	322	318	318
   q21	4450	4067	4073	4067
   q22	510	401	403	401
   Total cold run time: 116888 ms
   Total hot run time: 49817 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4299	4328	4292	4292
   q2	323	222	226	222
   q3	4167	4136	4134	4134
   q4	2754	2718	2764	2718
   q5	7241	7172	7202	7172
   q6	234	115	115	115
   q7	3220	2884	2901	2884
   q8	4326	4463	4447	4447
   q9	17062	16964	16943	16943
   q10	4246	4235	4249	4235
   q11	764	684	700	684
   q12	1013	846	839	839
   q13	6830	3748	3728	3728
   q14	449	435	415	415
   q15	500	462	450	450
   q16	763	698	697	697
   q17	3860	3848	3862	3848
   q18	8704	8780	8828	8780
   q19	1686	1705	1641	1641
   q20	2448	2145	2129	2129
   q21	8498	8467	8465	8465
   q22	1036	982	977	977
   Total cold run time: 84423 ms
   Total hot run time: 79815 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1940375633

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.53 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit f72d3cdd90024e6ac6e5b6d63eafee98c03f03f9, data reload: false
   
   query1	0.02	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.25	0.05	0.04
   query4	1.82	0.07	0.07
   query5	0.52	0.51	0.52
   query6	1.36	0.61	0.61
   query7	0.02	0.02	0.01
   query8	0.03	0.02	0.02
   query9	0.52	0.47	0.47
   query10	0.54	0.52	0.53
   query11	0.10	0.08	0.09
   query12	0.11	0.08	0.09
   query13	0.62	0.61	0.61
   query14	0.78	0.80	0.78
   query15	0.77	0.76	0.76
   query16	0.40	0.37	0.37
   query17	0.98	1.00	1.01
   query18	0.23	0.25	0.22
   query19	1.91	1.85	1.86
   query20	0.02	0.01	0.01
   query21	15.46	0.60	0.56
   query22	1.82	2.03	1.53
   query23	17.19	1.14	0.92
   query24	6.70	0.87	0.92
   query25	1.59	0.12	0.11
   query26	0.31	0.16	0.14
   query27	0.11	0.10	0.10
   query28	6.59	0.73	0.74
   query29	12.67	2.26	2.30
   query30	0.61	0.48	0.53
   query31	2.82	0.37	0.39
   query32	3.41	0.49	0.49
   query33	3.04	3.10	3.05
   query34	15.28	4.83	4.78
   query35	4.86	4.85	4.82
   query36	1.04	1.00	1.02
   query37	0.06	0.05	0.05
   query38	0.03	0.02	0.02
   query39	0.01	0.02	0.02
   query40	0.15	0.15	0.14
   query41	0.06	0.01	0.01
   query42	0.01	0.02	0.02
   query43	0.02	0.02	0.01
   Total cold run time: 104.9 s
   Total hot run time: 30.53 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #31003:
URL: https://github.com/apache/doris/pull/31003


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1934544839

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 235794 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 14e3351dd5487343318dc343ff982948b5089531, data reload: false
   
   query1	925	385	375	375
   query2	6533	2343	2074	2074
   query3	6917	198	194	194
   query4	20110	17983	18083	17983
   query5	19713	6533	6534	6533
   query6	281	211	225	211
   query7	4153	293	288	288
   query8	265	257	239	239
   query9	3081	2671	2622	2622
   query10	427	294	285	285
   query11	11332	10775	10686	10686
   query12	118	72	74	72
   query13	5569	633	622	622
   query14	17804	13688	13621	13621
   query15	357	242	227	227
   query16	6427	260	273	260
   query17	1715	1466	869	869
   query18	2311	402	400	400
   query19	197	141	140	140
   query20	77	76	76	76
   query21	188	99	93	93
   query22	5301	5032	5019	5019
   query23	32549	31814	31762	31762
   query24	6940	6518	6474	6474
   query25	513	416	423	416
   query26	499	161	153	153
   query27	1813	294	290	290
   query28	6072	2203	2159	2159
   query29	2834	2865	2832	2832
   query30	237	159	159	159
   query31	882	747	745	745
   query32	61	64	63	63
   query33	389	252	238	238
   query34	846	463	485	463
   query35	1116	926	911	911
   query36	1924	1474	1807	1474
   query37	85	60	63	60
   query38	3073	2943	2919	2919
   query39	1355	1303	1325	1303
   query40	200	91	96	91
   query41	35	32	31	31
   query42	92	91	81	81
   query43	622	638	588	588
   query44	1154	713	713	713
   query45	239	226	227	226
   query46	1245	987	966	966
   query47	1877	1725	1662	1662
   query48	976	690	664	664
   query49	610	368	355	355
   query50	872	612	594	594
   query51	5593	5343	5415	5343
   query52	86	89	75	75
   query53	442	320	337	320
   query54	2639	2442	2390	2390
   query55	91	73	80	73
   query56	215	200	205	200
   query57	1180	1057	1171	1057
   query58	212	195	194	194
   query59	3550	3223	3187	3187
   query60	202	192	201	192
   query61	82	79	83	79
   query62	737	569	462	462
   query63	476	339	332	332
   query64	2385	1457	1378	1378
   query65	3628	3533	3550	3533
   query66	768	370	354	354
   query67	16020	16002	14960	14960
   query68	8459	639	649	639
   query69	565	334	355	334
   query70	1930	1533	1540	1533
   query71	399	297	302	297
   query72	6540	3404	3411	3404
   query73	720	314	316	314
   query74	6349	5870	5790	5790
   query75	5114	3669	3791	3669
   query76	5182	1155	1182	1155
   query77	851	246	276	246
   query78	32781	51600	45412	45412
   query79	16029	641	623	623
   query80	5212	370	375	370
   query81	559	241	231	231
   query82	1068	98	94	94
   query83	418	133	132	132
   query84	259	71	67	67
   query85	2643	272	270	270
   query86	477	375	372	372
   query87	3313	2989	2998	2989
   query88	6835	2290	2302	2290
   query89	443	278	286	278
   query90	2521	206	200	200
   query91	151	120	116	116
   query92	61	47	49	47
   query93	6251	524	579	524
   query94	1851	207	204	204
   query95	1121	1057	1054	1054
   query96	626	331	323	323
   query97	6520	6335	6314	6314
   query98	193	169	173	169
   query99	3957	924	952	924
   Total cold run time: 350615 ms
   Total hot run time: 235794 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1934461222

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](index) Replace BITMAP INDEX with INVERTED INDEX #30950 [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang commented on PR #31003:
URL: https://github.com/apache/doris/pull/31003#issuecomment-1934461113

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org