You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "qidaye (via GitHub)" <gi...@apache.org> on 2024/01/04 12:53:06 UTC

[PR] [feature](inverted index)Support failover when index compaction failed [doris]

qidaye opened a new pull request, #29553:
URL: https://github.com/apache/doris/pull/29553

   ## Proposed changes
   
   When index compaction is failed, be will core and we need turn off the config `inverted_index_compaction_enabled` manually.
   In this PR, we introduce failover for index compaction. When index compaction is failed for the first time, the input rowsets will be marked and will skip index compaction in next compaction round.
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877161550

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 9af6dd3922c6ed338ed0fdd80e3b2366e413d86b, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5505	5180	5160	5160
   q2	382	200	150	150
   q3	1458	1169	1112	1112
   q4	1084	836	821	821
   q5	3102	3122	3105	3105
   q6	221	137	140	137
   q7	982	573	520	520
   q8	2153	2291	2256	2256
   q9	6682	6687	6666	6666
   q10	3170	3124	3076	3076
   q11	344	211	224	211
   q12	378	232	236	232
   q13	4382	3667	3659	3659
   q14	253	218	214	214
   q15	572	549	526	526
   q16	467	396	416	396
   q17	1044	557	505	505
   q18	7076	6756	6771	6756
   q19	1641	1518	1604	1518
   q20	582	350	364	350
   q21	2916	2561	2499	2499
   q22	405	333	350	333
   Total cold run time: 44799 ms
   Total hot run time: 40202 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5133	5076	5091	5076
   q2	339	234	233	233
   q3	3372	3329	3338	3329
   q4	2144	2035	2064	2035
   q5	5977	5928	5933	5928
   q6	231	129	135	129
   q7	2379	1938	1936	1936
   q8	3562	3656	3676	3656
   q9	9093	9040	8982	8982
   q10	3851	3926	3918	3918
   q11	586	490	508	490
   q12	802	626	634	626
   q13	3913	3231	3205	3205
   q14	299	295	262	262
   q15	592	533	530	530
   q16	570	515	503	503
   q17	2046	1853	1798	1798
   q18	8712	8334	8661	8334
   q19	1738	1674	1669	1669
   q20	2288	1983	1981	1981
   q21	5788	5362	5372	5362
   q22	560	481	473	473
   Total cold run time: 63975 ms
   Total hot run time: 60455 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on code in PR #29553:
URL: https://github.com/apache/doris/pull/29553#discussion_r1442656368


##########
be/src/olap/rowset/rowset.h:
##########
@@ -327,6 +330,9 @@ class Rowset : public std::enable_shared_from_this<Rowset> {
     // rowset state machine
     RowsetStateMachine _rowset_state_machine;
     std::atomic<uint64_t> _delayed_expired_timestamp = 0;
+
+    // skip inverted index
+    bool skip_inverted_index = false;

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1880386025

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877169784

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.31 seconds
    stream load tsv:          575 seconds loaded 74807831229 Bytes, about 124 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.0 seconds inserted 10000000 Rows, about 357K ops/s
    storage size: 17184015454 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878062956

   TeamCity be ut coverage result:
    Function Coverage: 36.66% (8623/23521) 
    Line Coverage: 28.69% (70082/244289)
    Region Coverage: 27.67% (36282/131118)
    Branch Coverage: 24.37% (18535/76070)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/9ed83aa5b98e1faa6725193d7d2b6a16be20cded_9ed83aa5b98e1faa6725193d7d2b6a16be20cded/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878437567

   
   TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
   ```
   TPC-DS sf100 test result on commit 482152328d3a5a0114a0b73b727d4f4038f474a8, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	915	344	341	341
   query2	6420	1971	1973	1971
   query3	6665	210	206	206
   query4	26493	22419	22236	22236
   query5	3883	552	540	540
   query6	265	181	175	175
   query7	4583	263	275	263
   query8	239	215	197	197
   query9	8219	2565	2511	2511
   query10	433	239	232	232
   query11	16111	15537	15475	15475
   query12	128	77	73	73
   query13	1627	330	319	319
   query14	11395	7101	7244	7101
   query15	229	196	190	190
   query16	6416	264	259	259
   query17	1892	489	482	482
   query18	1937	270	252	252
   query19	184	132	130	130
   query20	80	77	74	74
   query21	182	97	94	94
   query22	4880	4775	4859	4775
   query23	32219	31368	31316	31316
   query24	12187	2834	2770	2770
   query25	576	339	327	327
   query26	1761	145	131	131
   query27	2881	270	269	269
   query28	6923	1898	1891	1891
   query29	2069	374	377	374
   query30	286	144	146	144
   query31	974	765	791	765
   query32	90	56	53	53
   query33	735	271	262	262
   query34	890	440	446	440
   query35	839	763	777	763
   query36	1307	1292	1214	1214
   query37	181	68	67	67
   query38	3424	3258	3300	3258
   query39	1324	1290	1272	1272
   query40	305	89	90	89
   query41	37	34	35	34
   query42	87	78	99	78
   query43	517	494	494	494
   query44	1038	700	710	700
   query45	194	188	180	180
   query46	1057	655	631	631
   query47	1663	1538	1512	1512
   query48	338	268	245	245
   query49	1215	312	319	312
   query50	742	330	319	319
   query51	5445	5258	5216	5216
   query52	93	88	82	82
   query53	215	140	145	140
   query54	1441	559	562	559
   query55	94	88	76	76
   query56	180	185	196	185
   query57	986	944	950	944
   query58	223	198	197	197
   query59	2778	2632	2608	2608
   query60	221	203	220	203
   query61	82	80	81	80
   query62	675	458	441	441
   query63	165	143	146	143
   query64	5881	1688	1707	1688
   query65	3326	3257	3247	3247
   query66	1388	351	361	351
   query67	15510	15350	15385	15350
   query68	11602	506	524	506
   query69	509	246	254	246
   query70	1729	1495	1516	1495
   query71	495	218	219	218
   query72	5547	3529	3563	3529
   query73	2491	317	320	317
   query74	6980	6356	6449	6356
   query75	4875	2296	2246	2246
   query76	6247	1099	1070	1070
   query77	667	253	283	253
   query78	9162	8799	8739	8739
   query79	1030	508	515	508
   query80	523	350	337	337
   query81	458	210	205	205
   query82	205	95	89	89
   query83	156	134	138	134
   query84	242	53	52	52
   query85	940	275	260	260
   query86	384	414	390	390
   query87	3525	3406	3340	3340
   query88	2862	2265	2278	2265
   query89	331	257	237	237
   query90	1894	191	198	191
   query91	114	94	89	89
   query92	59	51	54	51
   query93	1857	434	422	422
   query94	876	178	174	174
   query95	454	402	410	402
   query96	629	322	329	322
   query97	4276	4137	4146	4137
   query98	215	197	195	195
   query99	1108	865	826	826
   Total cold run time: 290180 ms
   Total hot run time: 178917 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878476458

   TeamCity be ut coverage result:
    Function Coverage: 36.64% (8619/23526) 
    Line Coverage: 28.66% (70048/244386)
    Region Coverage: 27.64% (36250/131155)
    Branch Coverage: 24.33% (18516/76098)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/482152328d3a5a0114a0b73b727d4f4038f474a8_482152328d3a5a0114a0b73b727d4f4038f474a8/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878728738

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878003887

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878373118

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878491156

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 482152328d3a5a0114a0b73b727d4f4038f474a8, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5480	5111	5131	5111
   q2	402	153	157	153
   q3	1467	1214	1161	1161
   q4	1080	801	772	772
   q5	3158	3121	3188	3121
   q6	221	134	135	134
   q7	961	558	521	521
   q8	2162	2213	2286	2213
   q9	6718	6658	6667	6658
   q10	3198	3141	3154	3141
   q11	337	209	229	209
   q12	388	233	237	233
   q13	4406	3641	3687	3641
   q14	258	228	213	213
   q15	586	546	526	526
   q16	437	388	399	388
   q17	1054	571	616	571
   q18	7125	6757	6858	6757
   q19	1646	1518	1473	1473
   q20	546	396	314	314
   q21	2910	2389	2560	2389
   q22	394	316	341	316
   Total cold run time: 44934 ms
   Total hot run time: 40015 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5085	5053	5143	5053
   q2	340	233	236	233
   q3	3352	3349	3301	3301
   q4	2153	2047	2071	2047
   q5	5980	5926	5922	5922
   q6	222	125	133	125
   q7	2378	1939	1924	1924
   q8	3544	3644	3678	3644
   q9	9069	8991	9032	8991
   q10	3854	3887	3909	3887
   q11	593	471	489	471
   q12	794	641	637	637
   q13	3879	3256	3201	3201
   q14	313	298	256	256
   q15	584	521	540	521
   q16	576	522	519	519
   q17	2026	1795	1814	1795
   q18	8726	8283	8366	8283
   q19	1726	1687	1699	1687
   q20	2269	1986	1973	1973
   q21	5771	5334	5353	5334
   q22	556	501	481	481
   Total cold run time: 63790 ms
   Total hot run time: 60285 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877164138

   
   TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
   ```
   TPC-DS sf100 test result on commit 9af6dd3922c6ed338ed0fdd80e3b2366e413d86b, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	938	341	332	332
   query2	6442	1987	2085	1987
   query3	6644	205	201	201
   query4	27302	22320	22491	22320
   query5	3878	501	503	501
   query6	263	182	176	176
   query7	4575	279	268	268
   query8	221	201	195	195
   query9	8228	2536	2522	2522
   query10	433	243	225	225
   query11	16234	15756	15582	15582
   query12	131	73	76	73
   query13	1635	319	307	307
   query14	11948	7090	7018	7018
   query15	212	186	185	185
   query16	6261	268	255	255
   query17	1864	490	496	490
   query18	1898	266	267	266
   query19	189	128	133	128
   query20	77	75	75	75
   query21	183	96	97	96
   query22	4871	4622	4598	4598
   query23	32082	31304	31236	31236
   query24	11973	2800	2804	2800
   query25	602	345	346	345
   query26	1807	141	141	141
   query27	2878	269	271	269
   query28	7045	1879	1900	1879
   query29	2144	382	391	382
   query30	284	149	155	149
   query31	1054	776	753	753
   query32	86	57	57	57
   query33	731	246	263	246
   query34	904	460	449	449
   query35	854	774	751	751
   query36	1379	1254	1222	1222
   query37	186	70	65	65
   query38	3415	3260	3268	3260
   query39	1321	1290	1273	1273
   query40	303	85	84	84
   query41	38	36	34	34
   query42	86	78	88	78
   query43	530	519	507	507
   query44	1047	688	696	688
   query45	192	191	189	189
   query46	1043	644	665	644
   query47	1668	1561	1573	1561
   query48	322	261	251	251
   query49	1231	311	326	311
   query50	732	357	325	325
   query51	5362	5247	5348	5247
   query52	90	88	88	88
   query53	209	149	141	141
   query54	1349	568	586	568
   query55	98	84	80	80
   query56	184	187	196	187
   query57	1053	935	906	906
   query58	222	208	203	203
   query59	2846	2647	2628	2628
   query60	241	218	228	218
   query61	89	105	87	87
   query62	639	447	463	447
   query63	177	147	144	144
   query64	5947	1693	1723	1693
   query65	3314	3257	3250	3250
   query66	1405	345	332	332
   query67	15639	15263	15035	15035
   query68	12946	500	518	500
   query69	502	246	259	246
   query70	2091	1528	1473	1473
   query71	490	212	222	212
   query72	5704	3603	3574	3574
   query73	3248	314	312	312
   query74	7040	6461	6433	6433
   query75	5305	2259	2290	2259
   query76	6320	1140	1117	1117
   query77	646	252	275	252
   query78	9044	8703	8435	8435
   query79	1053	494	502	494
   query80	529	349	340	340
   query81	461	212	212	212
   query82	208	106	90	90
   query83	175	138	136	136
   query84	252	55	52	52
   query85	950	281	272	272
   query86	434	362	407	362
   query87	3586	3386	3327	3327
   query88	3046	2272	2263	2263
   query89	335	266	255	255
   query90	1890	196	191	191
   query91	127	91	94	91
   query92	59	51	49	49
   query93	1406	486	489	486
   query94	805	181	180	180
   query95	461	412	412	412
   query96	636	325	320	320
   query97	4298	4156	4160	4156
   query98	212	191	189	189
   query99	1108	814	812	812
   Total cold run time: 294595 ms
   Total hot run time: 178505 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878366745

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878422220

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 482152328d3a5a0114a0b73b727d4f4038f474a8, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18898	5714	5468	5468
   q2	2027	165	151	151
   q3	10596	1216	1155	1155
   q4	10248	862	894	862
   q5	7849	3177	2988	2988
   q6	240	141	140	140
   q7	1002	532	555	532
   q8	9309	2267	2300	2267
   q9	7185	6726	6668	6668
   q10	8336	3154	3135	3135
   q11	440	222	220	220
   q12	428	237	232	232
   q13	18032	3651	3665	3651
   q14	256	211	210	210
   q15	573	537	524	524
   q16	471	394	427	394
   q17	1042	512	527	512
   q18	7557	6762	6697	6697
   q19	1786	1612	1560	1560
   q20	719	348	312	312
   q21	3083	2556	2608	2556
   q22	406	329	335	329
   Total cold run time: 110483 ms
   Total hot run time: 40563 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5485	5413	5368	5368
   q2	358	255	238	238
   q3	3443	3413	3402	3402
   q4	2274	2164	2145	2145
   q5	6082	6051	6024	6024
   q6	243	130	135	130
   q7	2392	1907	1965	1907
   q8	3603	3739	3702	3702
   q9	8957	8893	8883	8883
   q10	3916	3979	3966	3966
   q11	585	495	491	491
   q12	837	646	639	639
   q13	7248	3195	3224	3195
   q14	301	267	272	267
   q15	590	530	530	530
   q16	622	540	521	521
   q17	2072	1882	1868	1868
   q18	8879	8603	8479	8479
   q19	1852	1815	1778	1778
   q20	2235	1982	1949	1949
   q21	5895	5622	5570	5570
   q22	571	508	503	503
   Total cold run time: 68440 ms
   Total hot run time: 61555 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878440772

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 46.15 seconds
    stream load tsv:          578 seconds loaded 74807831229 Bytes, about 123 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          27.3 seconds inserted 10000000 Rows, about 366K ops/s
    storage size: 17184202167 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #29553:
URL: https://github.com/apache/doris/pull/29553


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1880299529

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877147333

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 9af6dd3922c6ed338ed0fdd80e3b2366e413d86b, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17678	5454	5081	5081
   q2	2011	154	140	140
   q3	10539	1105	1163	1105
   q4	10180	783	833	783
   q5	7795	3003	2903	2903
   q6	217	132	132	132
   q7	935	509	527	509
   q8	9255	2044	2032	2032
   q9	6912	6410	6401	6401
   q10	8269	3049	3044	3044
   q11	426	218	212	212
   q12	394	232	230	230
   q13	18014	3591	3614	3591
   q14	237	223	215	215
   q15	565	520	520	520
   q16	449	391	402	391
   q17	987	475	429	429
   q18	7326	6738	6680	6680
   q19	1570	1436	1409	1409
   q20	751	331	330	330
   q21	2856	2408	2453	2408
   q22	392	320	344	320
   Total cold run time: 107758 ms
   Total hot run time: 38865 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5079	5108	5073	5073
   q2	338	236	247	236
   q3	3300	3293	3288	3288
   q4	2146	2048	2030	2030
   q5	5842	5806	5801	5801
   q6	216	124	126	124
   q7	2340	1902	1955	1902
   q8	3357	3420	3487	3420
   q9	8791	8840	8838	8838
   q10	3828	3850	3856	3850
   q11	600	492	491	491
   q12	788	626	647	626
   q13	8847	3164	3229	3164
   q14	313	285	264	264
   q15	582	529	526	526
   q16	547	502	526	502
   q17	1971	1787	1785	1785
   q18	8674	8333	8406	8333
   q19	1632	1569	1597	1569
   q20	2196	1971	1974	1971
   q21	5589	5328	5312	5312
   q22	580	457	520	457
   Total cold run time: 67556 ms
   Total hot run time: 59562 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878050567

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.36 seconds
    stream load tsv:          566 seconds loaded 74807831229 Bytes, about 126 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          65 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          27.3 seconds inserted 10000000 Rows, about 366K ops/s
    storage size: 17184170785 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878372970

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1880299479

   run pipelinex_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878048162

   
   TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
   ```
   TPC-DS sf100 test result on commit 9ed83aa5b98e1faa6725193d7d2b6a16be20cded, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	944	357	334	334
   query2	6423	1913	1852	1852
   query3	6646	208	203	203
   query4	27997	22504	22332	22332
   query5	3955	549	535	535
   query6	277	179	184	179
   query7	4580	268	266	266
   query8	223	214	196	196
   query9	8228	2519	2523	2519
   query10	394	245	257	245
   query11	16160	15419	15569	15419
   query12	129	77	75	75
   query13	1623	322	314	314
   query14	11346	7189	7158	7158
   query15	224	185	192	185
   query16	6339	272	275	272
   query17	1873	491	490	490
   query18	1936	270	265	265
   query19	179	133	137	133
   query20	77	81	77	77
   query21	184	98	97	97
   query22	4875	4835	4724	4724
   query23	32255	31213	31599	31213
   query24	11972	2856	2821	2821
   query25	598	346	330	330
   query26	1767	145	138	138
   query27	2910	273	268	268
   query28	6967	1877	1886	1877
   query29	2117	383	384	383
   query30	290	142	157	142
   query31	1030	781	786	781
   query32	84	59	55	55
   query33	737	285	255	255
   query34	903	454	446	446
   query35	934	790	767	767
   query36	1327	1240	1226	1226
   query37	189	62	74	62
   query38	3410	3349	3264	3264
   query39	1325	1300	1291	1291
   query40	304	91	89	89
   query41	37	36	41	36
   query42	91	79	80	79
   query43	513	481	495	481
   query44	1074	691	712	691
   query45	197	190	188	188
   query46	1068	634	641	634
   query47	1703	1521	1543	1521
   query48	334	258	258	258
   query49	1200	315	324	315
   query50	741	330	333	330
   query51	5334	5330	5200	5200
   query52	93	90	80	80
   query53	213	148	145	145
   query54	1440	574	555	555
   query55	101	80	90	80
   query56	202	188	189	188
   query57	1001	955	902	902
   query58	209	192	204	192
   query59	2814	2628	2646	2628
   query60	228	225	225	225
   query61	86	85	84	84
   query62	717	434	445	434
   query63	166	143	143	143
   query64	5875	1710	1654	1654
   query65	3350	3280	3254	3254
   query66	1388	355	333	333
   query67	15668	15519	15389	15389
   query68	11939	508	496	496
   query69	497	253	242	242
   query70	1594	1441	1443	1441
   query71	497	217	222	217
   query72	5618	3524	3512	3512
   query73	2665	316	318	316
   query74	7595	6437	6428	6428
   query75	4972	2268	2270	2268
   query76	6230	1063	1126	1063
   query77	678	248	248	248
   query78	9088	8767	8617	8617
   query79	1029	503	491	491
   query80	540	365	339	339
   query81	471	209	209	209
   query82	210	97	92	92
   query83	165	140	133	133
   query84	246	52	53	52
   query85	928	271	260	260
   query86	372	417	366	366
   query87	3543	3356	3346	3346
   query88	2818	2256	2259	2256
   query89	333	243	249	243
   query90	1897	199	197	197
   query91	119	89	95	89
   query92	58	48	50	48
   query93	1386	432	471	432
   query94	828	180	172	172
   query95	444	410	409	409
   query96	622	321	327	321
   query97	4281	4154	4220	4154
   query98	207	202	191	191
   query99	1118	871	829	829
   Total cold run time: 292562 ms
   Total hot run time: 178774 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878728471

   run pipelinex_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878369238

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877050353

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878044256

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 9ed83aa5b98e1faa6725193d7d2b6a16be20cded, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5552	5174	5192	5174
   q2	382	168	158	158
   q3	1478	1215	1159	1159
   q4	1090	844	805	805
   q5	3133	3169	3158	3158
   q6	227	136	137	136
   q7	981	549	503	503
   q8	2166	2237	2303	2237
   q9	6723	6723	6683	6683
   q10	3221	3117	3143	3117
   q11	338	230	217	217
   q12	386	239	246	239
   q13	4377	3650	3626	3626
   q14	249	228	220	220
   q15	587	554	533	533
   q16	452	407	400	400
   q17	1039	470	513	470
   q18	7095	6807	6792	6792
   q19	1653	1570	1631	1570
   q20	606	362	331	331
   q21	2931	2584	2561	2561
   q22	404	315	322	315
   Total cold run time: 45070 ms
   Total hot run time: 40404 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5141	5086	5161	5086
   q2	337	233	243	233
   q3	3382	3342	3342	3342
   q4	2162	2084	2067	2067
   q5	5968	5954	5924	5924
   q6	224	131	128	128
   q7	2392	1937	1969	1937
   q8	3588	3682	3686	3682
   q9	9113	9014	9041	9014
   q10	3874	3902	3914	3902
   q11	588	485	481	481
   q12	821	644	636	636
   q13	3875	3222	3173	3173
   q14	284	270	260	260
   q15	589	552	528	528
   q16	572	492	535	492
   q17	2024	1857	1834	1834
   q18	8794	8400	8316	8316
   q19	1761	1688	1687	1687
   q20	2275	1992	1950	1950
   q21	5778	5444	5376	5376
   q22	589	549	482	482
   Total cold run time: 64131 ms
   Total hot run time: 60530 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 commented on code in PR #29553:
URL: https://github.com/apache/doris/pull/29553#discussion_r1442540023


##########
be/src/olap/rowset/rowset.h:
##########
@@ -327,6 +330,9 @@ class Rowset : public std::enable_shared_from_this<Rowset> {
     // rowset state machine
     RowsetStateMachine _rowset_state_machine;
     std::atomic<uint64_t> _delayed_expired_timestamp = 0;
+
+    // skip inverted index
+    bool skip_inverted_index = false;

Review Comment:
   also we may set skip index compaction column ids instead of whole rowset



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 commented on code in PR #29553:
URL: https://github.com/apache/doris/pull/29553#discussion_r1442539649


##########
be/src/olap/rowset/rowset.h:
##########
@@ -327,6 +330,9 @@ class Rowset : public std::enable_shared_from_this<Rowset> {
     // rowset state machine
     RowsetStateMachine _rowset_state_machine;
     std::atomic<uint64_t> _delayed_expired_timestamp = 0;
+
+    // skip inverted index
+    bool skip_inverted_index = false;

Review Comment:
   change name will be better, like skip_index_compaction



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877059583

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1877172948

   TeamCity be ut coverage result:
    Function Coverage: 36.64% (8618/23519) 
    Line Coverage: 28.68% (70045/244237)
    Region Coverage: 27.66% (36257/131095)
    Branch Coverage: 24.35% (18522/76052)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/9af6dd3922c6ed338ed0fdd80e3b2366e413d86b_9af6dd3922c6ed338ed0fdd80e3b2366e413d86b/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878008633

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](inverted index)Support failover when index compaction failed [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29553:
URL: https://github.com/apache/doris/pull/29553#issuecomment-1878040787

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 9ed83aa5b98e1faa6725193d7d2b6a16be20cded, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18563	5440	5078	5078
   q2	2017	160	146	146
   q3	10613	1122	1146	1122
   q4	10201	815	826	815
   q5	7792	2940	2805	2805
   q6	223	134	135	134
   q7	938	528	542	528
   q8	9303	2038	2017	2017
   q9	6868	6419	6405	6405
   q10	8246	3054	3018	3018
   q11	453	209	226	209
   q12	388	234	233	233
   q13	17996	3702	3654	3654
   q14	243	218	219	218
   q15	568	531	521	521
   q16	453	390	392	390
   q17	979	489	510	489
   q18	7520	6757	6740	6740
   q19	1604	1331	1444	1331
   q20	704	341	330	330
   q21	2861	2383	2414	2383
   q22	384	317	336	317
   Total cold run time: 108917 ms
   Total hot run time: 38883 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5148	5096	5047	5047
   q2	339	237	230	230
   q3	3312	3302	3298	3298
   q4	2125	2024	2039	2024
   q5	5809	5834	5809	5809
   q6	216	124	130	124
   q7	2345	1922	1950	1922
   q8	3611	3472	3462	3462
   q9	8962	8864	8799	8799
   q10	3792	3814	3855	3814
   q11	603	483	479	479
   q12	791	660	632	632
   q13	8925	3211	3223	3211
   q14	286	267	274	267
   q15	584	522	521	521
   q16	537	527	525	525
   q17	1973	1798	1739	1739
   q18	8737	8544	8407	8407
   q19	1628	1573	1585	1573
   q20	2222	1964	1951	1951
   q21	5709	5309	5283	5283
   q22	537	470	500	470
   Total cold run time: 68191 ms
   Total hot run time: 59587 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org