You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "airborne12 (via GitHub)" <gi...@apache.org> on 2024/07/29 12:42:37 UTC

[PR] [Pick 2.0](clucene) update clucene version [doris]

airborne12 opened a new pull request, #38495:
URL: https://github.com/apache/doris/pull/38495

   ## Proposed changes
   
   backport #38482 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255966637

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 204433 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711, data reload: false
   
   query1	924	419	377	377
   query2	6550	2692	2812	2692
   query3	6926	206	196	196
   query4	20296	18020	18125	18020
   query5	19712	6560	6535	6535
   query6	294	221	227	221
   query7	4164	296	303	296
   query8	422	463	415	415
   query9	3185	2726	2678	2678
   query10	414	304	301	301
   query11	11390	10689	10754	10689
   query12	131	78	77	77
   query13	5601	730	715	715
   query14	17897	13496	13724	13496
   query15	360	246	247	246
   query16	6472	292	261	261
   query17	1751	1450	881	881
   query18	2318	425	408	408
   query19	221	149	152	149
   query20	84	81	77	77
   query21	193	100	95	95
   query22	5189	5056	4982	4982
   query23	32673	31984	31962	31962
   query24	6975	6582	6515	6515
   query25	527	440	434	434
   query26	513	172	167	167
   query27	1767	299	295	295
   query28	6224	2405	2370	2370
   query29	2910	2677	2882	2677
   query30	254	166	165	165
   query31	909	783	738	738
   query32	70	68	61	61
   query33	407	253	260	253
   query34	849	468	493	468
   query35	1131	923	911	911
   query36	1452	1253	1316	1253
   query37	91	60	63	60
   query38	3095	2912	2926	2912
   query39	1372	1323	1322	1322
   query40	204	97	95	95
   query41	47	44	44	44
   query42	88	84	87	84
   query43	823	688	687	687
   query44	1135	713	723	713
   query45	247	243	242	242
   query46	1213	952	989	952
   query47	1865	1777	1728	1728
   query48	1027	750	725	725
   query49	637	374	363	363
   query50	861	650	603	603
   query51	4774	4729	4641	4641
   query52	97	75	88	75
   query53	450	330	319	319
   query54	2642	2457	2461	2457
   query55	96	80	87	80
   query56	227	228	218	218
   query57	1268	1135	1128	1128
   query58	227	207	203	203
   query59	4246	3791	3990	3791
   query60	223	202	213	202
   query61	98	93	96	93
   query62	830	580	526	526
   query63	493	345	355	345
   query64	2494	1521	1513	1513
   query65	3648	3592	3618	3592
   query66	766	389	384	384
   query67	17188	15604	16482	15604
   query68	8145	661	659	659
   query69	563	375	355	355
   query70	1644	1302	1657	1302
   query71	378	303	325	303
   query72	6550	3464	3476	3464
   query73	737	321	320	320
   query74	6257	5855	5920	5855
   query75	4626	3712	3704	3704
   query76	4620	1160	1176	1160
   query77	551	252	261	252
   query78	12560	11549	11505	11505
   query79	9194	637	642	637
   query80	2851	406	401	401
   query81	527	242	236	236
   query82	1715	105	106	105
   query83	190	132	133	132
   query84	261	71	74	71
   query85	1461	347	336	336
   query86	367	298	301	298
   query87	3232	3028	3046	3028
   query88	5375	2321	2304	2304
   query89	388	299	301	299
   query90	1706	204	215	204
   query91	174	157	153	153
   query92	56	60	53	53
   query93	5599	571	607	571
   query94	886	213	214	213
   query95	1135	1069	1089	1069
   query96	634	328	320	320
   query97	6422	6328	6334	6328
   query98	180	168	173	168
   query99	2946	851	974	851
   Total cold run time: 315557 ms
   Total hot run time: 204433 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 merged PR #38495:
URL: https://github.com/apache/doris/pull/38495


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255832002

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255846196

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255986543

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
   Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255919921

   TeamCity be ut coverage result:
    Function Coverage: 37.82% (8120/21471) 
    Line Coverage: 29.48% (66600/225886)
    Region Coverage: 28.97% (34336/118516)
    Branch Coverage: 24.84% (17638/71002)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/ec276e7ff986bc57ccb6bdc03e1b89c5d48da711_ec276e7ff986bc57ccb6bdc03e1b89c5d48da711/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255831217

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255979440

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.39 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711, data reload: false
   
   query1	0.03	0.03	0.02
   query2	0.07	0.02	0.02
   query3	0.25	0.04	0.03
   query4	1.79	0.07	0.08
   query5	0.54	0.53	0.52
   query6	1.28	0.63	0.62
   query7	0.01	0.01	0.01
   query8	0.03	0.02	0.03
   query9	0.52	0.49	0.46
   query10	0.54	0.53	0.52
   query11	0.12	0.09	0.09
   query12	0.12	0.09	0.09
   query13	0.62	0.61	0.61
   query14	0.78	0.79	0.78
   query15	0.79	0.77	0.78
   query16	0.38	0.37	0.36
   query17	1.02	1.00	1.01
   query18	0.21	0.27	0.23
   query19	1.93	1.87	1.90
   query20	0.02	0.01	0.00
   query21	15.47	0.56	0.57
   query22	2.02	2.17	1.82
   query23	17.05	1.22	0.99
   query24	4.71	1.62	1.55
   query25	0.32	0.11	0.07
   query26	0.67	0.17	0.16
   query27	0.05	0.04	0.04
   query28	7.24	0.79	0.75
   query29	12.70	2.35	2.07
   query30	0.59	0.53	0.53
   query31	2.80	0.39	0.37
   query32	3.38	0.50	0.49
   query33	3.06	3.04	3.11
   query34	15.25	4.82	4.78
   query35	4.84	4.84	4.87
   query36	1.05	1.01	1.02
   query37	0.06	0.04	0.05
   query38	0.04	0.02	0.02
   query39	0.02	0.02	0.01
   query40	0.16	0.13	0.14
   query41	0.07	0.02	0.01
   query42	0.03	0.01	0.02
   query43	0.02	0.01	0.02
   Total cold run time: 102.65 s
   Total hot run time: 31.39 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Pick 2.0](clucene) update clucene version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38495:
URL: https://github.com/apache/doris/pull/38495#issuecomment-2255932227

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 49832 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ec276e7ff986bc57ccb6bdc03e1b89c5d48da711, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17770	4357	4338	4338
   q2	2078	153	152	152
   q3	10447	1871	2118	1871
   q4	10299	1251	1287	1251
   q5	8520	3817	3918	3817
   q6	253	144	125	125
   q7	2045	1611	1570	1570
   q8	9287	2728	2698	2698
   q9	10545	10303	10275	10275
   q10	8625	3502	3481	3481
   q11	421	253	246	246
   q12	467	298	301	298
   q13	18348	3954	4035	3954
   q14	368	345	337	337
   q15	500	456	453	453
   q16	716	579	602	579
   q17	1138	957	947	947
   q18	7360	6977	6945	6945
   q19	1821	1670	1668	1668
   q20	552	312	317	312
   q21	4506	4076	4145	4076
   q22	544	439	449	439
   Total cold run time: 116610 ms
   Total hot run time: 49832 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4359	4264	4288	4264
   q2	322	222	219	219
   q3	4130	4144	4131	4131
   q4	2738	2740	2743	2740
   q5	7132	7116	7141	7116
   q6	239	122	122	122
   q7	3219	2912	2861	2861
   q8	4372	4479	4496	4479
   q9	16773	16828	16806	16806
   q10	4231	4263	4329	4263
   q11	795	658	697	658
   q12	1023	859	857	857
   q13	7373	3735	3752	3735
   q14	456	433	424	424
   q15	501	454	456	454
   q16	727	696	670	670
   q17	3827	3875	3829	3829
   q18	8779	8830	8775	8775
   q19	1735	1698	1627	1627
   q20	2378	2101	2132	2101
   q21	8522	8559	8549	8549
   q22	1032	981	986	981
   Total cold run time: 84663 ms
   Total hot run time: 79661 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org