You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2024/09/26 07:44:06 UTC

[PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

englefly opened a new pull request, #41343:
URL: https://github.com/apache/doris/pull/41343

   
   ## Proposed changes
   pick #40529
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376172946

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376302563

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 8bc977d4ccb087c765b455232a913d48aef63829 with default session variables
   Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       22.3 seconds inserted 10000000 Rows, about 448K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376282166

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 211398 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 8bc977d4ccb087c765b455232a913d48aef63829, data reload: false
   
   query1	1500	530	516	516
   query2	6517	2500	2327	2327
   query3	9086	199	198	198
   query4	27834	21873	21356	21356
   query5	19142	6505	6441	6441
   query6	286	212	241	212
   query7	3596	294	318	294
   query8	254	289	238	238
   query9	3079	2638	2544	2544
   query10	413	289	304	289
   query11	15390	14825	14891	14825
   query12	130	78	75	75
   query13	872	469	431	431
   query14	17531	13607	13737	13607
   query15	327	215	223	215
   query16	6345	277	262	262
   query17	1567	929	890	890
   query18	850	312	317	312
   query19	202	151	146	146
   query20	99	100	106	100
   query21	192	94	94	94
   query22	5092	5029	5115	5029
   query23	34067	33503	33489	33489
   query24	7571	6308	6250	6250
   query25	526	438	415	415
   query26	1079	160	160	160
   query27	2388	295	306	295
   query28	5202	2225	2195	2195
   query29	2788	2630	2720	2630
   query30	239	168	169	168
   query31	955	726	744	726
   query32	63	60	61	60
   query33	450	250	244	244
   query34	858	478	472	472
   query35	1058	933	933	933
   query36	1296	1149	1004	1004
   query37	121	59	58	58
   query38	3049	2935	2936	2935
   query39	1370	1307	1315	1307
   query40	304	94	94	94
   query41	40	36	37	36
   query42	84	92	86	86
   query43	576	613	537	537
   query44	1166	706	704	704
   query45	246	228	224	224
   query46	1239	942	948	942
   query47	1905	1750	1994	1750
   query48	505	412	413	412
   query49	652	378	372	372
   query50	849	609	610	609
   query51	4729	4710	4732	4710
   query52	99	80	81	80
   query53	228	188	186	186
   query54	2648	2457	2468	2457
   query55	89	81	87	81
   query56	219	199	205	199
   query57	1328	1212	1158	1158
   query58	220	209	235	209
   query59	3445	3090	3485	3090
   query60	213	207	198	198
   query61	91	89	94	89
   query62	871	454	474	454
   query63	203	179	177	177
   query64	3632	1570	1378	1378
   query65	3585	3557	3537	3537
   query66	739	419	411	411
   query67	15826	17072	14858	14858
   query68	9683	635	620	620
   query69	508	263	276	263
   query70	1492	1336	1381	1336
   query71	397	299	308	299
   query72	6045	4903	4720	4720
   query73	765	323	318	318
   query74	6310	5764	5863	5764
   query75	5036	3788	3658	3658
   query76	5069	1151	1205	1151
   query77	779	250	250	250
   query78	12474	11689	11740	11689
   query79	7741	628	640	628
   query80	2085	377	408	377
   query81	456	235	239	235
   query82	1607	98	95	95
   query83	167	130	133	130
   query84	263	70	72	70
   query85	984	322	314	314
   query86	350	303	305	303
   query87	3284	3021	3015	3015
   query88	4716	2280	2305	2280
   query89	496	293	302	293
   query90	2115	218	217	217
   query91	156	126	125	125
   query92	61	51	53	51
   query93	7525	588	578	578
   query94	897	206	212	206
   query95	1970	2034	1974	1974
   query96	657	320	318	318
   query97	6443	6383	6313	6313
   query98	245	206	204	204
   query99	3093	824	825	824
   Total cold run time: 322984 ms
   Total hot run time: 211398 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376240096

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 49012 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 8bc977d4ccb087c765b455232a913d48aef63829, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17895	4375	4356	4356
   q2	12635	155	141	141
   q3	9805	1907	1915	1907
   q4	10288	1260	1325	1260
   q5	8403	3865	3878	3865
   q6	235	124	125	124
   q7	2052	1596	1610	1596
   q8	9415	2710	2698	2698
   q9	11617	9723	9771	9723
   q10	8615	3496	3508	3496
   q11	410	255	248	248
   q12	472	297	297	297
   q13	18371	3961	3985	3961
   q14	359	337	335	335
   q15	513	447	465	447
   q16	522	468	450	450
   q17	1132	947	931	931
   q18	7196	6902	6870	6870
   q19	1687	1574	1578	1574
   q20	534	325	312	312
   q21	4418	4107	4026	4026
   q22	493	401	395	395
   Total cold run time: 127067 ms
   Total hot run time: 49012 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4306	4295	4285	4285
   q2	321	228	221	221
   q3	4139	4107	4154	4107
   q4	2740	2727	2728	2727
   q5	7167	7077	7132	7077
   q6	236	119	119	119
   q7	3185	2821	2822	2821
   q8	4323	4465	4508	4465
   q9	13715	13294	13600	13294
   q10	4236	4232	4246	4232
   q11	767	672	688	672
   q12	1038	860	843	843
   q13	7072	3732	3729	3729
   q14	451	424	419	419
   q15	494	457	463	457
   q16	612	585	581	581
   q17	3787	3775	3889	3775
   q18	8846	8849	8750	8750
   q19	1699	1682	1653	1653
   q20	2390	2154	2087	2087
   q21	8424	8391	8471	8391
   q22	1019	930	947	930
   Total cold run time: 80967 ms
   Total hot run time: 75635 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376173082

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376295464

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 32.52 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 8bc977d4ccb087c765b455232a913d48aef63829, data reload: false
   
   query1	0.21	0.21	0.20
   query2	0.07	0.03	0.02
   query3	0.25	0.04	0.04
   query4	1.81	0.07	0.07
   query5	0.54	0.52	0.52
   query6	1.25	0.61	0.62
   query7	0.08	0.04	0.05
   query8	0.03	0.02	0.03
   query9	0.52	0.49	0.46
   query10	0.52	0.54	0.54
   query11	0.12	0.10	0.09
   query12	0.13	0.09	0.10
   query13	0.62	0.62	0.60
   query14	0.79	0.79	0.80
   query15	0.77	0.77	0.76
   query16	0.58	0.57	0.56
   query17	1.67	1.63	1.64
   query18	0.86	0.97	0.93
   query19	3.42	1.87	1.81
   query20	0.02	0.02	0.03
   query21	15.40	0.54	0.54
   query22	1.91	2.31	1.41
   query23	17.23	0.99	0.96
   query24	4.46	1.18	3.17
   query25	0.36	0.07	0.06
   query26	0.78	0.16	0.15
   query27	0.03	0.04	0.04
   query28	6.36	0.77	0.76
   query29	12.65	2.40	2.26
   query30	0.56	0.52	0.52
   query31	2.82	0.38	0.39
   query32	3.40	0.49	0.49
   query33	3.06	3.09	3.08
   query34	15.27	4.78	4.78
   query35	4.87	4.85	4.84
   query36	1.08	1.01	1.02
   query37	0.06	0.05	0.05
   query38	0.04	0.02	0.03
   query39	0.02	0.01	0.01
   query40	0.16	0.14	0.15
   query41	0.07	0.02	0.01
   query42	0.02	0.01	0.01
   query43	0.02	0.02	0.02
   Total cold run time: 104.89 s
   Total hot run time: 32.52 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly closed pull request #41343: [opt](nereids) tabe row count priority: user injected > BE report > analyzed  (2.0)
URL: https://github.com/apache/doris/pull/41343


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org