You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morrySnow (via GitHub)" <gi...@apache.org> on 2024/03/01 09:43:37 UTC

[PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

morrySnow opened a new pull request, #31672:
URL: https://github.com/apache/doris/pull/31672

   pick from master #31622
   commit id 585d12431c310c006b55bb81208b5805f381c3ed
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31672:
URL: https://github.com/apache/doris/pull/31672#issuecomment-1972900877

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 37753 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 619e6d3629827860bbbf78813a16ed1f62a59b3b, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18015	4889	4821	4821
   q2	2140	213	206	206
   q3	10134	1128	1078	1078
   q4	10193	770	762	762
   q5	8234	2455	2342	2342
   q6	154	102	100	100
   q7	1677	1516	1547	1516
   q8	9422	1955	1865	1865
   q9	8411	7714	7673	7673
   q10	8177	2256	2180	2180
   q11	472	312	322	312
   q12	434	333	340	333
   q13	18327	3177	3128	3128
   q14	344	308	330	308
   q15	412	364	354	354
   q16	652	623	612	612
   q17	927	454	435	435
   q18	6188	5881	5341	5341
   q19	1374	890	915	890
   q20	631	483	445	445
   q21	3288	2617	2555	2555
   q22	589	497	521	497
   Total cold run time: 110195 ms
   Total hot run time: 37753 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4844	4921	4864	4864
   q2	331	257	243	243
   q3	2706	2532	2479	2479
   q4	1901	1700	1661	1661
   q5	6812	6940	7035	6940
   q6	143	91	97	91
   q7	3783	3505	3479	3479
   q8	5867	5908	5664	5664
   q9	11128	10676	10799	10676
   q10	3272	2909	2836	2836
   q11	1112	1071	980	980
   q12	946	851	873	851
   q13	3358	2846	2866	2846
   q14	409	384	335	335
   q15	384	361	344	344
   q16	754	716	754	716
   q17	4705	5245	5796	5245
   q18	6394	6101	6713	6101
   q19	1432	996	1121	996
   q20	2187	2063	2018	2018
   q21	8680	7854	8469	7854
   q22	1054	988	1010	988
   Total cold run time: 72202 ms
   Total hot run time: 68207 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31672:
URL: https://github.com/apache/doris/pull/31672#issuecomment-1972930482

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 25.79 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 619e6d3629827860bbbf78813a16ed1f62a59b3b, data reload: false
   
   query1	0.03	0.04	0.03
   query2	0.09	0.04	0.03
   query3	0.26	0.06	0.06
   query4	1.74	0.07	0.07
   query5	0.41	0.41	0.40
   query6	1.36	0.93	0.90
   query7	0.02	0.02	0.02
   query8	0.05	0.03	0.03
   query9	0.62	0.56	0.60
   query10	0.61	0.61	0.64
   query11	0.18	0.13	0.12
   query12	0.16	0.14	0.14
   query13	0.46	0.44	0.40
   query14	0.78	0.77	0.77
   query15	0.81	0.79	0.77
   query16	0.40	0.40	0.36
   query17	1.26	1.27	1.25
   query18	0.21	0.32	0.25
   query19	2.42	2.29	2.28
   query20	0.02	0.02	0.01
   query21	15.43	0.83	0.84
   query22	0.51	0.53	0.52
   query23	13.68	0.54	0.53
   query24	0.77	0.49	0.46
   query25	0.08	0.07	0.07
   query26	0.21	0.20	0.21
   query27	0.06	0.05	0.06
   query28	0.85	0.73	0.69
   query29	12.72	3.29	3.08
   query30	0.92	0.89	0.87
   query31	0.94	0.46	0.42
   query32	3.30	0.42	0.42
   query33	2.68	2.79	2.52
   query34	2.28	2.29	2.30
   query35	2.29	2.34	2.33
   query36	1.19	1.17	1.21
   query37	0.05	0.04	0.05
   query38	0.04	0.02	0.03
   query39	0.03	0.03	0.02
   query40	0.13	0.13	0.13
   query41	0.08	0.02	0.02
   query42	0.03	0.02	0.02
   query43	0.03	0.03	0.03
   Total cold run time: 70.19 s
   Total hot run time: 25.79 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow commented on PR #31672:
URL: https://github.com/apache/doris/pull/31672#issuecomment-1972853181

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31672:
URL: https://github.com/apache/doris/pull/31672#issuecomment-1972922848

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 205274 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 619e6d3629827860bbbf78813a16ed1f62a59b3b, data reload: false
   
   query1	1017	465	443	443
   query2	6596	2793	2740	2740
   query3	6928	283	277	277
   query4	18293	13642	13750	13642
   query5	19971	3029	2943	2943
   query6	343	285	293	285
   query7	4139	436	425	425
   query8	338	350	350	350
   query9	4345	3972	3925	3925
   query10	589	478	463	463
   query11	9744	9532	9411	9411
   query12	164	100	104	100
   query13	5581	881	894	881
   query14	18865	14848	13992	13992
   query15	349	315	321	315
   query16	5047	359	330	330
   query17	1480	1118	1010	1010
   query18	2182	532	511	511
   query19	255	221	215	215
   query20	111	112	106	106
   query21	218	150	140	140
   query22	6402	6115	5804	5804
   query23	26044	25182	25791	25182
   query24	5212	5083	4932	4932
   query25	612	526	549	526
   query26	523	207	207	207
   query27	881	412	413	412
   query28	4619	3477	3401	3401
   query29	8587	8291	7840	7840
   query30	270	210	219	210
   query31	989	879	896	879
   query32	98	86	86	86
   query33	431	332	332	332
   query34	912	651	664	651
   query35	1287	1336	1275	1275
   query36	2152	1932	2039	1932
   query37	112	95	88	88
   query38	3180	3173	3152	3152
   query39	1268	1205	1215	1205
   query40	227	133	133	133
   query41	52	51	51	51
   query42	123	127	129	127
   query43	966	982	797	797
   query44	1246	1057	1068	1057
   query45	296	281	288	281
   query46	1038	904	916	904
   query47	2345	2435	2336	2336
   query48	1039	848	830	830
   query49	602	438	429	429
   query50	738	474	522	474
   query51	4327	4244	4186	4186
   query52	113	125	116	116
   query53	403	402	402	402
   query54	2040	1744	1928	1744
   query55	125	116	117	116
   query56	296	284	313	284
   query57	1421	1431	1576	1431
   query58	304	327	327	327
   query59	5045	4635	4995	4635
   query60	310	274	305	274
   query61	137	127	125	125
   query62	752	684	613	613
   query63	412	383	376	376
   query64	1962	1369	1361	1361
   query65	3461	3479	3277	3277
   query66	903	475	465	465
   query67	24193	19676	23798	19676
   query68	3356	704	732	704
   query69	602	505	492	492
   query70	2603	2581	2633	2581
   query71	431	425	419	419
   query72	3908	3163	3081	3081
   query73	801	481	481	481
   query74	6392	6047	5997	5997
   query75	3915	3243	3246	3243
   query76	2147	691	678	678
   query77	499	372	357	357
   query78	10551	10257	9487	9487
   query79	1150	798	782	782
   query80	605	547	544	544
   query81	473	281	285	281
   query82	167	123	138	123
   query83	215	200	195	195
   query84	248	98	99	98
   query85	664	395	389	389
   query86	531	530	528	528
   query87	3580	3271	3280	3271
   query88	4314	3489	3493	3489
   query89	438	410	422	410
   query90	1385	238	225	225
   query91	172	168	176	168
   query92	80	75	74	74
   query93	927	592	551	551
   query94	544	246	254	246
   query95	1330	1297	1279	1279
   query96	768	493	495	493
   query97	5720	6017	5706	5706
   query98	245	245	245	245
   query99	1397	1212	1248	1212
   Total cold run time: 285168 ms
   Total hot run time: 205274 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31672:
URL: https://github.com/apache/doris/pull/31672#issuecomment-1972852368

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](planner) should not push down sink when last exchange do limit (#31622) [doris]

Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #31672:
URL: https://github.com/apache/doris/pull/31672


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org