You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jackwener (via GitHub)" <gi...@apache.org> on 2024/01/29 11:17:58 UTC

[PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

jackwener opened a new pull request, #30524:
URL: https://github.com/apache/doris/pull/30524

   ## Proposed changes
   
   (cherry picked from commit aaa854f8ba8d31fc6eec219fb9da97bff4128b55)
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30524:
URL: https://github.com/apache/doris/pull/30524#issuecomment-1914559258

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.73 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 116a23c70b5cdbc2284a432ad4be55c1dbd0e837, data reload: false
   
   query1	0.02	0.02	0.02
   query2	0.05	0.03	0.02
   query3	0.24	0.05	0.05
   query4	1.80	0.07	0.07
   query5	0.53	0.52	0.51
   query6	1.30	0.61	0.62
   query7	0.02	0.01	0.00
   query8	0.03	0.02	0.02
   query9	0.52	0.50	0.48
   query10	0.55	0.54	0.55
   query11	0.12	0.08	0.08
   query12	0.11	0.09	0.10
   query13	0.63	0.61	0.61
   query14	0.78	0.80	0.78
   query15	0.79	0.76	0.75
   query16	0.38	0.39	0.38
   query17	1.02	1.00	0.96
   query18	0.22	0.26	0.25
   query19	1.88	1.84	1.86
   query20	0.02	0.02	0.01
   query21	15.52	0.56	0.55
   query22	2.16	2.59	1.75
   query23	17.06	0.99	1.04
   query24	6.51	0.76	1.08
   query25	2.22	0.17	0.15
   query26	0.15	0.14	0.14
   query27	0.15	0.16	0.14
   query28	6.41	0.74	0.70
   query29	12.70	2.15	2.35
   query30	0.54	0.52	0.52
   query31	2.82	0.39	0.38
   query32	3.41	0.51	0.49
   query33	3.08	3.06	3.08
   query34	15.27	4.79	4.78
   query35	4.87	4.84	4.84
   query36	1.04	1.01	1.01
   query37	0.05	0.05	0.04
   query38	0.04	0.02	0.02
   query39	0.01	0.02	0.02
   query40	0.17	0.13	0.14
   query41	0.07	0.02	0.01
   query42	0.02	0.01	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 105.3 s
   Total hot run time: 30.73 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #30524:
URL: https://github.com/apache/doris/pull/30524#issuecomment-1914489966

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30524:
URL: https://github.com/apache/doris/pull/30524#issuecomment-1914550552

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 239478 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 116a23c70b5cdbc2284a432ad4be55c1dbd0e837, data reload: false
   
   query1	921	393	379	379
   query2	6530	2298	2167	2167
   query3	6918	198	197	197
   query4	20811	18021	17920	17920
   query5	19720	6282	6199	6199
   query6	277	215	222	215
   query7	4151	295	298	295
   query8	234	226	224	224
   query9	3098	2681	2614	2614
   query10	411	294	301	294
   query11	11265	10673	10724	10673
   query12	121	78	69	69
   query13	5652	649	638	638
   query14	18031	13689	13638	13638
   query15	379	233	241	233
   query16	6438	261	281	261
   query17	3201	893	864	864
   query18	2261	402	407	402
   query19	211	145	149	145
   query20	76	76	75	75
   query21	190	95	93	93
   query22	5237	5084	5139	5084
   query23	32543	31954	31889	31889
   query24	6959	6525	6576	6525
   query25	504	447	404	404
   query26	527	163	161	161
   query27	1800	296	295	295
   query28	6138	2221	2199	2199
   query29	2913	2784	2815	2784
   query30	242	161	157	157
   query31	910	726	720	720
   query32	63	53	54	53
   query33	386	242	241	241
   query34	834	486	477	477
   query35	1118	942	929	929
   query36	1660	1496	1545	1496
   query37	95	62	62	62
   query38	3105	2964	2913	2913
   query39	1363	1325	1336	1325
   query40	203	98	96	96
   query41	34	33	32	32
   query42	98	94	100	94
   query43	641	713	643	643
   query44	1116	717	714	714
   query45	243	227	229	227
   query46	1230	978	960	960
   query47	1800	1657	1651	1651
   query48	1005	659	660	659
   query49	621	368	368	368
   query50	869	584	593	584
   query51	5688	5522	5595	5522
   query52	108	85	84	84
   query53	445	323	316	316
   query54	2404	2277	2246	2246
   query55	79	82	77	77
   query56	235	209	204	204
   query57	1302	1138	1172	1138
   query58	219	190	212	190
   query59	3583	3390	3138	3138
   query60	212	195	203	195
   query61	81	80	80	80
   query62	836	459	516	459
   query63	483	335	340	335
   query64	1954	1311	1267	1267
   query65	3668	3605	3701	3605
   query66	794	376	365	365
   query67	16191	16131	15809	15809
   query68	8341	642	675	642
   query69	565	348	335	335
   query70	1778	1569	1729	1569
   query71	395	307	312	307
   query72	4472	3385	3326	3326
   query73	717	318	313	313
   query74	6358	5911	5855	5855
   query75	4313	3546	3542	3542
   query76	4887	1196	1212	1196
   query77	671	256	242	242
   query78	31842	53892	48206	48206
   query79	15589	659	611	611
   query80	5056	377	376	376
   query81	556	230	233	230
   query82	1413	99	93	93
   query83	564	142	131	131
   query84	259	67	69	67
   query85	2615	275	271	271
   query86	478	358	387	358
   query87	3259	2995	3005	2995
   query88	6608	2286	2281	2281
   query89	413	284	296	284
   query90	2499	202	196	196
   query91	150	117	121	117
   query92	63	50	48	48
   query93	5990	550	575	550
   query94	1853	204	207	204
   query95	1118	1047	1068	1047
   query96	650	329	334	329
   query97	6447	6347	6260	6260
   query98	182	172	180	172
   query99	3953	1030	958	958
   Total cold run time: 347489 ms
   Total hot run time: 239478 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30524:
URL: https://github.com/apache/doris/pull/30524#issuecomment-1914528078

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 50332 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 116a23c70b5cdbc2284a432ad4be55c1dbd0e837, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17538	4384	4396	4384
   q2	2027	151	142	142
   q3	10955	2118	2066	2066
   q4	11498	1253	1338	1253
   q5	9484	4165	4013	4013
   q6	229	126	123	123
   q7	2048	1578	1595	1578
   q8	9264	2724	2744	2724
   q9	10920	10604	10444	10444
   q10	8664	3492	3547	3492
   q11	409	233	256	233
   q12	458	295	301	295
   q13	18322	3998	4054	3998
   q14	355	324	323	323
   q15	506	468	459	459
   q16	690	588	585	585
   q17	1144	982	936	936
   q18	7328	7069	6950	6950
   q19	1680	1555	1542	1542
   q20	553	316	311	311
   q21	4526	4086	4086	4086
   q22	495	395	402	395
   Total cold run time: 119093 ms
   Total hot run time: 50332 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4303	4309	4330	4309
   q2	326	232	241	232
   q3	4208	4160	4129	4129
   q4	2756	2759	2762	2759
   q5	7261	7179	7206	7179
   q6	235	122	117	117
   q7	3215	2827	2835	2827
   q8	4415	4498	4480	4480
   q9	17190	17051	16994	16994
   q10	4232	4270	4295	4270
   q11	779	685	687	685
   q12	1007	869	839	839
   q13	7040	3743	3751	3743
   q14	457	432	426	426
   q15	504	459	447	447
   q16	743	715	717	715
   q17	3825	3888	3787	3787
   q18	8893	8811	8972	8811
   q19	1710	1694	1650	1650
   q20	2393	2138	2116	2116
   q21	8579	8624	8587	8587
   q22	1041	975	964	964
   Total cold run time: 85112 ms
   Total hot run time: 80066 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener merged PR #30524:
URL: https://github.com/apache/doris/pull/30524


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): Except just can merge with left deep shape (#30270) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30524:
URL: https://github.com/apache/doris/pull/30524#issuecomment-1914564841

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 116a23c70b5cdbc2284a432ad4be55c1dbd0e837 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org