You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "XieJiann (via GitHub)" <gi...@apache.org> on 2024/01/17 03:14:19 UTC

[PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

XieJiann opened a new pull request, #30042:
URL: https://github.com/apache/doris/pull/30042

   ## Proposed changes
   
   fix enable mv rewrite is useless in dphyp
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1894975685

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1894917053

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.65 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 78758d1c719abd04222cbaf13f83901d5c731465, data reload: false
   
   query1	0.04	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.23	0.05	0.05
   query4	1.69	0.08	0.07
   query5	0.54	0.52	0.51
   query6	1.30	0.65	0.62
   query7	0.02	0.01	0.01
   query8	0.03	0.03	0.02
   query9	0.55	0.52	0.50
   query10	0.58	0.56	0.56
   query11	0.12	0.09	0.09
   query12	0.11	0.09	0.09
   query13	0.60	0.59	0.60
   query14	0.78	0.78	0.78
   query15	0.80	0.79	0.79
   query16	0.37	0.41	0.37
   query17	1.01	1.02	0.99
   query18	0.25	0.24	0.23
   query19	1.84	1.74	1.79
   query20	0.02	0.01	0.01
   query21	15.48	0.58	0.56
   query22	2.60	2.41	1.59
   query23	17.33	0.88	0.80
   query24	2.28	1.16	1.43
   query25	0.42	0.19	0.13
   query26	0.61	0.13	0.13
   query27	0.05	0.05	0.06
   query28	11.12	0.75	0.78
   query29	12.51	3.18	3.25
   query30	0.55	0.56	0.49
   query31	2.77	0.33	0.34
   query32	3.38	0.48	0.49
   query33	3.23	3.24	3.26
   query34	15.83	4.19	4.23
   query35	4.28	4.30	4.19
   query36	1.11	1.07	1.08
   query37	0.07	0.05	0.05
   query38	0.03	0.02	0.04
   query39	0.02	0.01	0.02
   query40	0.16	0.13	0.13
   query41	0.06	0.01	0.02
   query42	0.03	0.01	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 104.88 s
   Total hot run time: 30.65 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1894919148

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 78758d1c719abd04222cbaf13f83901d5c731465 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
   Insert into select:       13.2 seconds inserted 10000000 Rows, about 757K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener merged PR #30042:
URL: https://github.com/apache/doris/pull/30042


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1894913292

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 178150 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 78758d1c719abd04222cbaf13f83901d5c731465, data reload: false
   
   query1	942	332	332	332
   query2	6554	1926	2073	1926
   query3	6691	211	208	208
   query4	30426	22300	22258	22258
   query5	6851	549	543	543
   query6	269	164	164	164
   query7	4603	268	262	262
   query8	233	177	179	177
   query9	8456	2540	2514	2514
   query10	434	229	223	223
   query11	16953	15601	15614	15601
   query12	130	73	68	68
   query13	1677	383	376	376
   query14	10557	6868	6968	6868
   query15	209	185	183	183
   query16	4599	237	234	234
   query17	985	484	476	476
   query18	1785	262	248	248
   query19	176	133	129	129
   query20	73	78	72	72
   query21	182	136	117	117
   query22	4901	4757	4751	4751
   query23	31607	30930	30841	30841
   query24	12513	2833	2851	2833
   query25	581	316	316	316
   query26	1798	145	154	145
   query27	3196	267	269	267
   query28	7047	1806	1816	1806
   query29	2160	637	622	622
   query30	282	137	138	137
   query31	935	736	753	736
   query32	84	54	52	52
   query33	710	216	214	214
   query34	1152	462	463	462
   query35	868	789	781	781
   query36	1437	1316	1299	1299
   query37	92	63	56	56
   query38	3381	3259	3254	3254
   query39	1322	1279	1273	1273
   query40	340	88	85	85
   query41	38	36	35	35
   query42	93	78	86	78
   query43	563	491	492	491
   query44	1038	687	699	687
   query45	194	178	176	176
   query46	1052	650	667	650
   query47	1697	1568	1533	1533
   query48	395	303	316	303
   query49	1211	285	287	285
   query50	680	312	314	312
   query51	5281	5250	5211	5211
   query52	93	77	79	77
   query53	326	257	259	257
   query54	895	432	440	432
   query55	84	77	72	72
   query56	177	172	165	165
   query57	1053	967	953	953
   query58	199	157	162	157
   query59	2947	2698	2784	2698
   query60	213	188	189	188
   query61	85	86	85	85
   query62	665	405	398	398
   query63	281	270	264	264
   query64	6157	1803	1791	1791
   query65	3363	3253	3260	3253
   query66	1439	325	314	314
   query67	15730	15356	15336	15336
   query68	12940	519	526	519
   query69	624	312	299	299
   query70	1881	1566	1552	1552
   query71	544	211	214	211
   query72	4844	2843	2834	2834
   query73	3164	326	325	325
   query74	6869	6392	6425	6392
   query75	5134	2373	2356	2356
   query76	6165	1068	1035	1035
   query77	687	238	242	238
   query78	9108	8787	8656	8656
   query79	2347	503	488	488
   query80	502	313	315	313
   query81	447	203	205	203
   query82	210	80	77	77
   query83	146	119	124	119
   query84	278	75	74	74
   query85	1054	325	320	320
   query86	388	380	394	380
   query87	3550	3328	3366	3328
   query88	3407	2267	2248	2248
   query89	445	352	366	352
   query90	1992	198	188	188
   query91	157	127	122	122
   query92	57	42	45	42
   query93	1430	441	404	404
   query94	1211	162	160	160
   query95	505	476	461	461
   query96	637	330	327	327
   query97	4292	4183	4128	4128
   query98	216	198	184	184
   query99	1032	705	729	705
   Total cold run time: 299403 ms
   Total hot run time: 178150 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "XieJiann (via GitHub)" <gi...@apache.org>.
XieJiann commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1894887993

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1894905454

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39150 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 78758d1c719abd04222cbaf13f83901d5c731465, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17607	5173	5365	5173
   q2	2039	150	131	131
   q3	10640	1214	1207	1207
   q4	10854	798	815	798
   q5	7831	3208	3194	3194
   q6	203	131	121	121
   q7	901	514	503	503
   q8	9307	1939	1989	1939
   q9	8046	6481	6359	6359
   q10	8266	3137	3001	3001
   q11	416	202	212	202
   q12	360	189	190	189
   q13	17990	3379	3375	3375
   q14	248	211	215	211
   q15	548	512	511	511
   q16	428	378	375	375
   q17	944	502	528	502
   q18	7592	7016	6952	6952
   q19	1554	1360	1397	1360
   q20	575	314	310	310
   q21	2854	2425	2456	2425
   q22	384	312	313	312
   Total cold run time: 109587 ms
   Total hot run time: 39150 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5528	5294	5220	5220
   q2	338	214	209	209
   q3	3354	3254	3240	3240
   q4	2178	2022	2083	2022
   q5	6096	5952	5954	5952
   q6	196	118	118	118
   q7	2337	1883	1886	1883
   q8	3230	3375	3369	3369
   q9	8972	9125	8786	8786
   q10	3917	3790	3794	3790
   q11	552	469	457	457
   q12	814	619	625	619
   q13	16937	3198	3179	3179
   q14	294	269	266	266
   q15	551	508	502	502
   q16	529	492	494	492
   q17	1854	1885	1814	1814
   q18	9483	17629	9465	9465
   q19	23844	1608	1502	1502
   q20	4615	1927	1918	1918
   q21	14481	5489	5245	5245
   q22	989	528	530	528
   Total cold run time: 111089 ms
   Total hot run time: 60576 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](Nereids): fix enable mv rewrite is useless in dphyp [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30042:
URL: https://github.com/apache/doris/pull/30042#issuecomment-1895184916

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org