You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BiteTheDDDDt (via GitHub)" <gi...@apache.org> on 2024/01/24 08:06:23 UTC

[PR] [Feature](materialized-view) support create mv with count(*) [doris]

BiteTheDDDDt opened a new pull request, #30313:
URL: https://github.com/apache/doris/pull/30313

   ## Proposed changes
   support create mv with count(*)
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907727763

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907665350

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       14.3 seconds inserted 10000000 Rows, about 699K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907652267

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 186408 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49, data reload: false
   
   query1	935	335	334	334
   query2	6545	2131	1931	1931
   query3	6706	205	198	198
   query4	32426	22190	22135	22135
   query5	4452	438	354	354
   query6	239	160	156	156
   query7	4600	267	258	258
   query8	229	175	174	174
   query9	8363	2556	2522	2522
   query10	430	225	230	225
   query11	16625	15590	15538	15538
   query12	117	67	67	67
   query13	1683	370	377	370
   query14	10543	6956	6925	6925
   query15	204	176	184	176
   query16	5785	259	250	250
   query17	946	460	467	460
   query18	1783	253	244	244
   query19	174	130	132	130
   query20	67	70	65	65
   query21	187	139	130	130
   query22	4885	4841	4849	4841
   query23	31555	30990	30813	30813
   query24	11850	2786	2733	2733
   query25	563	313	314	313
   query26	1394	147	146	146
   query27	3196	285	288	285
   query28	7145	1840	1827	1827
   query29	1262	620	616	616
   query30	281	135	142	135
   query31	932	724	775	724
   query32	83	51	48	48
   query33	706	210	210	210
   query34	1147	472	474	472
   query35	905	734	777	734
   query36	1348	1217	1168	1168
   query37	92	57	60	57
   query38	3342	3208	3215	3208
   query39	1318	1281	1265	1265
   query40	203	89	85	85
   query41	37	34	34	34
   query42	95	81	87	81
   query43	532	489	482	482
   query44	1067	685	688	685
   query45	195	176	177	176
   query46	1065	652	665	652
   query47	1585	1522	1506	1506
   query48	402	317	316	316
   query49	1131	284	287	284
   query50	672	307	303	303
   query51	5355	5268	5184	5184
   query52	85	91	80	80
   query53	321	254	250	250
   query54	239	188	196	188
   query55	82	72	76	72
   query56	193	168	165	165
   query57	1018	934	936	934
   query58	173	156	161	156
   query59	2909	2707	2630	2630
   query60	200	175	185	175
   query61	79	85	81	81
   query62	598	382	359	359
   query63	279	255	257	255
   query64	4939	1797	1743	1743
   query65	3345	3269	3260	3260
   query66	1175	323	316	316
   query67	15824	15255	15080	15080
   query68	10403	522	509	509
   query69	592	292	301	292
   query70	1750	1509	1538	1509
   query71	10420	10198	10202	10198
   query72	4821	2793	2817	2793
   query73	2141	314	319	314
   query74	7061	6464	6390	6390
   query75	4537	2260	2263	2260
   query76	6262	1022	1055	1022
   query77	658	231	247	231
   query78	8969	8886	8595	8595
   query79	1021	507	509	507
   query80	516	331	306	306
   query81	469	202	204	202
   query82	209	79	82	79
   query83	137	116	117	116
   query84	273	68	70	68
   query85	1060	328	333	328
   query86	409	375	371	371
   query87	3486	3376	3280	3280
   query88	3254	2214	2175	2175
   query89	433	353	352	352
   query90	1993	196	185	185
   query91	166	125	119	119
   query92	57	44	44	44
   query93	2096	459	447	447
   query94	1186	158	156	156
   query95	496	449	450	449
   query96	625	325	315	315
   query97	4265	4140	4180	4140
   query98	204	193	186	186
   query99	960	701	707	701
   Total cold run time: 299770 ms
   Total hot run time: 186408 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907727642

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907660132

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.43 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49, data reload: false
   
   query1	0.03	0.02	0.02
   query2	0.06	0.03	0.02
   query3	0.22	0.05	0.06
   query4	1.69	0.08	0.08
   query5	0.52	0.54	0.53
   query6	1.32	0.63	0.63
   query7	0.02	0.01	0.01
   query8	0.04	0.02	0.02
   query9	0.55	0.50	0.50
   query10	0.56	0.56	0.54
   query11	0.12	0.08	0.08
   query12	0.10	0.10	0.09
   query13	0.61	0.61	0.61
   query14	0.79	0.82	0.80
   query15	0.81	0.77	0.78
   query16	0.39	0.39	0.37
   query17	1.03	0.98	1.02
   query18	0.24	0.26	0.22
   query19	1.79	1.75	1.71
   query20	0.02	0.01	0.01
   query21	15.41	0.58	0.56
   query22	2.54	2.32	2.56
   query23	17.36	0.75	0.75
   query24	2.53	1.65	0.12
   query25	0.20	0.20	0.10
   query26	0.59	0.14	0.14
   query27	0.06	0.05	0.06
   query28	12.17	0.75	0.77
   query29	12.52	3.20	3.20
   query30	0.54	0.48	0.49
   query31	2.77	0.34	0.35
   query32	3.43	0.47	0.48
   query33	3.23	3.21	3.25
   query34	15.75	4.29	4.30
   query35	4.24	4.30	4.29
   query36	1.10	1.07	1.07
   query37	0.07	0.05	0.05
   query38	0.04	0.02	0.02
   query39	0.02	0.02	0.01
   query40	0.16	0.14	0.13
   query41	0.07	0.02	0.01
   query42	0.02	0.01	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 105.75 s
   Total hot run time: 30.43 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907598919

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt merged PR #30313:
URL: https://github.com/apache/doris/pull/30313


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feature](materialized-view) support create mv with count(*) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30313:
URL: https://github.com/apache/doris/pull/30313#issuecomment-1907633904

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39100 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 9922c4a7ca06e57e693c5be48241042b3cf65d49, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17608	5185	5245	5185
   q2	2041	147	134	134
   q3	10634	1201	1196	1196
   q4	11158	796	827	796
   q5	9015	3256	3236	3236
   q6	201	123	124	123
   q7	876	514	504	504
   q8	9370	2005	1984	1984
   q9	7333	6360	6389	6360
   q10	8246	3033	3076	3033
   q11	410	213	207	207
   q12	370	188	190	188
   q13	17975	3362	3331	3331
   q14	238	221	212	212
   q15	542	507	508	507
   q16	427	366	383	366
   q17	937	506	542	506
   q18	7549	6979	6828	6828
   q19	1531	1387	1442	1387
   q20	615	333	310	310
   q21	2751	2409	2426	2409
   q22	370	298	303	298
   Total cold run time: 110197 ms
   Total hot run time: 39100 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5431	5262	5332	5262
   q2	332	212	211	211
   q3	3394	3296	3247	3247
   q4	2112	2042	2077	2042
   q5	6073	5980	5722	5722
   q6	198	118	115	115
   q7	2354	1897	1939	1897
   q8	3206	3392	3402	3392
   q9	9078	8876	8977	8876
   q10	3844	3854	3779	3779
   q11	587	450	461	450
   q12	799	611	642	611
   q13	16923	3163	3146	3146
   q14	271	256	266	256
   q15	544	497	501	497
   q16	510	464	455	455
   q17	1880	1812	1835	1812
   q18	9546	20472	9757	9757
   q19	23862	1552	1490	1490
   q20	4647	1957	1924	1924
   q21	14599	5376	5429	5376
   q22	982	520	574	520
   Total cold run time: 111172 ms
   Total hot run time: 60837 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org