You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "BiteTheDDDDt (via GitHub)" <gi...@apache.org> on 2024/03/27 05:46:44 UTC

[PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

BiteTheDDDDt opened a new pull request, #32885:
URL: https://github.com/apache/doris/pull/32885

   ## Proposed changes
   The materialized view can not involved auto increment column
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2022067613

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 181747 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e095605fc8b800b6305384dcb677625094c336b3, data reload: false
   
   query1	2151	372	347	347
   query2	7090	2027	1890	1890
   query3	6772	226	229	226
   query4	32489	22037	21685	21685
   query5	4811	394	409	394
   query6	1014	181	176	176
   query7	6617	343	316	316
   query8	964	173	176	173
   query9	12180	2290	2303	2290
   query10	585	252	261	252
   query11	14764	14227	14246	14227
   query12	132	86	88	86
   query13	1628	438	426	426
   query14	9239	8117	7489	7489
   query15	324	188	197	188
   query16	8244	253	249	249
   query17	2160	577	525	525
   query18	2100	278	272	272
   query19	349	143	147	143
   query20	99	85	85	85
   query21	204	122	121	121
   query22	5001	4847	4777	4777
   query23	33648	32578	32957	32578
   query24	10542	2877	2864	2864
   query25	608	391	390	390
   query26	1222	158	159	158
   query27	2591	350	354	350
   query28	7220	1912	1879	1879
   query29	926	630	623	623
   query30	303	149	150	149
   query31	971	736	730	730
   query32	105	56	56	56
   query33	787	255	251	251
   query34	1076	492	487	487
   query35	855	612	608	608
   query36	1009	883	868	868
   query37	127	64	67	64
   query38	3549	3426	3409	3409
   query39	1502	1454	1541	1454
   query40	215	112	115	112
   query41	52	51	48	48
   query42	107	97	98	97
   query43	478	437	435	435
   query44	1143	729	738	729
   query45	279	259	270	259
   query46	1107	720	704	704
   query47	1929	1862	1878	1862
   query48	451	346	363	346
   query49	1112	352	347	347
   query50	757	366	374	366
   query51	6682	6553	6609	6553
   query52	110	101	88	88
   query53	349	275	276	275
   query54	310	251	232	232
   query55	86	81	80	80
   query56	265	224	225	224
   query57	1228	1147	1146	1146
   query58	240	211	207	207
   query59	2702	2486	2518	2486
   query60	262	251	250	250
   query61	113	139	115	115
   query62	685	442	440	440
   query63	304	274	273	273
   query64	5711	4097	4051	4051
   query65	3063	3035	3027	3027
   query66	894	375	370	370
   query67	15313	14941	14743	14743
   query68	8873	537	552	537
   query69	651	384	378	378
   query70	1302	1156	1123	1123
   query71	518	273	262	262
   query72	6453	2711	2556	2556
   query73	766	324	319	319
   query74	6936	6498	6445	6445
   query75	3724	2208	2249	2208
   query76	5527	889	847	847
   query77	663	258	254	254
   query78	10862	10249	10168	10168
   query79	10135	532	536	532
   query80	1922	367	368	367
   query81	522	221	216	216
   query82	410	88	81	81
   query83	209	147	147	147
   query84	286	78	75	75
   query85	1151	316	311	311
   query86	373	310	305	305
   query87	3761	3529	3599	3529
   query88	4638	2384	2359	2359
   query89	499	364	360	360
   query90	2099	171	173	171
   query91	167	140	140	140
   query92	61	46	46	46
   query93	6951	505	491	491
   query94	1290	175	175	175
   query95	432	324	320	320
   query96	605	269	273	269
   query97	2667	2500	2480	2480
   query98	225	218	202	202
   query99	1157	954	965	954
   Total cold run time: 317740 ms
   Total hot run time: 181747 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2022012808

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2026521618

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 37734 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 199a4893edc175bf42d9a9aaf299add3768c6763, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17603	4326	4288	4288
   q2	2024	149	147	147
   q3	10600	1117	1185	1117
   q4	10222	714	832	714
   q5	7458	2856	2844	2844
   q6	202	122	126	122
   q7	1050	591	569	569
   q8	9335	1994	1990	1990
   q9	6886	6302	6292	6292
   q10	8490	3452	3573	3452
   q11	441	240	229	229
   q12	417	200	202	200
   q13	17883	2946	2974	2946
   q14	250	206	209	206
   q15	519	469	468	468
   q16	494	398	384	384
   q17	953	577	604	577
   q18	7135	6478	6424	6424
   q19	3880	1439	1468	1439
   q20	542	243	262	243
   q21	3555	2889	2788	2788
   q22	342	302	295	295
   Total cold run time: 110281 ms
   Total hot run time: 37734 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4168	4091	4069	4069
   q2	325	230	227	227
   q3	2953	2854	2803	2803
   q4	1841	1575	1563	1563
   q5	5220	5199	5219	5199
   q6	194	115	115	115
   q7	2208	1776	1769	1769
   q8	3180	3287	3275	3275
   q9	8403	8414	8405	8405
   q10	3769	3757	3765	3757
   q11	539	440	440	440
   q12	714	557	546	546
   q13	16948	2846	2863	2846
   q14	273	257	265	257
   q15	506	454	475	454
   q16	458	429	411	411
   q17	1724	1521	1461	1461
   q18	7435	7399	7501	7399
   q19	1683	1545	1563	1545
   q20	2021	1792	1908	1792
   q21	5170	4875	4852	4852
   q22	529	447	460	447
   Total cold run time: 70261 ms
   Total hot run time: 53632 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2022000494

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt merged PR #32885:
URL: https://github.com/apache/doris/pull/32885


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2026745531

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2026745501

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2022056185

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 37870 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e095605fc8b800b6305384dcb677625094c336b3, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17624	4280	4124	4124
   q2	2105	153	152	152
   q3	10647	1130	1178	1130
   q4	10234	794	764	764
   q5	7446	2986	2976	2976
   q6	205	124	122	122
   q7	1021	582	568	568
   q8	9340	1951	1942	1942
   q9	7127	6579	6551	6551
   q10	8426	3500	3497	3497
   q11	429	230	222	222
   q12	403	198	193	193
   q13	17793	2848	2865	2848
   q14	221	202	204	202
   q15	507	458	466	458
   q16	507	380	378	378
   q17	931	595	560	560
   q18	7077	6392	6354	6354
   q19	1857	1358	1435	1358
   q20	548	279	241	241
   q21	3510	2928	2953	2928
   q22	349	302	304	302
   Total cold run time: 108307 ms
   Total hot run time: 37870 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4110	4115	4085	4085
   q2	335	230	233	230
   q3	2982	2876	2814	2814
   q4	1818	1577	1574	1574
   q5	5296	5318	5331	5318
   q6	197	117	120	117
   q7	2247	1869	1870	1869
   q8	3161	3310	3274	3274
   q9	8690	8698	8702	8698
   q10	3782	3801	3711	3711
   q11	551	460	457	457
   q12	736	554	531	531
   q13	17196	2886	2849	2849
   q14	278	261	246	246
   q15	498	472	465	465
   q16	457	425	405	405
   q17	1733	1506	1474	1474
   q18	7503	7284	7232	7232
   q19	1659	1532	1531	1531
   q20	1912	1732	1713	1713
   q21	4854	4673	4817	4673
   q22	521	453	445	445
   Total cold run time: 70516 ms
   Total hot run time: 53711 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2026487652

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Improvement](materialized-view) The materialized view can not involved auto increment column [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32885:
URL: https://github.com/apache/doris/pull/32885#issuecomment-2022076202

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit e095605fc8b800b6305384dcb677625094c336b3 with default session variables
   Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
   Insert into select:       13.9 seconds inserted 10000000 Rows, about 719K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org