You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Jibing-Li (via GitHub)" <gi...@apache.org> on 2023/12/28 12:12:47 UTC

[PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Jibing-Li opened a new pull request, #29254:
URL: https://github.com/apache/doris/pull/29254

   Create or update table stats after alter column stats.
   Set flag to disable auto analyze for the table after user inject column stats.
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #29254:
URL: https://github.com/apache/doris/pull/29254


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882467386

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882499735

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38809 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 261c3295caba9cf0ee48f4930337603251c63c0b, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17668	4974	4940	4940
   q2	2031	154	145	145
   q3	10756	1182	1155	1155
   q4	10429	789	848	789
   q5	7813	2998	3005	2998
   q6	226	130	127	127
   q7	920	513	500	500
   q8	9231	1994	2027	1994
   q9	6482	6456	6400	6400
   q10	8291	3043	3027	3027
   q11	454	211	209	209
   q12	401	235	234	234
   q13	18012	3438	3386	3386
   q14	244	212	209	209
   q15	559	508	501	501
   q16	497	402	395	395
   q17	961	701	610	610
   q18	7379	6743	6690	6690
   q19	1574	1539	1528	1528
   q20	712	334	316	316
   q21	2738	2350	2397	2350
   q22	391	306	314	306
   Total cold run time: 107769 ms
   Total hot run time: 38809 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4901	4940	4928	4928
   q2	342	238	249	238
   q3	3299	3317	3315	3315
   q4	2131	2016	2005	2005
   q5	5839	5780	5827	5780
   q6	203	115	117	115
   q7	2372	1935	1906	1906
   q8	3394	3481	3525	3481
   q9	8819	8786	8813	8786
   q10	3848	3878	3890	3878
   q11	549	454	456	454
   q12	809	631	643	631
   q13	4029	3171	3202	3171
   q14	307	263	289	263
   q15	554	507	502	502
   q16	570	514	486	486
   q17	1848	1923	1872	1872
   q18	8592	8447	8340	8340
   q19	1603	1636	1624	1624
   q20	2229	1997	1967	1967
   q21	5525	5303	5333	5303
   q22	519	467	463	463
   Total cold run time: 62282 ms
   Total hot run time: 59508 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871823785

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 4db24fae866dbbfa1105647aaf9f89f7045b6277, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5491	5149	5174	5149
   q2	389	178	158	158
   q3	1449	1118	1269	1118
   q4	1097	860	805	805
   q5	3165	3084	3124	3084
   q6	232	138	142	138
   q7	995	559	527	527
   q8	2139	2134	2147	2134
   q9	6723	6667	6646	6646
   q10	3190	3212	3170	3170
   q11	345	233	235	233
   q12	392	244	240	240
   q13	4392	3624	3635	3624
   q14	262	229	219	219
   q15	635	579	566	566
   q16	463	396	393	393
   q17	1043	686	531	531
   q18	7131	6759	6831	6759
   q19	1635	1559	1616	1559
   q20	573	388	371	371
   q21	2900	2470	2434	2434
   q22	408	333	341	333
   Total cold run time: 45049 ms
   Total hot run time: 40191 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5044	5101	5060	5060
   q2	334	259	250	250
   q3	3376	3345	3328	3328
   q4	2140	2016	1999	1999
   q5	5935	5914	5923	5914
   q6	238	132	133	132
   q7	2399	1982	1955	1955
   q8	3569	3649	3649	3649
   q9	9123	9027	8988	8988
   q10	3885	3930	3946	3930
   q11	601	491	487	487
   q12	801	655	645	645
   q13	3877	3208	3188	3188
   q14	307	279	272	272
   q15	648	564	569	564
   q16	556	532	529	529
   q17	2046	1807	1808	1807
   q18	8830	8301	8367	8301
   q19	1750	1752	1707	1707
   q20	2292	2013	1994	1994
   q21	5712	5300	5340	5300
   q22	559	544	523	523
   Total cold run time: 64022 ms
   Total hot run time: 60522 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871232567

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882484366

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882511062

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 45.55 seconds
    stream load tsv:          567 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          27.4 seconds inserted 10000000 Rows, about 364K ops/s
    storage size: 17183774023 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871283280

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 08f961d1d8a98126df9a966ebc0ba4aed35450aa, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5511	5157	5077	5077
   q2	392	181	170	170
   q3	1471	1217	1278	1217
   q4	1108	900	822	822
   q5	3146	3074	3070	3070
   q6	232	142	139	139
   q7	992	566	532	532
   q8	2185	2233	2211	2211
   q9	6860	6851	6835	6835
   q10	3207	3137	3127	3127
   q11	357	225	230	225
   q12	394	248	237	237
   q13	4410	3640	3636	3636
   q14	252	214	232	214
   q15	615	562	558	558
   q16	463	405	429	405
   q17	1054	538	539	538
   q18	7116	6799	6737	6737
   q19	1649	1571	1500	1500
   q20	598	340	351	340
   q21	2934	2508	2547	2508
   q22	392	340	343	340
   Total cold run time: 45338 ms
   Total hot run time: 40438 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5092	5127	5037	5037
   q2	340	265	255	255
   q3	3369	3333	3308	3308
   q4	2157	1968	2015	1968
   q5	5947	5949	5961	5949
   q6	239	131	136	131
   q7	2418	1937	1937	1937
   q8	3537	3640	3650	3640
   q9	9135	9019	9046	9019
   q10	3894	3949	3936	3936
   q11	577	501	492	492
   q12	806	630	656	630
   q13	3878	3172	3203	3172
   q14	295	283	280	280
   q15	629	550	575	550
   q16	551	523	537	523
   q17	2042	1817	1799	1799
   q18	8708	8380	8341	8341
   q19	1770	1709	1740	1709
   q20	2400	2004	1984	1984
   q21	5729	5391	5268	5268
   q22	585	531	478	478
   Total cold run time: 64098 ms
   Total hot run time: 60406 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871110312

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871272409

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.56 seconds
    stream load tsv:          579 seconds loaded 74807831229 Bytes, about 123 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.7 seconds inserted 10000000 Rows, about 348K ops/s
    storage size: 17188510670 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871819685

   
   TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
   ```
   TPC-DS sf100 test result on commit 4db24fae866dbbfa1105647aaf9f89f7045b6277, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	931	355	337	337
   query2	6409	1962	1994	1962
   query3	6661	220	212	212
   query4	26968	22485	22379	22379
   query5	5038	582	558	558
   query6	285	181	176	176
   query7	4576	289	278	278
   query8	222	204	194	194
   query9	8067	2769	2719	2719
   query10	461	278	240	240
   query11	16205	15551	15477	15477
   query12	136	79	80	79
   query13	1634	335	332	332
   query14	11787	7302	7211	7211
   query15	248	188	194	188
   query16	6475	296	285	285
   query17	1769	509	499	499
   query18	1930	264	261	261
   query19	278	145	146	145
   query20	82	78	80	78
   query21	186	98	99	98
   query22	4990	4728	4450	4450
   query23	32076	31258	31364	31258
   query24	12002	2844	2778	2778
   query25	602	351	348	348
   query26	1694	144	147	144
   query27	2867	282	293	282
   query28	7035	2000	1997	1997
   query29	2061	398	398	398
   query30	286	145	147	145
   query31	947	783	781	781
   query32	91	60	59	59
   query33	717	282	281	281
   query34	821	462	453	453
   query35	881	802	791	791
   query36	1274	1291	1276	1276
   query37	201	87	87	87
   query38	3418	3252	3251	3251
   query39	1317	1283	1277	1277
   query40	303	96	90	90
   query41	38	36	34	34
   query42	98	90	95	90
   query43	522	486	493	486
   query44	1091	753	766	753
   query45	198	188	181	181
   query46	1099	649	679	649
   query47	1724	1607	1573	1573
   query48	350	277	275	275
   query49	1199	330	328	328
   query50	735	363	341	341
   query51	5490	5222	5261	5222
   query52	102	88	91	88
   query53	215	152	154	152
   query54	1478	639	634	634
   query55	100	90	91	90
   query56	221	205	208	205
   query57	1002	958	926	926
   query58	232	207	207	207
   query59	2721	2577	2502	2502
   query60	263	230	241	230
   query61	87	89	84	84
   query62	670	477	460	460
   query63	169	160	153	153
   query64	5932	1836	1725	1725
   query65	3336	3239	3240	3239
   query66	1321	339	322	322
   query67	15557	15286	15337	15286
   query68	13646	550	534	534
   query69	645	268	262	262
   query70	1786	1591	1434	1434
   query71	563	237	232	232
   query72	5602	3678	3614	3614
   query73	2120	336	322	322
   query74	7047	6497	6472	6472
   query75	6023	2261	2247	2247
   query76	6195	1112	1113	1112
   query77	911	298	292	292
   query78	9054	8580	8522	8522
   query79	3826	513	515	513
   query80	1101	385	391	385
   query81	513	212	204	204
   query82	242	126	123	123
   query83	408	148	144	144
   query84	259	59	56	56
   query85	989	294	299	294
   query86	403	414	390	390
   query87	3547	3360	3370	3360
   query88	3248	2388	2401	2388
   query89	324	268	256	256
   query90	1902	248	246	246
   query91	122	104	94	94
   query92	72	59	55	55
   query93	2709	515	450	450
   query94	876	216	217	216
   query95	503	471	459	459
   query96	649	331	330	330
   query97	4318	4124	4180	4124
   query98	217	194	188	188
   query99	1117	869	817	817
   Total cold run time: 300818 ms
   Total hot run time: 180224 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882467418

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871798303

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882427992

   run buidall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882510660

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 183941 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 261c3295caba9cf0ee48f4930337603251c63c0b, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	889	345	337	337
   query2	5543	2014	1833	1833
   query3	6079	235	218	218
   query4	27547	22610	22531	22531
   query5	5531	609	591	591
   query6	346	210	202	202
   query7	4530	312	312	312
   query8	267	226	222	222
   query9	8560	2923	2911	2911
   query10	571	344	351	344
   query11	16091	15697	15801	15697
   query12	162	126	96	96
   query13	1690	334	341	334
   query14	12174	7659	7685	7659
   query15	251	238	238	238
   query16	6127	336	324	324
   query17	1653	523	534	523
   query18	1914	302	297	297
   query19	225	166	165	165
   query20	110	101	105	101
   query21	180	99	91	91
   query22	5042	4777	4768	4768
   query23	32231	31061	31426	31061
   query24	12068	2951	2947	2947
   query25	577	365	367	365
   query26	1663	173	175	173
   query27	2870	308	311	308
   query28	6464	2110	2112	2110
   query29	1844	408	416	408
   query30	277	146	148	146
   query31	1032	831	811	811
   query32	126	88	74	74
   query33	801	342	347	342
   query34	867	480	493	480
   query35	974	911	933	911
   query36	1331	1233	1276	1233
   query37	187	90	94	90
   query38	3556	3346	3420	3346
   query39	1346	1302	1319	1302
   query40	288	90	85	85
   query41	38	37	36	36
   query42	110	115	103	103
   query43	543	537	526	526
   query44	1208	800	819	800
   query45	215	212	215	212
   query46	1106	704	719	704
   query47	1727	1598	1588	1588
   query48	383	295	280	280
   query49	1085	326	324	324
   query50	735	363	333	333
   query51	5513	5269	5395	5269
   query52	103	100	93	93
   query53	229	168	168	168
   query54	1134	666	639	639
   query55	106	102	97	97
   query56	259	250	258	250
   query57	1028	1001	990	990
   query58	302	256	270	256
   query59	2965	2769	2904	2769
   query60	326	287	290	287
   query61	135	150	150	150
   query62	579	502	491	491
   query63	194	188	169	169
   query64	5527	1829	1764	1764
   query65	3449	3375	3345	3345
   query66	1273	401	370	370
   query67	15575	15267	15575	15267
   query68	13303	537	569	537
   query69	602	303	311	303
   query70	1765	1635	1605	1605
   query71	596	274	256	256
   query72	5495	3453	3478	3453
   query73	3052	345	350	345
   query74	7003	6663	6572	6572
   query75	5873	2302	2261	2261
   query76	6815	1047	1242	1047
   query77	1050	343	324	324
   query78	9155	8537	8504	8504
   query79	1093	554	517	517
   query80	637	348	343	343
   query81	482	215	218	215
   query82	226	106	103	103
   query83	227	142	143	142
   query84	251	59	59	59
   query85	879	278	270	270
   query86	434	444	424	424
   query87	3629	3501	3454	3454
   query88	3244	2514	2446	2446
   query89	357	285	287	285
   query90	2212	262	252	252
   query91	126	94	96	94
   query92	98	76	72	72
   query93	1205	424	486	424
   query94	1032	245	252	245
   query95	594	508	508	508
   query96	636	328	344	328
   query97	4406	4232	4235	4232
   query98	244	219	226	219
   query99	1153	876	836	836
   Total cold run time: 297705 ms
   Total hot run time: 183941 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871155062

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.55 seconds
    stream load tsv:          567 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          29.1 seconds inserted 10000000 Rows, about 343K ops/s
    storage size: 17184131486 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871188257

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 8fb7c5b44e3fa3cf865025fcd8fb3d01d08bb343, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4977	4658	4691	4658
   q2	371	164	160	160
   q3	1457	1314	1231	1231
   q4	1133	963	919	919
   q5	3202	3179	3163	3163
   q6	258	129	129	129
   q7	1038	488	497	488
   q8	2269	2260	2260	2260
   q9	6725	6717	6717	6717
   q10	3204	3270	3262	3262
   q11	338	222	207	207
   q12	353	219	207	207
   q13	4139	3412	3365	3365
   q14	244	214	213	213
   q15	569	524	526	524
   q16	443	389	381	381
   q17	1054	813	588	588
   q18	7112	6833	6782	6782
   q19	1630	1637	1651	1637
   q20	511	293	309	293
   q21	3191	2727	2706	2706
   q22	371	301	308	301
   Total cold run time: 44589 ms
   Total hot run time: 40191 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4601	4624	4579	4579
   q2	270	164	170	164
   q3	3375	3371	3358	3358
   q4	2229	2206	2208	2206
   q5	5723	5724	5715	5715
   q6	239	121	123	121
   q7	2379	1889	1860	1860
   q8	3610	3621	3610	3610
   q9	8959	8983	8964	8964
   q10	3811	3908	3890	3890
   q11	484	363	369	363
   q12	772	599	596	596
   q13	3888	3199	3151	3151
   q14	292	254	263	254
   q15	570	523	523	523
   q16	497	454	467	454
   q17	1990	1949	1941	1941
   q18	8604	8217	8117	8117
   q19	1763	1755	1751	1751
   q20	2241	1939	1902	1902
   q21	6122	5751	5744	5744
   q22	564	467	469	467
   Total cold run time: 62983 ms
   Total hot run time: 59730 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871820857

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.75 seconds
    stream load tsv:          578 seconds loaded 74807831229 Bytes, about 123 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.6 seconds inserted 10000000 Rows, about 349K ops/s
    storage size: 17184171859 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871814769

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 4db24fae866dbbfa1105647aaf9f89f7045b6277, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17640	5164	5032	5032
   q2	2009	160	146	146
   q3	10528	1079	1145	1079
   q4	10202	854	847	847
   q5	7794	2982	2961	2961
   q6	213	139	138	138
   q7	940	553	512	512
   q8	9287	2031	2038	2031
   q9	6885	6417	6379	6379
   q10	8260	3011	3031	3011
   q11	438	235	218	218
   q12	384	238	244	238
   q13	17987	3621	3613	3613
   q14	239	216	204	204
   q15	604	553	567	553
   q16	441	423	396	396
   q17	973	456	459	456
   q18	7272	6644	6683	6644
   q19	1585	1326	1395	1326
   q20	752	342	329	329
   q21	2842	2365	2479	2365
   q22	374	327	345	327
   Total cold run time: 107649 ms
   Total hot run time: 38805 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5135	5074	5021	5021
   q2	340	257	256	256
   q3	3329	3243	3241	3241
   q4	2124	1977	1972	1972
   q5	5778	5799	5816	5799
   q6	220	129	131	129
   q7	2327	1858	1893	1858
   q8	3372	3451	3459	3451
   q9	8819	8809	8787	8787
   q10	3775	3834	3835	3834
   q11	605	515	489	489
   q12	790	659	650	650
   q13	9687	3330	3366	3330
   q14	290	290	284	284
   q15	626	550	548	548
   q16	565	539	519	519
   q17	1984	1806	1752	1752
   q18	8685	8338	8276	8276
   q19	1634	1580	1583	1580
   q20	2192	1986	1953	1953
   q21	5614	5468	5352	5352
   q22	552	488	510	488
   Total cold run time: 68443 ms
   Total hot run time: 59569 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org