You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zclllyybb (via GitHub)" <gi...@apache.org> on 2024/09/06 02:10:52 UTC

[PR] [Enhancement](test) Add function test templates [doris]

zclllyybb opened a new pull request, #40462:
URL: https://github.com/apache/doris/pull/40462

   ## Proposed changes
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339544698

   TeamCity be ut coverage result:
    Function Coverage: 36.86% (9393/25486) 
    Line Coverage: 28.24% (77460/274286)
    Region Coverage: 27.64% (39992/144689)
    Branch Coverage: 24.27% (20343/83834)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/1d3292945ae00f224f720d738bfbbc70c6a21519_1d3292945ae00f224f720d738bfbbc70c6a21519/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333296730

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 186451 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 891440d73b92a8396dbf88229b966a687304b474, data reload: false
   
   query1	911	377	369	369
   query2	6471	1916	1904	1904
   query3	6645	204	225	204
   query4	34006	23037	22969	22969
   query5	4167	504	475	475
   query6	249	163	150	150
   query7	4579	289	290	289
   query8	271	220	214	214
   query9	8490	2459	2447	2447
   query10	430	265	265	265
   query11	16679	14924	15137	14924
   query12	155	97	100	97
   query13	1631	371	358	358
   query14	9789	6993	7222	6993
   query15	282	182	170	170
   query16	8092	443	444	443
   query17	1548	560	546	546
   query18	2115	285	279	279
   query19	329	139	145	139
   query20	116	107	132	107
   query21	217	103	99	99
   query22	4680	4408	4353	4353
   query23	33916	33430	33152	33152
   query24	11117	2888	2837	2837
   query25	593	388	388	388
   query26	1132	149	152	149
   query27	2342	269	265	265
   query28	7333	2029	2016	2016
   query29	800	396	394	394
   query30	310	148	144	144
   query31	965	713	782	713
   query32	99	52	57	52
   query33	745	274	271	271
   query34	1015	471	469	469
   query35	879	728	720	720
   query36	1044	896	934	896
   query37	153	95	86	86
   query38	3948	3891	3840	3840
   query39	1445	1381	1378	1378
   query40	197	114	111	111
   query41	48	45	45	45
   query42	116	94	95	94
   query43	503	453	457	453
   query44	1214	739	731	731
   query45	191	163	163	163
   query46	1105	779	724	724
   query47	1876	1803	1827	1803
   query48	353	287	294	287
   query49	1101	426	432	426
   query50	799	397	410	397
   query51	6961	6914	6831	6831
   query52	97	86	87	86
   query53	249	183	175	175
   query54	901	441	483	441
   query55	75	76	72	72
   query56	271	242	265	242
   query57	1178	1088	1053	1053
   query58	239	230	239	230
   query59	2948	2768	2752	2752
   query60	293	268	259	259
   query61	104	100	100	100
   query62	834	659	651	651
   query63	222	185	184	184
   query64	4268	710	629	629
   query65	3194	3150	3149	3149
   query66	1462	343	339	339
   query67	15428	15505	15199	15199
   query68	3344	599	557	557
   query69	388	272	281	272
   query70	1127	1123	1103	1103
   query71	332	267	269	267
   query72	6443	3999	4022	3999
   query73	737	323	320	320
   query74	9007	8673	8851	8673
   query75	3379	2633	2703	2633
   query76	1913	970	978	970
   query77	501	311	308	308
   query78	9623	9048	9132	9048
   query79	1015	533	524	524
   query80	691	496	490	490
   query81	456	231	228	228
   query82	245	130	138	130
   query83	169	151	150	150
   query84	232	87	76	76
   query85	683	284	279	279
   query86	316	309	277	277
   query87	4424	4328	4208	4208
   query88	3010	2276	2255	2255
   query89	380	292	284	284
   query90	1915	189	200	189
   query91	120	111	113	111
   query92	61	48	48	48
   query93	1045	548	609	548
   query94	673	298	285	285
   query95	337	257	247	247
   query96	587	257	257	257
   query97	3199	3041	3066	3041
   query98	213	195	199	195
   query99	1480	1289	1293	1289
   Total cold run time: 283960 ms
   Total hot run time: 186451 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2350842986

   TeamCity be ut coverage result:
    Function Coverage: 36.91% (9473/25663) 
    Line Coverage: 28.26% (77852/275490)
    Region Coverage: 27.67% (40212/145319)
    Branch Coverage: 24.27% (20426/84152)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/fc2a7f7e221d25452b3c85cb878e45e8d92a67c7_fc2a7f7e221d25452b3c85cb878e45e8d92a67c7/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333141879

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 192586 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e1769fad264a14e05eae888d436fb0a5f631b63a, data reload: false
   
   query1	1273	890	879	879
   query2	6335	1957	1955	1955
   query3	10551	4104	3972	3972
   query4	59572	25547	23115	23115
   query5	5448	494	512	494
   query6	400	161	157	157
   query7	5775	294	292	292
   query8	310	228	235	228
   query9	9082	2520	2510	2510
   query10	500	279	271	271
   query11	18394	14965	15344	14965
   query12	153	99	97	97
   query13	1566	398	387	387
   query14	11142	7295	7332	7295
   query15	252	176	182	176
   query16	7580	485	473	473
   query17	1125	573	578	573
   query18	1928	313	291	291
   query19	280	152	145	145
   query20	120	112	108	108
   query21	207	104	113	104
   query22	4685	4736	4634	4634
   query23	34540	33348	33687	33348
   query24	5928	2833	2888	2833
   query25	520	388	387	387
   query26	679	151	162	151
   query27	1792	274	280	274
   query28	3799	2039	2040	2039
   query29	669	404	416	404
   query30	228	160	161	160
   query31	937	781	779	779
   query32	85	58	60	58
   query33	481	313	287	287
   query34	877	475	478	475
   query35	842	735	735	735
   query36	1074	931	937	931
   query37	149	83	84	83
   query38	3988	3889	3927	3889
   query39	1432	1418	1385	1385
   query40	201	115	108	108
   query41	45	44	44	44
   query42	111	95	95	95
   query43	549	501	475	475
   query44	1100	759	748	748
   query45	198	168	164	164
   query46	1080	764	713	713
   query47	1930	1789	1824	1789
   query48	382	298	303	298
   query49	768	431	443	431
   query50	842	410	435	410
   query51	7052	6878	6882	6878
   query52	97	88	87	87
   query53	256	182	184	182
   query54	565	450	493	450
   query55	74	75	73	73
   query56	288	256	257	256
   query57	1157	1085	1091	1085
   query58	228	223	231	223
   query59	3077	2794	2954	2794
   query60	297	254	260	254
   query61	100	100	100	100
   query62	745	635	662	635
   query63	227	184	190	184
   query64	2768	724	644	644
   query65	3231	3145	3146	3145
   query66	654	336	324	324
   query67	15345	15288	15171	15171
   query68	2965	588	591	588
   query69	402	278	281	278
   query70	1166	1133	1037	1037
   query71	353	279	270	270
   query72	5342	4101	3967	3967
   query73	763	331	332	331
   query74	9336	8814	8862	8814
   query75	3351	2645	2695	2645
   query76	1396	958	1006	958
   query77	532	372	328	328
   query78	9681	9136	8994	8994
   query79	1034	543	532	532
   query80	696	497	509	497
   query81	458	232	229	229
   query82	234	135	139	135
   query83	177	149	154	149
   query84	263	79	72	72
   query85	682	293	282	282
   query86	303	268	280	268
   query87	4477	4277	4390	4277
   query88	2923	2339	2347	2339
   query89	374	284	297	284
   query90	1885	188	192	188
   query91	128	100	95	95
   query92	62	48	48	48
   query93	1062	546	603	546
   query94	648	289	299	289
   query95	331	248	255	248
   query96	581	266	261	261
   query97	3211	3114	3090	3090
   query98	214	197	192	192
   query99	1513	1256	1274	1256
   Total cold run time: 304608 ms
   Total hot run time: 192586 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on code in PR #40462:
URL: https://github.com/apache/doris/pull/40462#discussion_r1751279702


##########
regression-test/suites/query_p0/sql_functions/test_template_three_args.groovy:
##########
@@ -0,0 +1,110 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite("test_template_three_args") {
+    // this table has nothing todo. just make it eaiser to generate query
+    sql " drop table if exists hits_three_args "
+    sql """ create table hits_three_args(
+                nothing boolean
+            )
+            properties("replication_num" = "1");
+    """
+    sql "insert into hits_three_args values(true);"
+
+    sql " drop table if exists arg1_three_args"
+    sql """
+        create table arg1_three_args (
+            k0 int,
+            a varchar not null,
+            b varchar null,
+        )
+        DISTRIBUTED BY HASH(k0)
+        PROPERTIES
+        (
+            "replication_num" = "1"
+        );
+    """
+
+    order_qt_empty_nullable "select concat(a, a, a) from arg1_three_args"
+    order_qt_empty_not_nullable "select concat(b, b, b) from arg1_three_args"
+    order_qt_empty_partial_nullable "select concat(a, b, b) from arg1_three_args"
+
+    sql """ insert into arg1_three_args values (1, "", ""), (2, "中文", "中文"), (3, "123123", "123123"),
+            (4, "\\\\a\\\\b\\\\c\\\\d", "\\\\a\\\\b\\\\c\\\\d"),
+            (5, "!@#@#\$#^\$%%\$^", "!@#@#\$#^\$%%\$^"), (6, "   ", "   "),
+            (7, "", NULL);
+    """
+
+    order_qt_nullable """
+        SELECT concat(t.arg1_three_args, t.ARG2, t.ARG3) as result
+        FROM (
+            SELECT hits_three_args.nothing, TABLE1.arg1_three_args, TABLE1.order1, TABLE2.ARG2, TABLE2.order2, TABLE3.ARG3, TABLE3.order3
+            FROM hits_three_args
+            CROSS JOIN (
+                SELECT b as arg1_three_args, k0 as order1
+                FROM arg1_three_args
+            ) as TABLE1
+            CROSS JOIN (
+                SELECT b as ARG2, k0 as order2
+                FROM arg1_three_args
+            ) as TABLE2
+            CROSS JOIN (
+                SELECT b as ARG3, k0 as order3
+                FROM arg1_three_args
+            ) as TABLE3
+        )t;
+    """
+
+    /// nullables
+    order_qt_not_nullable "select concat(a, a, a) from arg1_three_args"
+    order_qt_partial_nullable "select concat(a, b, b) from arg1_three_args"
+    order_qt_nullable_no_null "select concat(a, nullable(a), nullable(a)) from arg1_three_args"
+    /// if you set `use_default_implementation_for_nulls` to false, add:

Review Comment:
   this will grow exponentially, and most of the time it's unnecessary overhead for test time.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2350849232

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.55 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit fc2a7f7e221d25452b3c85cb878e45e8d92a67c7, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.08	0.04	0.04
   query3	0.23	0.05	0.05
   query4	1.68	0.07	0.06
   query5	0.50	0.50	0.50
   query6	1.16	0.74	0.73
   query7	0.02	0.01	0.01
   query8	0.06	0.04	0.04
   query9	0.57	0.52	0.52
   query10	0.60	0.60	0.57
   query11	0.16	0.12	0.12
   query12	0.15	0.12	0.13
   query13	0.63	0.61	0.60
   query14	1.45	1.47	1.47
   query15	0.89	0.86	0.88
   query16	0.36	0.36	0.37
   query17	1.07	1.04	1.00
   query18	0.22	0.21	0.21
   query19	1.90	1.82	1.81
   query20	0.01	0.01	0.01
   query21	15.42	0.68	0.65
   query22	4.10	6.71	1.66
   query23	18.08	1.36	1.38
   query24	2.27	0.23	0.22
   query25	0.18	0.08	0.08
   query26	0.30	0.18	0.18
   query27	0.08	0.08	0.08
   query28	13.19	1.14	1.12
   query29	12.56	3.39	3.35
   query30	0.25	0.06	0.05
   query31	2.88	0.42	0.41
   query32	3.22	0.51	0.49
   query33	3.05	3.05	3.06
   query34	15.46	4.33	4.32
   query35	4.35	4.33	4.38
   query36	0.68	0.49	0.50
   query37	0.20	0.17	0.16
   query38	0.16	0.15	0.14
   query39	0.05	0.04	0.04
   query40	0.17	0.13	0.12
   query41	0.10	0.05	0.05
   query42	0.06	0.05	0.04
   query43	0.04	0.04	0.04
   Total cold run time: 108.63 s
   Total hot run time: 31.55 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333229891

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.16 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 9dce1dafda6792270db28b6a78a813eff2ba6205, data reload: false
   
   query1	0.05	0.04	0.04
   query2	0.09	0.04	0.04
   query3	0.23	0.05	0.05
   query4	1.67	0.08	0.09
   query5	0.52	0.49	0.52
   query6	1.12	0.74	0.73
   query7	0.03	0.02	0.01
   query8	0.05	0.04	0.05
   query9	0.54	0.49	0.49
   query10	0.56	0.58	0.55
   query11	0.16	0.12	0.11
   query12	0.15	0.13	0.12
   query13	0.60	0.58	0.58
   query14	1.40	1.41	1.41
   query15	0.83	0.83	0.82
   query16	0.38	0.37	0.37
   query17	1.04	0.99	1.00
   query18	0.20	0.19	0.20
   query19	1.93	1.77	1.78
   query20	0.01	0.01	0.02
   query21	15.40	0.66	0.66
   query22	4.35	7.27	1.59
   query23	18.27	1.37	1.29
   query24	2.06	0.23	0.21
   query25	0.16	0.09	0.09
   query26	0.27	0.17	0.17
   query27	0.08	0.08	0.08
   query28	13.32	1.01	1.01
   query29	12.58	3.35	3.26
   query30	0.25	0.06	0.05
   query31	2.87	0.40	0.40
   query32	3.27	0.49	0.48
   query33	2.97	2.99	2.99
   query34	16.88	4.43	4.46
   query35	4.45	4.46	4.47
   query36	0.66	0.49	0.49
   query37	0.19	0.16	0.15
   query38	0.16	0.16	0.15
   query39	0.05	0.04	0.04
   query40	0.17	0.13	0.13
   query41	0.09	0.05	0.06
   query42	0.06	0.05	0.06
   query43	0.05	0.05	0.04
   Total cold run time: 110.17 s
   Total hot run time: 31.16 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339521706

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339548902

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 197575 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 1d3292945ae00f224f720d738bfbbc70c6a21519, data reload: false
   
   query1	1254	905	917	905
   query2	6330	1865	1904	1865
   query3	10627	4058	4177	4058
   query4	59555	27494	23287	23287
   query5	4988	505	502	502
   query6	399	163	169	163
   query7	5634	297	293	293
   query8	323	214	211	211
   query9	7736	2487	2489	2487
   query10	426	284	281	281
   query11	17172	15187	15662	15187
   query12	152	102	107	102
   query13	1457	438	411	411
   query14	10685	7392	7211	7211
   query15	202	185	177	177
   query16	6793	476	445	445
   query17	1099	566	559	559
   query18	1424	298	302	298
   query19	193	148	147	147
   query20	119	111	108	108
   query21	205	112	105	105
   query22	4876	4346	4436	4346
   query23	34393	34065	33186	33186
   query24	5931	2926	2854	2854
   query25	489	401	397	397
   query26	612	158	155	155
   query27	1612	278	283	278
   query28	3808	2053	2033	2033
   query29	651	404	413	404
   query30	240	155	151	151
   query31	908	760	725	725
   query32	72	50	52	50
   query33	467	290	294	290
   query34	877	486	492	486
   query35	832	739	733	733
   query36	1022	916	919	916
   query37	144	90	81	81
   query38	4076	3853	3927	3853
   query39	1447	1421	1402	1402
   query40	195	115	116	115
   query41	47	46	45	45
   query42	115	99	96	96
   query43	493	467	460	460
   query44	1112	753	750	750
   query45	196	164	160	160
   query46	1102	755	747	747
   query47	1891	1807	1815	1807
   query48	371	298	300	298
   query49	790	446	465	446
   query50	810	409	419	409
   query51	7037	6880	6884	6880
   query52	97	85	90	85
   query53	252	176	183	176
   query54	568	455	457	455
   query55	76	73	79	73
   query56	281	260	246	246
   query57	1233	1090	1088	1088
   query58	220	234	230	230
   query59	2862	2711	2843	2711
   query60	287	272	280	272
   query61	101	107	97	97
   query62	764	657	629	629
   query63	221	195	188	188
   query64	1384	677	678	677
   query65	3242	3164	3160	3160
   query66	671	342	343	342
   query67	15980	15409	15283	15283
   query68	1171	876	863	863
   query69	421	328	339	328
   query70	1133	1185	1161	1161
   query71	353	352	336	336
   query72	4600	3569	3548	3548
   query73	606	596	596	596
   query74	8953	8880	8876	8876
   query75	3038	2982	2930	2930
   query76	991	864	855	855
   query77	421	397	395	395
   query78	9342	9188	9234	9188
   query79	909	881	870	870
   query80	820	839	813	813
   query81	451	265	262	262
   query82	267	264	260	260
   query83	194	188	192	188
   query84	203	113	109	109
   query85	599	407	384	384
   query86	307	316	323	316
   query87	4560	4434	4374	4374
   query88	4273	4155	4167	4155
   query89	386	436	369	369
   query90	818	313	311	311
   query91	122	123	127	123
   query92	78	76	77	76
   query93	929	931	926	926
   query94	400	367	363	363
   query95	425	412	414	412
   query96	478	474	481	474
   query97	3108	3138	3164	3138
   query98	227	241	236	236
   query99	1311	1273	1282	1273
   Total cold run time: 293522 ms
   Total hot run time: 197575 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333150853

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.53 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e1769fad264a14e05eae888d436fb0a5f631b63a, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.08	0.04	0.04
   query3	0.22	0.05	0.05
   query4	1.68	0.07	0.07
   query5	0.50	0.48	0.50
   query6	1.13	0.73	0.73
   query7	0.02	0.01	0.01
   query8	0.05	0.04	0.05
   query9	0.53	0.48	0.49
   query10	0.55	0.54	0.52
   query11	0.16	0.11	0.12
   query12	0.15	0.12	0.12
   query13	0.61	0.58	0.58
   query14	1.46	1.47	1.41
   query15	0.84	0.82	0.84
   query16	0.37	0.36	0.38
   query17	1.00	1.04	1.00
   query18	0.21	0.20	0.20
   query19	1.83	1.77	1.79
   query20	0.01	0.01	0.01
   query21	15.40	0.65	0.65
   query22	4.51	6.82	2.16
   query23	18.28	1.27	1.26
   query24	2.15	0.22	0.22
   query25	0.15	0.09	0.08
   query26	0.27	0.18	0.17
   query27	0.08	0.08	0.08
   query28	13.21	1.02	1.00
   query29	12.60	3.38	3.31
   query30	0.24	0.05	0.06
   query31	2.88	0.41	0.39
   query32	3.23	0.48	0.46
   query33	2.99	2.97	3.00
   query34	16.97	4.38	4.47
   query35	4.56	4.44	4.48
   query36	0.66	0.48	0.48
   query37	0.19	0.15	0.15
   query38	0.15	0.15	0.14
   query39	0.04	0.03	0.04
   query40	0.16	0.14	0.13
   query41	0.10	0.05	0.05
   query42	0.06	0.05	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 110.37 s
   Total hot run time: 31.53 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333232299

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333273554

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38132 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 891440d73b92a8396dbf88229b966a687304b474, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18536	4759	4353	4353
   q2	2026	191	186	186
   q3	10506	1166	1144	1144
   q4	10162	696	786	696
   q5	7725	2864	2780	2780
   q6	230	136	139	136
   q7	954	601	594	594
   q8	9342	2280	2088	2088
   q9	7229	6539	6559	6539
   q10	7013	2186	2243	2186
   q11	469	263	244	244
   q12	399	221	223	221
   q13	17767	3056	3037	3037
   q14	286	230	248	230
   q15	530	491	479	479
   q16	509	433	430	430
   q17	992	702	687	687
   q18	7458	6974	6898	6898
   q19	1409	1059	973	973
   q20	695	344	323	323
   q21	3877	2950	2892	2892
   q22	1118	1057	1016	1016
   Total cold run time: 109232 ms
   Total hot run time: 38132 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4371	4346	4278	4278
   q2	381	272	277	272
   q3	2893	2688	2640	2640
   q4	1908	1621	1697	1621
   q5	5417	5395	5391	5391
   q6	212	131	129	129
   q7	2114	1747	1716	1716
   q8	3232	3353	3367	3353
   q9	8349	8433	8348	8348
   q10	3459	3195	3188	3188
   q11	600	507	513	507
   q12	765	580	609	580
   q13	11974	3088	3039	3039
   q14	306	266	273	266
   q15	516	476	478	476
   q16	538	482	488	482
   q17	1811	1517	1474	1474
   q18	7813	7564	7529	7529
   q19	1659	1537	1541	1537
   q20	2052	1810	1835	1810
   q21	5333	5177	5383	5177
   q22	1155	1061	1031	1031
   Total cold run time: 66858 ms
   Total hot run time: 54844 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2350834898

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333052488

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333086958

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 37966 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e1769fad264a14e05eae888d436fb0a5f631b63a, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17597	4758	4309	4309
   q2	2019	185	188	185
   q3	11747	970	1122	970
   q4	10519	754	694	694
   q5	7766	2845	2827	2827
   q6	229	141	140	140
   q7	951	621	600	600
   q8	9311	2071	2073	2071
   q9	7127	6514	6539	6514
   q10	7001	2199	2178	2178
   q11	469	248	245	245
   q12	419	227	226	226
   q13	18862	3110	3090	3090
   q14	270	240	239	239
   q15	530	496	477	477
   q16	517	429	428	428
   q17	1003	707	682	682
   q18	7309	6836	6838	6836
   q19	1385	1065	958	958
   q20	674	335	341	335
   q21	3937	2962	2957	2957
   q22	1129	1037	1005	1005
   Total cold run time: 110771 ms
   Total hot run time: 37966 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4336	4248	4250	4248
   q2	381	272	272	272
   q3	2832	2654	2647	2647
   q4	1933	1646	1627	1627
   q5	5625	5664	5731	5664
   q6	231	138	137	137
   q7	2213	1817	1802	1802
   q8	3289	3413	3467	3413
   q9	8784	8812	8792	8792
   q10	3582	3403	3397	3397
   q11	615	504	507	504
   q12	859	680	657	657
   q13	13603	3199	3249	3199
   q14	319	304	298	298
   q15	534	488	495	488
   q16	557	484	481	481
   q17	1832	1513	1552	1513
   q18	8183	7744	7920	7744
   q19	1754	1643	1690	1643
   q20	2150	1909	1907	1907
   q21	5704	5414	5431	5414
   q22	1134	1036	1067	1036
   Total cold run time: 70450 ms
   Total hot run time: 56883 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339517708

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on code in PR #40462:
URL: https://github.com/apache/doris/pull/40462#discussion_r1751280390


##########
be/test/vec/function/function_test_template.cpp:
##########
@@ -0,0 +1,57 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+#include <string>
+
+#include "function_test_util.h"
+#include "vec/core/types.h"
+#include "vec/data_types/data_type_number.h"
+#include "vec/data_types/data_type_string.h"
+
+namespace doris::vectorized {
+
+TEST(FunctionTestTemplate, two_args_template) {
+    std::string func_name = "atan2";
+
+    BaseInputTypeSet input_types = {TypeIndex::Float64, TypeIndex::Float64};
+
+    DataSet data_set = {
+            {{-1.0, -2.0}, -2.677945044588987},    {{0.0, 0.0}, 0.0},
+            {{0.5, 0.5}, 0.7853981633974483},      {{M_PI, M_PI / 2}, 1.1071487177940904},
+            {{1e100, 1e-100}, 1.5707963267948966}, {{Null(), Null()}, Null()}};
+
+    static_cast<void>(
+            check_function_all_arg_comb<DataTypeFloat64, true>(func_name, input_types, data_set));
+}
+
+TEST(FunctionTestTemplate, three_args_template) {
+    std::string func_name = "concat";
+
+    BaseInputTypeSet input_types = {TypeIndex::String, TypeIndex::String, TypeIndex::String};
+
+    DataSet data_set = {{{std::string(""), std::string(""), std::string("")}, std::string("")},
+                        {{std::string("123"), std::string("456"), std::string("789")},
+                         std::string("123456789")},
+                        {{std::string("123"), Null(), std::string("789")}, Null()},
+                        {{std::string("中文"), std::string("中文"), std::string("中文")},
+                         std::string("中文中文中文")},
+                        {{std::string("   "), std::string("   "), std::string("   ")},
+                         std::string("         ")}};
+
+    check_function_all_arg_comb<DataTypeString, true>(func_name, input_types, data_set);

Review Comment:
   can not test Decimal type



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333237920

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2350847239

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 195258 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit fc2a7f7e221d25452b3c85cb878e45e8d92a67c7, data reload: false
   
   query1	920	384	378	378
   query2	6451	1808	1767	1767
   query3	6677	213	221	213
   query4	25851	24135	24024	24024
   query5	5315	549	525	525
   query6	267	181	172	172
   query7	4600	319	318	318
   query8	277	226	220	220
   query9	8503	2587	2592	2587
   query10	482	290	285	285
   query11	16062	15536	15663	15536
   query12	163	102	104	102
   query13	1690	414	388	388
   query14	11386	6638	7234	6638
   query15	216	180	178	178
   query16	7612	473	488	473
   query17	1523	588	578	578
   query18	1988	299	300	299
   query19	201	156	157	156
   query20	122	114	113	113
   query21	219	107	108	107
   query22	4520	4066	4381	4066
   query23	34357	33887	33761	33761
   query24	9923	3134	3106	3106
   query25	694	434	428	428
   query26	1414	166	167	166
   query27	2860	287	290	287
   query28	6916	2081	2052	2052
   query29	976	446	440	440
   query30	307	160	155	155
   query31	989	783	832	783
   query32	102	59	65	59
   query33	744	308	315	308
   query34	906	484	483	483
   query35	859	761	743	743
   query36	1055	891	925	891
   query37	174	87	86	86
   query38	4078	3960	3925	3925
   query39	1449	1444	1394	1394
   query40	291	123	119	119
   query41	52	50	48	48
   query42	122	103	100	100
   query43	502	448	443	443
   query44	1224	813	791	791
   query45	200	174	174	174
   query46	1118	857	818	818
   query47	1936	1786	1789	1786
   query48	376	302	297	297
   query49	1149	460	469	460
   query50	926	453	466	453
   query51	7186	6950	6895	6895
   query52	106	91	92	91
   query53	262	192	191	191
   query54	797	477	475	475
   query55	85	79	77	77
   query56	298	283	282	282
   query57	1209	1080	1081	1080
   query58	272	235	240	235
   query59	2760	2666	2454	2454
   query60	316	283	290	283
   query61	127	127	128	127
   query62	922	664	671	664
   query63	330	198	205	198
   query64	5408	672	691	672
   query65	3297	3197	3201	3197
   query66	1382	295	303	295
   query67	15961	15552	15359	15359
   query68	3445	883	864	864
   query69	434	330	329	329
   query70	1198	1161	1183	1161
   query71	390	348	345	345
   query72	6067	3407	3481	3407
   query73	608	597	588	588
   query74	9184	9262	9040	9040
   query75	3096	3032	3029	3029
   query76	1890	866	861	861
   query77	430	415	404	404
   query78	9806	9226	9369	9226
   query79	927	901	877	877
   query80	869	850	827	827
   query81	446	264	268	264
   query82	265	267	265	265
   query83	192	190	194	190
   query84	231	110	115	110
   query85	658	418	401	401
   query86	337	308	305	305
   query87	4448	4466	4433	4433
   query88	4249	4187	4175	4175
   query89	385	372	377	372
   query90	1294	330	324	324
   query91	124	138	124	124
   query92	81	75	73	73
   query93	1087	1089	1079	1079
   query94	627	455	406	406
   query95	469	432	430	430
   query96	505	486	481	481
   query97	3155	3113	3138	3113
   query98	228	230	221	221
   query99	1543	1366	1280	1280
   Total cold run time: 280130 ms
   Total hot run time: 195258 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2350948497

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on code in PR #40462:
URL: https://github.com/apache/doris/pull/40462#discussion_r1751276915


##########
regression-test/suites/query_p0/sql_functions/test_template_three_args.groovy:
##########
@@ -0,0 +1,110 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite("test_template_three_args") {
+    // this table has nothing todo. just make it eaiser to generate query
+    sql " drop table if exists hits_three_args "
+    sql """ create table hits_three_args(
+                nothing boolean
+            )
+            properties("replication_num" = "1");
+    """
+    sql "insert into hits_three_args values(true);"
+
+    sql " drop table if exists arg1_three_args"
+    sql """
+        create table arg1_three_args (
+            k0 int,
+            a varchar not null,
+            b varchar null,
+        )
+        DISTRIBUTED BY HASH(k0)
+        PROPERTIES
+        (
+            "replication_num" = "1"
+        );
+    """
+
+    order_qt_empty_nullable "select concat(a, a, a) from arg1_three_args"
+    order_qt_empty_not_nullable "select concat(b, b, b) from arg1_three_args"
+    order_qt_empty_partial_nullable "select concat(a, b, b) from arg1_three_args"
+
+    sql """ insert into arg1_three_args values (1, "", ""), (2, "中文", "中文"), (3, "123123", "123123"),
+            (4, "\\\\a\\\\b\\\\c\\\\d", "\\\\a\\\\b\\\\c\\\\d"),
+            (5, "!@#@#\$#^\$%%\$^", "!@#@#\$#^\$%%\$^"), (6, "   ", "   "),
+            (7, "", NULL);
+    """
+
+    order_qt_nullable """
+        SELECT concat(t.arg1_three_args, t.ARG2, t.ARG3) as result
+        FROM (
+            SELECT hits_three_args.nothing, TABLE1.arg1_three_args, TABLE1.order1, TABLE2.ARG2, TABLE2.order2, TABLE3.ARG3, TABLE3.order3
+            FROM hits_three_args
+            CROSS JOIN (
+                SELECT b as arg1_three_args, k0 as order1
+                FROM arg1_three_args
+            ) as TABLE1
+            CROSS JOIN (
+                SELECT b as ARG2, k0 as order2
+                FROM arg1_three_args
+            ) as TABLE2
+            CROSS JOIN (
+                SELECT b as ARG3, k0 as order3
+                FROM arg1_three_args
+            ) as TABLE3
+        )t;
+    """
+
+    /// nullables
+    order_qt_not_nullable "select concat(a, a, a) from arg1_three_args"
+    order_qt_partial_nullable "select concat(a, b, b) from arg1_three_args"
+    order_qt_nullable_no_null "select concat(a, nullable(a), nullable(a)) from arg1_three_args"
+    /// if you set `use_default_implementation_for_nulls` to false, add:

Review Comment:
   Why not make this case available for all cases?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333057127

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333169730

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333174119

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333302891

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.33 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 891440d73b92a8396dbf88229b966a687304b474, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.07	0.04	0.04
   query3	0.24	0.05	0.04
   query4	1.67	0.07	0.07
   query5	0.50	0.48	0.50
   query6	1.14	0.72	0.72
   query7	0.02	0.01	0.02
   query8	0.05	0.04	0.05
   query9	0.54	0.50	0.48
   query10	0.53	0.55	0.55
   query11	0.16	0.12	0.12
   query12	0.14	0.13	0.12
   query13	0.59	0.58	0.59
   query14	1.41	1.45	1.44
   query15	0.84	0.81	0.81
   query16	0.37	0.38	0.38
   query17	1.03	0.97	1.00
   query18	0.21	0.20	0.19
   query19	1.97	1.80	1.78
   query20	0.00	0.01	0.01
   query21	15.40	0.68	0.67
   query22	4.33	7.40	2.01
   query23	18.29	1.46	1.27
   query24	2.06	0.24	0.21
   query25	0.15	0.08	0.08
   query26	0.27	0.19	0.17
   query27	0.08	0.07	0.08
   query28	13.25	1.02	0.99
   query29	12.64	3.33	3.30
   query30	0.24	0.05	0.05
   query31	2.89	0.39	0.39
   query32	3.27	0.48	0.47
   query33	2.94	2.95	2.98
   query34	17.14	4.40	4.37
   query35	4.45	4.46	4.41
   query36	0.66	0.47	0.48
   query37	0.19	0.15	0.15
   query38	0.15	0.14	0.14
   query39	0.05	0.04	0.04
   query40	0.16	0.13	0.12
   query41	0.09	0.04	0.04
   query42	0.06	0.05	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 110.33 s
   Total hot run time: 31.33 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on code in PR #40462:
URL: https://github.com/apache/doris/pull/40462#discussion_r1759645229


##########
be/test/vec/function/function_test_template.cpp:
##########
@@ -0,0 +1,57 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+#include <string>
+
+#include "function_test_util.h"
+#include "vec/core/types.h"
+#include "vec/data_types/data_type_number.h"
+#include "vec/data_types/data_type_string.h"
+
+namespace doris::vectorized {
+
+TEST(FunctionTestTemplate, two_args_template) {
+    std::string func_name = "atan2";
+
+    BaseInputTypeSet input_types = {TypeIndex::Float64, TypeIndex::Float64};
+
+    DataSet data_set = {
+            {{-1.0, -2.0}, -2.677945044588987},    {{0.0, 0.0}, 0.0},
+            {{0.5, 0.5}, 0.7853981633974483},      {{M_PI, M_PI / 2}, 1.1071487177940904},
+            {{1e100, 1e-100}, 1.5707963267948966}, {{Null(), Null()}, Null()}};
+
+    static_cast<void>(
+            check_function_all_arg_comb<DataTypeFloat64, true>(func_name, input_types, data_set));
+}
+
+TEST(FunctionTestTemplate, three_args_template) {
+    std::string func_name = "concat";
+
+    BaseInputTypeSet input_types = {TypeIndex::String, TypeIndex::String, TypeIndex::String};
+
+    DataSet data_set = {{{std::string(""), std::string(""), std::string("")}, std::string("")},
+                        {{std::string("123"), std::string("456"), std::string("789")},
+                         std::string("123456789")},
+                        {{std::string("123"), Null(), std::string("789")}, Null()},
+                        {{std::string("中文"), std::string("中文"), std::string("中文")},
+                         std::string("中文中文中文")},
+                        {{std::string("   "), std::string("   "), std::string("   ")},
+                         std::string("         ")}};
+
+    check_function_all_arg_comb<DataTypeString, true>(func_name, input_types, data_set);

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333062613

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333225825

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 187127 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 9dce1dafda6792270db28b6a78a813eff2ba6205, data reload: false
   
   query1	929	377	378	377
   query2	6456	1947	1835	1835
   query3	6640	206	213	206
   query4	31207	23217	22944	22944
   query5	4159	506	509	506
   query6	253	163	164	163
   query7	4578	301	309	301
   query8	282	221	235	221
   query9	8556	2478	2485	2478
   query10	456	279	275	275
   query11	17545	15079	15125	15079
   query12	160	103	100	100
   query13	1650	394	373	373
   query14	10197	6849	7143	6849
   query15	258	184	171	171
   query16	8034	437	426	426
   query17	1594	564	550	550
   query18	2066	286	277	277
   query19	336	150	156	150
   query20	121	109	109	109
   query21	216	104	104	104
   query22	4443	4152	4210	4152
   query23	34282	33286	33419	33286
   query24	11243	2873	2869	2869
   query25	633	377	387	377
   query26	1140	155	153	153
   query27	2315	274	269	269
   query28	7137	2071	2033	2033
   query29	822	441	410	410
   query30	308	162	151	151
   query31	977	786	785	785
   query32	92	56	58	56
   query33	763	295	286	286
   query34	964	466	471	466
   query35	865	721	714	714
   query36	1118	908	958	908
   query37	151	84	87	84
   query38	4167	3926	3851	3851
   query39	1439	1401	1379	1379
   query40	198	115	111	111
   query41	50	46	46	46
   query42	120	94	93	93
   query43	508	469	457	457
   query44	1250	768	753	753
   query45	200	166	166	166
   query46	1106	746	765	746
   query47	1906	1810	1832	1810
   query48	376	297	294	294
   query49	1075	436	457	436
   query50	825	409	410	409
   query51	7028	6848	6869	6848
   query52	101	90	91	90
   query53	261	189	183	183
   query54	988	509	461	461
   query55	72	74	77	74
   query56	277	256	251	251
   query57	1184	1109	1080	1080
   query58	257	217	247	217
   query59	3043	2839	2705	2705
   query60	298	271	272	271
   query61	102	97	99	97
   query62	865	633	664	633
   query63	213	187	185	185
   query64	4234	704	663	663
   query65	3249	3139	3166	3139
   query66	1412	350	341	341
   query67	15702	15183	15378	15183
   query68	3124	593	570	570
   query69	406	273	268	268
   query70	1105	1157	1089	1089
   query71	333	274	278	274
   query72	6337	4000	4055	4000
   query73	747	331	320	320
   query74	9195	8902	8800	8800
   query75	3406	2721	2735	2721
   query76	1898	1077	1028	1028
   query77	451	314	301	301
   query78	10726	9388	9093	9093
   query79	1031	543	534	534
   query80	768	496	539	496
   query81	503	234	227	227
   query82	238	139	138	138
   query83	174	151	153	151
   query84	221	83	74	74
   query85	689	283	274	274
   query86	320	301	299	299
   query87	4465	4277	4206	4206
   query88	3358	2328	2321	2321
   query89	386	294	304	294
   query90	1931	189	194	189
   query91	127	106	125	106
   query92	59	50	51	50
   query93	1040	553	542	542
   query94	870	283	289	283
   query95	352	310	249	249
   query96	587	261	264	261
   query97	3230	3176	3047	3047
   query98	210	208	195	195
   query99	1464	1262	1279	1262
   Total cold run time: 285203 ms
   Total hot run time: 187127 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339521686

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339539352

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39077 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 1d3292945ae00f224f720d738bfbbc70c6a21519, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17615	4628	4315	4315
   q2	2033	191	185	185
   q3	10826	1264	1179	1179
   q4	10341	741	750	741
   q5	8611	2921	2899	2899
   q6	233	145	141	141
   q7	998	635	613	613
   q8	9656	2123	2127	2123
   q9	7561	6706	6683	6683
   q10	7288	2250	2209	2209
   q11	472	263	256	256
   q12	400	230	234	230
   q13	17781	3096	3147	3096
   q14	289	244	251	244
   q15	532	496	497	496
   q16	541	438	431	431
   q17	996	787	796	787
   q18	7514	6979	7187	6979
   q19	1395	1068	1074	1068
   q20	660	340	343	340
   q21	3999	3028	3143	3028
   q22	1113	1034	1048	1034
   Total cold run time: 110854 ms
   Total hot run time: 39077 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4393	4297	4301	4297
   q2	374	283	269	269
   q3	2925	2713	2658	2658
   q4	1923	1700	1722	1700
   q5	6358	5777	5743	5743
   q6	233	135	138	135
   q7	2213	1849	1884	1849
   q8	3297	3460	3472	3460
   q9	9056	9010	8762	8762
   q10	3586	3427	3344	3344
   q11	613	539	519	519
   q12	854	650	655	650
   q13	9138	3278	3228	3228
   q14	337	296	300	296
   q15	523	492	496	492
   q16	582	487	503	487
   q17	1830	1545	1563	1545
   q18	8345	7915	7848	7848
   q19	1756	1545	1565	1545
   q20	2216	1895	1970	1895
   q21	5526	5404	5412	5404
   q22	1168	1103	1087	1087
   Total cold run time: 67246 ms
   Total hot run time: 57213 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2350841972

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 42960 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit fc2a7f7e221d25452b3c85cb878e45e8d92a67c7, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17981	7401	7265	7265
   q2	2607	205	190	190
   q3	10766	1344	1326	1326
   q4	10156	1002	998	998
   q5	7722	3197	3137	3137
   q6	239	152	154	152
   q7	1033	629	625	625
   q8	9454	2031	2003	2003
   q9	6727	6261	6302	6261
   q10	7024	2516	2521	2516
   q11	428	256	261	256
   q12	414	241	236	236
   q13	17759	3043	3037	3037
   q14	292	244	252	244
   q15	589	530	521	521
   q16	529	426	429	426
   q17	998	959	952	952
   q18	7355	6711	6724	6711
   q19	1379	1242	1229	1229
   q20	620	338	332	332
   q21	3914	3548	3543	3543
   q22	1075	1000	1032	1000
   Total cold run time: 109061 ms
   Total hot run time: 42960 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	7148	7153	7175	7153
   q2	352	233	232	232
   q3	2941	2884	2908	2884
   q4	1964	1989	1956	1956
   q5	5489	5432	5427	5427
   q6	234	145	149	145
   q7	2078	1726	1695	1695
   q8	3224	3336	3293	3293
   q9	8430	8436	8394	8394
   q10	3402	3447	3477	3447
   q11	575	470	473	470
   q12	749	564	611	564
   q13	6513	3051	3063	3051
   q14	290	276	273	273
   q15	590	534	523	523
   q16	495	451	449	449
   q17	1759	1744	1706	1706
   q18	8082	7498	7639	7498
   q19	1715	1696	1693	1693
   q20	2033	1807	1841	1807
   q21	5654	5405	5461	5405
   q22	1114	1020	1011	1011
   Total cold run time: 64831 ms
   Total hot run time: 59076 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 merged PR #40462:
URL: https://github.com/apache/doris/pull/40462


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333279337

   TeamCity be ut coverage result:
    Function Coverage: 36.87% (9383/25450) 
    Line Coverage: 28.23% (77350/273965)
    Region Coverage: 27.64% (39953/144547)
    Branch Coverage: 24.27% (20335/83774)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/891440d73b92a8396dbf88229b966a687304b474_891440d73b92a8396dbf88229b966a687304b474/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2333216530

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38266 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 9dce1dafda6792270db28b6a78a813eff2ba6205, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18417	4564	4407	4407
   q2	2029	191	183	183
   q3	10456	1196	1088	1088
   q4	10183	725	758	725
   q5	7728	2852	2791	2791
   q6	228	138	136	136
   q7	959	615	605	605
   q8	9321	2111	2039	2039
   q9	7264	6540	6559	6540
   q10	7007	2202	2261	2202
   q11	476	244	246	244
   q12	401	226	216	216
   q13	17785	3064	3050	3050
   q14	287	234	254	234
   q15	541	496	496	496
   q16	519	420	451	420
   q17	979	670	728	670
   q18	7513	6955	6944	6944
   q19	1398	1036	1040	1036
   q20	680	322	327	322
   q21	3961	3062	2899	2899
   q22	1144	1053	1019	1019
   Total cold run time: 109276 ms
   Total hot run time: 38266 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4378	4323	4292	4292
   q2	382	275	269	269
   q3	2913	2663	2658	2658
   q4	1972	1648	1638	1638
   q5	5427	5407	5400	5400
   q6	219	131	126	126
   q7	2079	1745	1704	1704
   q8	3236	3366	3364	3364
   q9	8502	8444	8462	8444
   q10	3468	3173	3159	3159
   q11	586	498	532	498
   q12	788	623	642	623
   q13	12670	3083	3100	3083
   q14	312	283	270	270
   q15	527	473	503	473
   q16	522	495	456	456
   q17	1777	1504	1482	1482
   q18	7770	7434	7361	7361
   q19	1672	1578	1507	1507
   q20	2032	1822	1815	1815
   q21	5510	5157	5137	5137
   q22	1145	1035	1024	1024
   Total cold run time: 67887 ms
   Total hot run time: 54783 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](test) Add function test templates [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40462:
URL: https://github.com/apache/doris/pull/40462#issuecomment-2339553214

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 32.52 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 1d3292945ae00f224f720d738bfbbc70c6a21519, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.08	0.04	0.04
   query3	0.22	0.05	0.04
   query4	1.68	0.08	0.08
   query5	0.51	0.52	0.49
   query6	1.13	0.73	0.72
   query7	0.02	0.01	0.01
   query8	0.06	0.05	0.05
   query9	0.54	0.47	0.49
   query10	0.55	0.55	0.55
   query11	0.16	0.12	0.11
   query12	0.15	0.13	0.12
   query13	0.60	0.59	0.59
   query14	1.43	1.47	1.43
   query15	0.85	0.81	0.82
   query16	0.37	0.38	0.38
   query17	1.06	1.00	1.00
   query18	0.21	0.19	0.21
   query19	1.93	1.89	1.83
   query20	0.01	0.01	0.01
   query21	15.39	0.67	0.67
   query22	4.33	5.63	2.83
   query23	18.35	1.37	1.29
   query24	2.19	0.22	0.22
   query25	0.15	0.07	0.09
   query26	0.28	0.18	0.17
   query27	0.07	0.09	0.08
   query28	13.24	1.04	1.01
   query29	12.61	3.37	3.35
   query30	0.24	0.06	0.05
   query31	2.89	0.40	0.39
   query32	3.24	0.48	0.48
   query33	2.99	3.01	3.05
   query34	17.23	4.49	4.44
   query35	4.52	4.46	4.43
   query36	0.66	0.48	0.48
   query37	0.17	0.15	0.16
   query38	0.15	0.15	0.15
   query39	0.05	0.04	0.04
   query40	0.16	0.12	0.13
   query41	0.09	0.05	0.04
   query42	0.06	0.05	0.05
   query43	0.04	0.05	0.04
   Total cold run time: 110.7 s
   Total hot run time: 32.52 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org