You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "LiBinfeng-01 (via GitHub)" <gi...@apache.org> on 2024/06/05 09:57:27 UTC

[PR] [Feat](Nereids) support cost based rule hint [doris]

LiBinfeng-01 opened a new pull request, #35925:
URL: https://github.com/apache/doris/pull/35925

   Add feat of cost based rule hint
   - usage example
       /*+ COST_BASED_RULE(PLACE_DISTINCT_INTO_SET) */ 
        /*+ COST_BASED_RULE(NO_PLACE_DISTINCT_INTO_SET) */ 
   - all hints of this kind are list here:
   PLACE_DISTINCT_INTO_SET
   PUSH_DOWN_AGG_THROUGH_JOIN_ONE_SIDE
   PUSH_DOWN_AGG_THROUGH_JOIN
   PUSH_DOWN_DISTINCT_THROUGH_JOIN
   NO_PLACE_DISTINCT_INTO_SET
   NO_PUSH_DOWN_AGG_THROUGH_JOIN_ONE_SIDE
   NO_PUSH_DOWN_AGG_THROUGH_JOIN
   NO_PUSH_DOWN_DISTINCT_THROUGH_JOIN
   - remove sessionvariable enableNereidsRules
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support use cbo rule hint [doris]

Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow commented on code in PR #35925:
URL: https://github.com/apache/doris/pull/35925#discussion_r1650951923


##########
fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/rewrite/CostBasedRewriteJob.java:
##########
@@ -70,12 +75,46 @@ public void execute(JobContext jobContext) {
                     rewriteJobs, currentCtx.getRewritePlan());
             return;
         }
+        Pair<Boolean, Boolean> checkHint = checkRuleHint();
+        if (checkHint.first) {
+            if (checkHint.second) {
+                currentCtx.setRewritePlan(applyCboRuleCtx.getRewritePlan());
+            }
+            return;
+        }
         // If the candidate applied cbo rule is better, replace the original plan with it.
         if (appliedCboRuleCost.get().first.getValue() < skipCboRuleCost.get().first.getValue()) {
             currentCtx.setRewritePlan(applyCboRuleCtx.getRewritePlan());
         }
     }
 
+    private Pair<Boolean, Boolean> checkRuleHint() {

Review Comment:
   add comment to explain the first and second of the return Pair



##########
fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/rewrite/CostBasedRewriteJob.java:
##########
@@ -70,12 +75,46 @@ public void execute(JobContext jobContext) {
                     rewriteJobs, currentCtx.getRewritePlan());
             return;
         }
+        Pair<Boolean, Boolean> checkHint = checkRuleHint();
+        if (checkHint.first) {
+            if (checkHint.second) {
+                currentCtx.setRewritePlan(applyCboRuleCtx.getRewritePlan());
+            }
+            return;
+        }
         // If the candidate applied cbo rule is better, replace the original plan with it.
         if (appliedCboRuleCost.get().first.getValue() < skipCboRuleCost.get().first.getValue()) {
             currentCtx.setRewritePlan(applyCboRuleCtx.getRewritePlan());
         }
     }
 
+    private Pair<Boolean, Boolean> checkRuleHint() {
+        Pair<Boolean, Boolean> checkResult = Pair.of(false, false);
+        if (rewriteJobs.get(0) instanceof RootPlanTreeRewriteJob) {
+            for (Rule rule : ((RootPlanTreeRewriteJob) rewriteJobs.get(0)).getRules()) {
+                checkResult = checkRuleHintWithHintName(rule.getRuleType());
+            }
+        }
+        if (rewriteJobs.get(0) instanceof CustomRewriteJob) {
+            checkResult = checkRuleHintWithHintName(((CustomRewriteJob) rewriteJobs.get(0)).getRuleType());
+        }
+        return checkResult;
+    }
+
+    private Pair<Boolean, Boolean> checkRuleHintWithHintName(RuleType ruleType) {

Review Comment:
   add comment to explain the first and second of the return Pair



##########
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PushDownAggThroughJoinOneSide.java:
##########
@@ -80,7 +80,8 @@ public List<Rule> buildRules() {
                         .thenApply(ctx -> {
                             Set<Integer> enableNereidsRules = ctx.cascadesContext.getConnectContext()
                                     .getSessionVariable().getEnableNereidsRules();
-                            if (!enableNereidsRules.contains(RuleType.PUSH_DOWN_AGG_THROUGH_JOIN_ONE_SIDE.type())) {
+                            if (!enableNereidsRules.contains(RuleType.PUSH_DOWN_AGG_THROUGH_JOIN_ONE_SIDE.type())
+                                    && !RuleType.PUSH_DOWN_AGG_THROUGH_JOIN_ONE_SIDE.checkUseCboRuleHint()) {

Review Comment:
   why add here? i think the mod of cost based rewrite is enough



##########
fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/rewrite/CostBasedRewriteJob.java:
##########
@@ -70,12 +75,46 @@ public void execute(JobContext jobContext) {
                     rewriteJobs, currentCtx.getRewritePlan());
             return;
         }
+        Pair<Boolean, Boolean> checkHint = checkRuleHint();
+        if (checkHint.first) {

Review Comment:
   if no need to rewrite, return at the beginning of execute to avoid useless rewrite for better perf



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2151577404

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160067650

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 174348 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit a89e21f9923da4e327a4c85ec230cb3932e71bc0, data reload: false
   
   query1	986	400	398	398
   query2	6462	2345	2353	2345
   query3	6674	228	230	228
   query4	19112	17384	17286	17286
   query5	4207	504	521	504
   query6	234	154	146	146
   query7	4589	303	300	300
   query8	325	314	322	314
   query9	8446	2384	2344	2344
   query10	587	285	270	270
   query11	10553	9948	10155	9948
   query12	145	94	92	92
   query13	1628	365	357	357
   query14	10162	6949	7693	6949
   query15	246	202	208	202
   query16	8110	264	256	256
   query17	1917	522	525	522
   query18	1961	269	266	266
   query19	204	156	150	150
   query20	103	94	91	91
   query21	233	132	124	124
   query22	4266	4231	4009	4009
   query23	33617	32944	33080	32944
   query24	11946	2929	2755	2755
   query25	766	448	471	448
   query26	1834	153	145	145
   query27	3069	308	316	308
   query28	7472	2041	2035	2035
   query29	1168	603	605	603
   query30	291	155	158	155
   query31	961	729	757	729
   query32	102	55	53	53
   query33	842	366	358	358
   query34	908	480	495	480
   query35	730	613	613	613
   query36	1028	962	960	960
   query37	296	77	79	77
   query38	2925	2768	2764	2764
   query39	834	797	797	797
   query40	287	123	122	122
   query41	67	62	61	61
   query42	129	103	106	103
   query43	541	563	547	547
   query44	1220	719	726	719
   query45	197	165	166	165
   query46	1137	756	763	756
   query47	1893	1785	1825	1785
   query48	392	316	327	316
   query49	1178	401	408	401
   query50	758	375	392	375
   query51	6773	6689	6604	6604
   query52	106	105	100	100
   query53	386	297	297	297
   query54	1033	494	495	494
   query55	79	78	80	78
   query56	355	331	327	327
   query57	1161	1070	1062	1062
   query58	291	270	291	270
   query59	3350	3221	3133	3133
   query60	367	337	337	337
   query61	224	229	226	226
   query62	644	451	448	448
   query63	345	308	310	308
   query64	10629	2947	2449	2449
   query65	3243	3152	3145	3145
   query66	1389	339	442	339
   query67	15650	14944	15035	14944
   query68	8783	579	569	569
   query69	694	471	396	396
   query70	1381	1094	1152	1094
   query71	520	279	296	279
   query72	8434	5816	5439	5439
   query73	2199	336	338	336
   query74	5875	5566	5559	5559
   query75	4904	2649	2694	2649
   query76	5194	884	951	884
   query77	758	326	331	326
   query78	10443	9955	9896	9896
   query79	8380	529	521	521
   query80	1067	466	453	453
   query81	551	222	227	222
   query82	478	124	106	106
   query83	307	201	201	201
   query84	304	83	81	81
   query85	998	261	256	256
   query86	359	327	337	327
   query87	3329	3103	3119	3103
   query88	4823	2357	2355	2355
   query89	548	387	401	387
   query90	2010	189	194	189
   query91	188	148	149	148
   query92	66	49	47	47
   query93	6608	526	494	494
   query94	1333	182	180	180
   query95	400	316	313	313
   query96	618	275	268	268
   query97	3205	3007	3001	3001
   query98	228	211	208	208
   query99	1164	869	825	825
   Total cold run time: 299912 ms
   Total hot run time: 174348 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160023988

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2172746541

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 173042 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 103e16d03c62c2259ec0d0e829f3f3f7584fc742, data reload: false
   
   query1	930	380	388	380
   query2	6465	2463	2264	2264
   query3	6658	207	211	207
   query4	19666	17384	17244	17244
   query5	4145	473	488	473
   query6	247	174	157	157
   query7	4598	306	294	294
   query8	314	318	291	291
   query9	8713	2389	2396	2389
   query10	611	315	299	299
   query11	10524	10103	10004	10004
   query12	140	88	85	85
   query13	1658	368	361	361
   query14	10143	6789	6895	6789
   query15	232	194	188	188
   query16	7465	271	258	258
   query17	1426	531	529	529
   query18	1895	272	270	270
   query19	194	157	152	152
   query20	95	84	82	82
   query21	209	134	124	124
   query22	4476	4195	4052	4052
   query23	33809	33241	33158	33158
   query24	12140	2812	2787	2787
   query25	662	352	356	352
   query26	1775	156	154	154
   query27	2996	322	319	319
   query28	7484	2057	2036	2036
   query29	1134	628	616	616
   query30	274	162	150	150
   query31	947	727	764	727
   query32	89	54	57	54
   query33	778	300	291	291
   query34	988	476	470	470
   query35	721	604	613	604
   query36	1068	943	963	943
   query37	217	71	70	70
   query38	2882	2726	2736	2726
   query39	840	803	779	779
   query40	283	129	125	125
   query41	58	52	54	52
   query42	127	99	105	99
   query43	590	545	533	533
   query44	1286	722	742	722
   query45	198	162	163	162
   query46	1083	717	728	717
   query47	1871	1741	1782	1741
   query48	392	302	302	302
   query49	1188	414	413	413
   query50	775	383	392	383
   query51	6920	6736	6691	6691
   query52	107	91	96	91
   query53	362	293	283	283
   query54	1043	472	435	435
   query55	75	76	74	74
   query56	287	272	263	263
   query57	1140	1068	1046	1046
   query58	256	235	261	235
   query59	3296	3228	3267	3228
   query60	293	269	267	267
   query61	89	86	89	86
   query62	641	456	461	456
   query63	332	285	284	284
   query64	10016	2262	1736	1736
   query65	3179	3086	3102	3086
   query66	1383	336	336	336
   query67	15749	15129	15017	15017
   query68	4607	553	556	553
   query69	626	441	385	385
   query70	1105	1143	1132	1132
   query71	414	282	274	274
   query72	7222	5625	5657	5625
   query73	770	325	323	323
   query74	5942	5572	5469	5469
   query75	3378	2675	2617	2617
   query76	2798	958	950	950
   query77	633	312	310	310
   query78	10252	9838	10024	9838
   query79	2266	518	525	518
   query80	1130	467	469	467
   query81	586	218	215	215
   query82	1214	112	105	105
   query83	259	166	165	165
   query84	239	86	85	85
   query85	1543	289	265	265
   query86	489	315	298	298
   query87	3247	3134	3068	3068
   query88	3803	2366	2360	2360
   query89	483	380	405	380
   query90	1780	200	202	200
   query91	141	182	97	97
   query92	63	50	50	50
   query93	1991	519	503	503
   query94	1242	187	188	187
   query95	401	313	317	313
   query96	599	277	263	263
   query97	3292	3061	3031	3031
   query98	213	201	197	197
   query99	1293	839	808	808
   Total cold run time: 276648 ms
   Total hot run time: 173042 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2153874419

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 41667 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit c2f1a44ac8ea67d64a64ad4c4cba6967a886be16, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17620	4383	4246	4246
   q2	2015	192	195	192
   q3	10459	1216	1211	1211
   q4	10190	802	741	741
   q5	7487	2834	2682	2682
   q6	220	132	134	132
   q7	976	611	625	611
   q8	9232	2148	2088	2088
   q9	9585	6732	6778	6732
   q10	9390	3876	3875	3875
   q11	455	247	244	244
   q12	505	229	229	229
   q13	17229	3221	3187	3187
   q14	279	238	238	238
   q15	531	491	469	469
   q16	492	386	372	372
   q17	976	767	650	650
   q18	8461	7927	7828	7828
   q19	6804	1259	1456	1259
   q20	635	327	331	327
   q21	5248	4006	4159	4006
   q22	398	348	348	348
   Total cold run time: 119187 ms
   Total hot run time: 41667 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4626	4365	4388	4365
   q2	373	263	265	263
   q3	3158	2840	2945	2840
   q4	1883	1567	1600	1567
   q5	5438	5534	5507	5507
   q6	222	124	122	122
   q7	2169	1843	1820	1820
   q8	3255	3384	3372	3372
   q9	8705	8645	8694	8645
   q10	4078	3825	3878	3825
   q11	584	506	466	466
   q12	783	602	608	602
   q13	15804	3103	3172	3103
   q14	311	274	268	268
   q15	537	479	481	479
   q16	474	437	439	437
   q17	1794	1497	1514	1497
   q18	8145	7714	7522	7522
   q19	2563	1576	1613	1576
   q20	3031	1779	1799	1779
   q21	4925	4853	4797	4797
   q22	675	547	544	544
   Total cold run time: 73533 ms
   Total hot run time: 55396 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154281646

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.07 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e82641953f0fd77797d3445cf6b863955dfb263f, data reload: false
   
   query1	0.04	0.04	0.03
   query2	0.08	0.04	0.04
   query3	0.24	0.05	0.04
   query4	1.67	0.07	0.08
   query5	0.51	0.48	0.51
   query6	1.13	0.72	0.72
   query7	0.02	0.02	0.02
   query8	0.06	0.04	0.04
   query9	0.54	0.48	0.49
   query10	0.55	0.55	0.54
   query11	0.17	0.12	0.11
   query12	0.15	0.12	0.12
   query13	0.59	0.60	0.61
   query14	0.79	0.78	0.80
   query15	0.84	0.83	0.80
   query16	0.36	0.36	0.37
   query17	0.96	0.98	0.96
   query18	0.20	0.27	0.23
   query19	1.91	1.82	1.72
   query20	0.02	0.01	0.01
   query21	15.45	0.71	0.67
   query22	3.74	6.83	2.46
   query23	18.29	1.45	1.40
   query24	2.14	0.22	0.21
   query25	0.16	0.08	0.09
   query26	0.28	0.18	0.17
   query27	0.09	0.08	0.08
   query28	13.25	1.02	0.99
   query29	12.64	3.18	3.20
   query30	0.26	0.05	0.05
   query31	2.85	0.41	0.38
   query32	3.26	0.47	0.46
   query33	2.88	2.91	2.87
   query34	17.26	4.42	4.46
   query35	4.49	4.43	4.45
   query36	0.65	0.47	0.47
   query37	0.18	0.15	0.15
   query38	0.15	0.15	0.14
   query39	0.04	0.03	0.03
   query40	0.17	0.14	0.15
   query41	0.09	0.05	0.05
   query42	0.06	0.05	0.05
   query43	0.04	0.04	0.04
   Total cold run time: 109.25 s
   Total hot run time: 31.07 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2151660957

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154217809

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2149462564

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 42090 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 302e0598cf9707fe60a23ee78c06e13d7601f684, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17617	4312	4276	4276
   q2	2028	193	192	192
   q3	10475	1215	987	987
   q4	10222	820	903	820
   q5	7501	2743	2674	2674
   q6	215	131	141	131
   q7	987	637	605	605
   q8	9265	2135	2105	2105
   q9	9467	6735	6746	6735
   q10	10027	3914	3859	3859
   q11	431	242	245	242
   q12	456	230	240	230
   q13	18159	3111	3334	3111
   q14	270	223	228	223
   q15	515	476	470	470
   q16	476	407	400	400
   q17	974	594	648	594
   q18	8525	7930	7929	7929
   q19	7145	1506	1523	1506
   q20	696	343	339	339
   q21	5358	4301	4391	4301
   q22	431	378	361	361
   Total cold run time: 121240 ms
   Total hot run time: 42090 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4844	4498	4593	4498
   q2	396	268	266	266
   q3	3330	3221	2922	2922
   q4	1984	1662	1658	1658
   q5	5529	5555	5545	5545
   q6	221	125	124	124
   q7	2154	1842	1854	1842
   q8	3223	3412	3374	3374
   q9	8543	8686	8713	8686
   q10	4080	3746	3667	3667
   q11	586	493	485	485
   q12	793	644	648	644
   q13	15926	3087	3122	3087
   q14	281	272	285	272
   q15	524	467	489	467
   q16	477	428	425	425
   q17	1816	1551	1481	1481
   q18	8000	7528	7318	7318
   q19	1701	1665	1590	1590
   q20	3069	1784	1780	1780
   q21	11888	4796	4745	4745
   q22	633	555	544	544
   Total cold run time: 79998 ms
   Total hot run time: 55420 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2149385888

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2174779912

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2153901794

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 171140 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit c2f1a44ac8ea67d64a64ad4c4cba6967a886be16, data reload: false
   
   query1	985	404	397	397
   query2	6454	2440	2388	2388
   query3	6677	226	246	226
   query4	19753	17234	17114	17114
   query5	4237	500	519	500
   query6	242	153	169	153
   query7	4599	296	301	296
   query8	364	327	343	327
   query9	8524	2413	2367	2367
   query10	451	288	270	270
   query11	10518	10015	10015	10015
   query12	145	94	93	93
   query13	1618	362	361	361
   query14	10341	7530	7247	7247
   query15	248	201	215	201
   query16	7419	263	256	256
   query17	1366	510	509	509
   query18	1310	278	271	271
   query19	190	152	154	152
   query20	98	91	99	91
   query21	207	131	136	131
   query22	4415	4004	4094	4004
   query23	33533	33151	33212	33151
   query24	11132	2868	2795	2795
   query25	728	442	451	442
   query26	1027	152	153	152
   query27	2842	314	318	314
   query28	6903	2041	2039	2039
   query29	880	602	609	602
   query30	298	153	157	153
   query31	984	764	765	764
   query32	90	54	54	54
   query33	854	361	357	357
   query34	897	481	486	481
   query35	737	606	610	606
   query36	1045	936	913	913
   query37	165	78	81	78
   query38	2918	2770	2729	2729
   query39	880	791	769	769
   query40	229	122	121	121
   query41	66	61	63	61
   query42	127	104	103	103
   query43	587	526	520	520
   query44	1211	729	739	729
   query45	191	170	163	163
   query46	1112	724	745	724
   query47	1895	1764	1776	1764
   query48	390	332	327	327
   query49	1083	395	399	395
   query50	780	380	388	380
   query51	6716	6668	6577	6577
   query52	109	99	98	98
   query53	374	300	307	300
   query54	927	496	497	496
   query55	84	80	87	80
   query56	364	362	333	333
   query57	1139	1084	1078	1078
   query58	287	283	281	281
   query59	3596	3144	3224	3144
   query60	378	347	357	347
   query61	170	173	171	171
   query62	639	441	448	441
   query63	335	316	304	304
   query64	9492	2632	2348	2348
   query65	3168	3088	3121	3088
   query66	892	331	315	315
   query67	15652	14882	14890	14882
   query68	4463	562	551	551
   query69	456	309	298	298
   query70	1137	1185	1069	1069
   query71	382	282	290	282
   query72	6891	4424	2643	2643
   query73	750	332	333	332
   query74	5990	5502	5534	5502
   query75	3315	2662	2641	2641
   query76	2520	896	870	870
   query77	487	342	320	320
   query78	10449	9994	9700	9700
   query79	2433	521	531	521
   query80	1135	454	453	453
   query81	554	223	228	223
   query82	753	114	112	112
   query83	271	201	199	199
   query84	244	82	86	82
   query85	1790	321	255	255
   query86	508	318	321	318
   query87	3258	3059	3104	3059
   query88	4231	2305	2316	2305
   query89	483	394	386	386
   query90	1808	184	185	184
   query91	184	150	149	149
   query92	64	46	47	46
   query93	2494	525	509	509
   query94	1226	181	181	181
   query95	401	299	306	299
   query96	588	261	266	261
   query97	3170	3011	3044	3011
   query98	215	212	212	212
   query99	1343	842	829	829
   Total cold run time: 272060 ms
   Total hot run time: 171140 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2153916604

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.8 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit c2f1a44ac8ea67d64a64ad4c4cba6967a886be16, data reload: false
   
   query1	0.04	0.03	0.04
   query2	0.08	0.04	0.04
   query3	0.23	0.06	0.05
   query4	1.65	0.07	0.08
   query5	0.51	0.49	0.51
   query6	1.12	0.72	0.73
   query7	0.02	0.02	0.01
   query8	0.06	0.04	0.04
   query9	0.54	0.50	0.49
   query10	0.54	0.55	0.55
   query11	0.15	0.11	0.11
   query12	0.15	0.13	0.12
   query13	0.60	0.58	0.60
   query14	0.79	0.78	0.77
   query15	0.84	0.81	0.82
   query16	0.37	0.36	0.37
   query17	1.04	1.04	1.03
   query18	0.20	0.25	0.24
   query19	1.92	1.83	1.73
   query20	0.02	0.01	0.01
   query21	15.51	0.70	0.68
   query22	4.72	6.68	2.04
   query23	18.32	1.40	1.31
   query24	2.08	0.22	0.22
   query25	0.15	0.09	0.09
   query26	0.27	0.17	0.17
   query27	0.07	0.07	0.08
   query28	13.26	1.01	0.99
   query29	13.36	3.32	3.29
   query30	0.25	0.06	0.05
   query31	2.87	0.40	0.38
   query32	3.26	0.46	0.48
   query33	2.88	2.88	2.92
   query34	17.19	4.47	4.39
   query35	4.48	4.49	4.65
   query36	0.65	0.47	0.46
   query37	0.17	0.15	0.16
   query38	0.14	0.14	0.14
   query39	0.04	0.04	0.04
   query40	0.17	0.14	0.15
   query41	0.08	0.04	0.05
   query42	0.05	0.04	0.05
   query43	0.04	0.03	0.03
   Total cold run time: 110.88 s
   Total hot run time: 30.8 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on code in PR #35925:
URL: https://github.com/apache/doris/pull/35925#discussion_r1634133270


##########
fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/rewrite/CostBasedRewriteJob.java:
##########
@@ -41,6 +45,17 @@ public class CostBasedRewriteJob implements RewriteJob {
 
     private static final Logger LOG = LogManager.getLogger(CostBasedRewriteJob.class);
 
+    private static final ImmutableList<Pair<RuleType, String>> RuleHintName =

Review Comment:
   remove this name mapping



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160016487

   please desc how to disable the cbo rule forcely


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2149494661

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.65 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 302e0598cf9707fe60a23ee78c06e13d7601f684, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.08	0.04	0.04
   query3	0.22	0.05	0.05
   query4	1.68	0.07	0.07
   query5	0.51	0.48	0.50
   query6	1.13	0.72	0.72
   query7	0.02	0.02	0.02
   query8	0.05	0.04	0.04
   query9	0.55	0.49	0.49
   query10	0.55	0.54	0.53
   query11	0.15	0.11	0.12
   query12	0.16	0.11	0.11
   query13	0.59	0.59	0.59
   query14	0.79	0.77	0.79
   query15	0.82	0.82	0.80
   query16	0.35	0.36	0.37
   query17	1.02	0.95	1.05
   query18	0.22	0.25	0.23
   query19	1.81	1.72	1.71
   query20	0.02	0.01	0.01
   query21	15.43	0.70	0.68
   query22	4.52	6.75	2.03
   query23	18.30	1.35	1.29
   query24	1.60	0.30	0.22
   query25	0.15	0.09	0.09
   query26	0.27	0.17	0.17
   query27	0.07	0.08	0.08
   query28	13.31	1.02	1.01
   query29	13.34	3.28	3.27
   query30	0.24	0.06	0.05
   query31	2.88	0.40	0.39
   query32	3.26	0.48	0.46
   query33	2.87	2.94	2.88
   query34	17.24	4.40	4.38
   query35	4.47	4.50	4.65
   query36	0.66	0.46	0.46
   query37	0.17	0.14	0.15
   query38	0.15	0.14	0.14
   query39	0.04	0.04	0.03
   query40	0.16	0.14	0.15
   query41	0.10	0.05	0.05
   query42	0.05	0.04	0.05
   query43	0.05	0.04	0.03
   Total cold run time: 110.09 s
   Total hot run time: 30.65 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2175721527

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 173550 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 6e9dd43843030ca8986214817a762eae22dfd4c0, data reload: false
   
   query1	932	380	382	380
   query2	6463	2312	2406	2312
   query3	6637	204	213	204
   query4	19501	17226	17108	17108
   query5	3748	481	470	470
   query6	257	167	162	162
   query7	4585	313	296	296
   query8	324	292	292	292
   query9	8653	2425	2391	2391
   query10	590	314	286	286
   query11	10491	10121	9953	9953
   query12	118	85	81	81
   query13	1647	364	359	359
   query14	9325	7467	7653	7467
   query15	231	192	185	185
   query16	7745	254	255	254
   query17	1780	541	509	509
   query18	1938	273	272	272
   query19	209	148	153	148
   query20	92	85	85	85
   query21	209	124	130	124
   query22	4300	3952	3978	3952
   query23	33532	33420	33983	33420
   query24	12208	2919	2870	2870
   query25	667	405	358	358
   query26	1722	154	152	152
   query27	2991	330	330	330
   query28	7634	2128	2109	2109
   query29	1108	627	655	627
   query30	260	162	153	153
   query31	990	768	741	741
   query32	92	50	53	50
   query33	744	281	288	281
   query34	999	494	494	494
   query35	728	669	683	669
   query36	1143	999	1000	999
   query37	291	70	70	70
   query38	2981	2842	2796	2796
   query39	944	831	857	831
   query40	265	135	125	125
   query41	60	52	51	51
   query42	118	93	100	93
   query43	586	556	539	539
   query44	1238	721	744	721
   query45	196	187	161	161
   query46	1067	715	687	687
   query47	1855	1801	1780	1780
   query48	364	292	292	292
   query49	949	389	402	389
   query50	777	387	395	387
   query51	6840	6723	6659	6659
   query52	103	91	94	91
   query53	357	292	281	281
   query54	927	453	445	445
   query55	73	70	73	70
   query56	270	248	266	248
   query57	1111	1005	1068	1005
   query58	260	235	240	235
   query59	3356	3377	3233	3233
   query60	294	262	262	262
   query61	92	137	96	96
   query62	597	468	436	436
   query63	318	289	289	289
   query64	9695	2231	1718	1718
   query65	3150	3092	3110	3092
   query66	1243	329	330	329
   query67	15453	15041	14762	14762
   query68	4521	537	576	537
   query69	437	299	298	298
   query70	1172	1070	1068	1068
   query71	398	270	269	269
   query72	6941	5968	5720	5720
   query73	752	329	321	321
   query74	5992	5433	5448	5433
   query75	3448	2658	2677	2658
   query76	2731	1012	930	930
   query77	423	302	283	283
   query78	10401	9789	9859	9789
   query79	2124	510	515	510
   query80	1059	467	458	458
   query81	596	225	216	216
   query82	676	103	100	100
   query83	247	164	159	159
   query84	239	85	83	83
   query85	1983	274	268	268
   query86	497	290	310	290
   query87	3252	3071	3065	3065
   query88	3979	2349	2339	2339
   query89	460	381	374	374
   query90	1752	193	184	184
   query91	124	102	109	102
   query92	65	119	46	46
   query93	2032	507	501	501
   query94	1149	189	182	182
   query95	404	320	321	320
   query96	588	268	272	268
   query97	3221	3081	3025	3025
   query98	228	206	206	206
   query99	1233	834	832	832
   Total cold run time: 273547 ms
   Total hot run time: 173550 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2175430279

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2174890348

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2177373563

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160013378

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160024068

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow commented on code in PR #35925:
URL: https://github.com/apache/doris/pull/35925#discussion_r1636045347


##########
regression-test/suites/nereids_tpcds_shape_sf100_p0/noStatsRfPrune/query1.groovy:
##########
@@ -45,7 +45,7 @@ where sr_returned_date_sk = d_date_sk
 and d_year =2000
 group by sr_customer_sk
 ,sr_store_sk)
- select  c_customer_id
+ select /*+ FORCE_CBO_RULE(no_push_down_agg_through_join no_push_down_agg_through_join_one_side) */  c_customer_id

Review Comment:
   we need force no use to avoid shape changed? i think the shape check should not add any hint. because it used to check plan shape under all default set



##########
regression-test/suites/nereids_tpcds_shape_sf100_p0/noStatsRfPrune/query1.groovy:
##########
@@ -45,7 +45,7 @@ where sr_returned_date_sk = d_date_sk
 and d_year =2000
 group by sr_customer_sk
 ,sr_store_sk)
- select  c_customer_id
+ select /*+ FORCE_CBO_RULE(no_push_down_agg_through_join no_push_down_agg_through_join_one_side) */  c_customer_id

Review Comment:
   we should check perfermance is ok after let these rules become cost based rewrite tule



##########
fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java:
##########
@@ -1201,9 +1201,6 @@ public void setEnableLeftZigZag(boolean enableLeftZigZag) {
     @VariableMgr.VarAttr(name = DISABLE_NEREIDS_RULES, needForward = true)
     private String disableNereidsRules = "";
 
-    @VariableMgr.VarAttr(name = ENABLE_NEREIDS_RULES, needForward = true)
-    public String enableNereidsRules = "";
-

Review Comment:
   not remove it directly, use varType REMOVED to avoid set failed



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2151759616

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 174333 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b6f4edec05426be813e0d7d65932177067f92284, data reload: false
   
   query1	984	404	388	388
   query2	6453	2458	2344	2344
   query3	6666	231	231	231
   query4	19450	17126	17181	17126
   query5	4181	510	520	510
   query6	242	149	152	149
   query7	4597	297	302	297
   query8	346	312	333	312
   query9	8579	2388	2381	2381
   query10	429	274	270	270
   query11	10611	10059	10096	10059
   query12	153	93	93	93
   query13	1642	352	363	352
   query14	10246	7181	7726	7181
   query15	240	203	206	203
   query16	7797	264	258	258
   query17	1705	509	526	509
   query18	1951	275	268	268
   query19	193	161	154	154
   query20	103	92	93	92
   query21	209	133	129	129
   query22	4322	4004	3913	3913
   query23	33706	33127	33084	33084
   query24	10983	2902	2790	2790
   query25	721	447	441	441
   query26	1186	150	156	150
   query27	2961	316	308	308
   query28	7219	2041	2058	2041
   query29	870	604	598	598
   query30	292	154	155	154
   query31	987	728	765	728
   query32	92	52	53	52
   query33	844	351	347	347
   query34	918	496	497	496
   query35	747	634	633	633
   query36	1086	904	932	904
   query37	191	81	82	81
   query38	2894	2738	2737	2737
   query39	843	787	818	787
   query40	212	118	120	118
   query41	63	70	63	63
   query42	123	107	102	102
   query43	585	556	560	556
   query44	1167	709	723	709
   query45	195	165	166	165
   query46	1106	736	725	725
   query47	1887	1793	1792	1792
   query48	387	316	312	312
   query49	1073	390	408	390
   query50	770	389	379	379
   query51	6864	6726	6672	6672
   query52	112	103	103	103
   query53	366	298	303	298
   query54	901	521	502	502
   query55	81	83	82	82
   query56	354	322	325	322
   query57	1114	1076	1071	1071
   query58	299	278	280	278
   query59	3440	3313	3132	3132
   query60	371	346	395	346
   query61	219	228	220	220
   query62	684	459	457	457
   query63	340	316	305	305
   query64	9710	2954	2472	2472
   query65	3230	3115	3131	3115
   query66	1098	338	349	338
   query67	15447	14781	14774	14774
   query68	5925	582	655	582
   query69	677	418	392	392
   query70	1207	1146	1131	1131
   query71	490	286	282	282
   query72	8767	5534	5648	5534
   query73	777	331	333	331
   query74	6046	5498	5554	5498
   query75	4566	2648	2675	2648
   query76	3513	939	831	831
   query77	748	331	329	329
   query78	10272	9854	9729	9729
   query79	8536	531	528	528
   query80	996	472	465	465
   query81	556	225	223	223
   query82	763	116	113	113
   query83	379	199	233	199
   query84	278	83	87	83
   query85	1394	265	259	259
   query86	418	300	287	287
   query87	3314	3087	3084	3084
   query88	4864	2376	2365	2365
   query89	551	402	403	402
   query90	1874	189	192	189
   query91	180	146	150	146
   query92	62	48	49	48
   query93	6438	510	503	503
   query94	1199	188	184	184
   query95	388	312	308	308
   query96	616	267	262	262
   query97	3217	3044	3015	3015
   query98	219	216	204	204
   query99	1217	838	831	831
   Total cold run time: 290284 ms
   Total hot run time: 174333 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2162370129

   prefix `NO_` before rule type is not a good idea. if we have two rule named `A` and `NO_A` u could not force use `A` anymore.
   i think
   `FORCE_USE_CBO_RULE` and `FORCE_NOT_USE_CBO_RULE` is better?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2172774080

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.05 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 103e16d03c62c2259ec0d0e829f3f3f7584fc742, data reload: false
   
   query1	0.04	0.03	0.04
   query2	0.08	0.04	0.04
   query3	0.23	0.05	0.05
   query4	1.67	0.10	0.09
   query5	0.49	0.48	0.51
   query6	1.14	0.73	0.73
   query7	0.02	0.02	0.01
   query8	0.05	0.04	0.04
   query9	0.54	0.49	0.48
   query10	0.55	0.55	0.55
   query11	0.16	0.12	0.11
   query12	0.15	0.12	0.11
   query13	0.59	0.58	0.59
   query14	0.78	0.78	0.78
   query15	0.83	0.81	0.81
   query16	0.36	0.37	0.37
   query17	0.98	1.01	0.97
   query18	0.21	0.24	0.24
   query19	1.84	1.72	1.82
   query20	0.02	0.01	0.01
   query21	15.45	0.65	0.65
   query22	4.20	6.87	2.56
   query23	18.32	1.33	1.23
   query24	2.12	0.21	0.23
   query25	0.15	0.09	0.09
   query26	0.27	0.18	0.18
   query27	0.07	0.08	0.07
   query28	13.26	1.01	0.99
   query29	12.59	3.34	3.28
   query30	0.25	0.06	0.06
   query31	2.86	0.39	0.39
   query32	3.27	0.46	0.47
   query33	2.93	2.90	2.84
   query34	16.93	4.38	4.37
   query35	4.47	4.46	4.42
   query36	0.65	0.46	0.46
   query37	0.19	0.15	0.15
   query38	0.15	0.14	0.14
   query39	0.04	0.03	0.04
   query40	0.17	0.15	0.14
   query41	0.09	0.04	0.05
   query42	0.06	0.05	0.05
   query43	0.04	0.04	0.04
   Total cold run time: 109.26 s
   Total hot run time: 31.05 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2175699658

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39689 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 6e9dd43843030ca8986214817a762eae22dfd4c0, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17621	4324	4271	4271
   q2	2027	193	195	193
   q3	10446	1136	1117	1117
   q4	10181	846	757	757
   q5	7476	2727	2630	2630
   q6	222	141	138	138
   q7	952	609	603	603
   q8	9225	2065	2102	2065
   q9	8939	6533	6453	6453
   q10	8924	3686	3718	3686
   q11	450	236	236	236
   q12	426	236	223	223
   q13	17800	2974	2952	2952
   q14	264	224	211	211
   q15	504	473	475	473
   q16	514	374	370	370
   q17	971	657	769	657
   q18	8172	7478	7347	7347
   q19	8654	1536	1482	1482
   q20	642	308	312	308
   q21	4928	3181	3181	3181
   q22	391	336	336	336
   Total cold run time: 119729 ms
   Total hot run time: 39689 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4444	4240	4307	4240
   q2	378	261	263	261
   q3	3065	2985	2924	2924
   q4	1976	1709	1735	1709
   q5	5547	5499	5427	5427
   q6	221	130	131	130
   q7	2408	1825	1871	1825
   q8	3252	3444	3447	3444
   q9	8685	8727	8777	8727
   q10	4180	3674	3836	3674
   q11	616	504	496	496
   q12	810	655	610	610
   q13	17199	3183	3169	3169
   q14	314	280	278	278
   q15	517	488	507	488
   q16	517	448	440	440
   q17	1821	1526	1482	1482
   q18	8113	7837	7817	7817
   q19	1812	1487	1572	1487
   q20	2144	1867	1869	1867
   q21	8281	4945	4719	4719
   q22	644	553	542	542
   Total cold run time: 76944 ms
   Total hot run time: 55756 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2175665954

   /run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2177415888

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40495 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 6e9dd43843030ca8986214817a762eae22dfd4c0, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18036	4482	4413	4413
   q2	2582	197	188	188
   q3	11480	1162	1054	1054
   q4	11051	893	866	866
   q5	7502	2683	2646	2646
   q6	224	140	138	138
   q7	963	627	624	624
   q8	9614	2047	2082	2047
   q9	9338	6890	6861	6861
   q10	8985	3715	3732	3715
   q11	451	225	236	225
   q12	435	229	239	229
   q13	18280	2992	2983	2983
   q14	266	230	213	213
   q15	538	483	480	480
   q16	523	381	377	377
   q17	964	680	629	629
   q18	7969	7444	7412	7412
   q19	2125	1441	1491	1441
   q20	658	308	336	308
   q21	4879	3863	3304	3304
   q22	392	342	342	342
   Total cold run time: 117255 ms
   Total hot run time: 40495 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4319	4301	4295	4295
   q2	374	268	269	268
   q3	3014	2765	2783	2765
   q4	1846	1601	1638	1601
   q5	5270	5275	5227	5227
   q6	218	132	129	129
   q7	2110	1734	1739	1734
   q8	3203	3325	3298	3298
   q9	8766	8745	8745	8745
   q10	3902	3644	3682	3644
   q11	585	477	474	474
   q12	808	579	602	579
   q13	17348	2969	2968	2968
   q14	283	262	257	257
   q15	515	477	463	463
   q16	453	418	424	418
   q17	1774	1488	1469	1469
   q18	7474	7547	7425	7425
   q19	6513	1627	1641	1627
   q20	1986	1753	1758	1753
   q21	4852	4691	4700	4691
   q22	597	537	555	537
   Total cold run time: 76210 ms
   Total hot run time: 54367 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on code in PR #35925:
URL: https://github.com/apache/doris/pull/35925#discussion_r1634356878


##########
fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/rewrite/CostBasedRewriteJob.java:
##########
@@ -41,6 +45,17 @@ public class CostBasedRewriteJob implements RewriteJob {
 
     private static final Logger LOG = LogManager.getLogger(CostBasedRewriteJob.class);
 
+    private static final ImmutableList<Pair<RuleType, String>> RuleHintName =

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160045064

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39743 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit a89e21f9923da4e327a4c85ec230cb3932e71bc0, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17609	4342	4244	4244
   q2	2033	195	190	190
   q3	10461	1163	1055	1055
   q4	10193	852	883	852
   q5	7555	2703	2669	2669
   q6	221	139	139	139
   q7	971	633	630	630
   q8	9511	2083	2097	2083
   q9	8930	6453	6486	6453
   q10	8872	3722	3672	3672
   q11	442	237	237	237
   q12	412	235	229	229
   q13	17769	3000	2965	2965
   q14	268	213	218	213
   q15	516	477	468	468
   q16	515	377	385	377
   q17	965	716	701	701
   q18	8034	7480	7413	7413
   q19	7881	1521	1368	1368
   q20	647	304	326	304
   q21	5049	3159	3996	3159
   q22	381	322	329	322
   Total cold run time: 119235 ms
   Total hot run time: 39743 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4381	4245	4194	4194
   q2	360	256	269	256
   q3	2955	2748	2714	2714
   q4	1852	1613	1645	1613
   q5	5231	5283	5306	5283
   q6	218	127	129	127
   q7	2120	1702	1666	1666
   q8	3151	3301	3320	3301
   q9	8341	8319	8362	8319
   q10	3898	3678	3586	3586
   q11	575	479	473	473
   q12	767	594	588	588
   q13	17608	2959	2998	2959
   q14	300	265	265	265
   q15	525	472	470	470
   q16	468	416	421	416
   q17	1746	1478	1434	1434
   q18	7583	7631	7537	7537
   q19	1688	1582	1539	1539
   q20	1982	1800	1778	1778
   q21	4885	4820	4762	4762
   q22	595	541	543	541
   Total cold run time: 71229 ms
   Total hot run time: 53821 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154411255

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.03 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e82641953f0fd77797d3445cf6b863955dfb263f, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.09	0.04	0.04
   query3	0.23	0.06	0.06
   query4	1.66	0.08	0.08
   query5	0.52	0.49	0.47
   query6	1.13	0.73	0.73
   query7	0.02	0.01	0.02
   query8	0.05	0.04	0.04
   query9	0.54	0.49	0.49
   query10	0.53	0.54	0.54
   query11	0.15	0.11	0.12
   query12	0.15	0.12	0.12
   query13	0.60	0.59	0.61
   query14	0.78	0.79	0.78
   query15	0.83	0.80	0.81
   query16	0.38	0.38	0.38
   query17	1.00	1.05	1.07
   query18	0.21	0.27	0.24
   query19	1.82	1.74	1.76
   query20	0.02	0.01	0.00
   query21	15.86	0.69	0.67
   query22	4.63	6.90	2.11
   query23	18.23	1.39	1.30
   query24	2.12	0.26	0.20
   query25	0.16	0.09	0.08
   query26	0.27	0.17	0.17
   query27	0.08	0.09	0.08
   query28	13.18	1.02	1.00
   query29	13.28	3.28	3.28
   query30	0.24	0.05	0.06
   query31	2.88	0.41	0.40
   query32	3.23	0.47	0.47
   query33	2.95	2.94	2.98
   query34	17.37	4.47	4.38
   query35	4.52	4.56	4.68
   query36	0.65	0.46	0.48
   query37	0.17	0.15	0.16
   query38	0.15	0.15	0.14
   query39	0.04	0.03	0.04
   query40	0.17	0.14	0.15
   query41	0.09	0.04	0.05
   query42	0.05	0.05	0.04
   query43	0.04	0.04	0.04
   Total cold run time: 111.11 s
   Total hot run time: 31.03 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2153761764

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2175733342

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.93 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 6e9dd43843030ca8986214817a762eae22dfd4c0, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.08	0.05	0.04
   query3	0.23	0.05	0.06
   query4	1.71	0.08	0.08
   query5	0.48	0.50	0.47
   query6	1.12	0.73	0.73
   query7	0.02	0.01	0.01
   query8	0.06	0.04	0.05
   query9	0.56	0.49	0.49
   query10	0.53	0.57	0.56
   query11	0.15	0.12	0.12
   query12	0.15	0.11	0.13
   query13	0.60	0.58	0.61
   query14	0.78	0.78	0.80
   query15	0.83	0.83	0.81
   query16	0.37	0.37	0.36
   query17	0.98	1.05	1.03
   query18	0.22	0.24	0.26
   query19	1.76	1.75	1.69
   query20	0.01	0.00	0.01
   query21	15.40	0.64	0.64
   query22	4.16	7.21	2.27
   query23	18.38	1.40	1.34
   query24	2.14	0.25	0.22
   query25	0.15	0.08	0.09
   query26	0.27	0.17	0.17
   query27	0.09	0.07	0.07
   query28	13.16	1.01	1.00
   query29	12.61	3.28	3.27
   query30	0.26	0.07	0.06
   query31	2.85	0.39	0.38
   query32	3.29	0.48	0.47
   query33	2.89	2.87	2.90
   query34	17.00	4.36	4.41
   query35	4.45	4.47	4.46
   query36	0.65	0.46	0.47
   query37	0.18	0.15	0.16
   query38	0.15	0.15	0.13
   query39	0.04	0.03	0.03
   query40	0.17	0.15	0.14
   query41	0.09	0.05	0.05
   query42	0.06	0.05	0.04
   query43	0.04	0.04	0.04
   Total cold run time: 109.16 s
   Total hot run time: 30.93 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2172638930

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2172513730

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2174761473

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2149484353

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 175056 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 302e0598cf9707fe60a23ee78c06e13d7601f684, data reload: false
   
   query1	971	418	409	409
   query2	6475	2552	2301	2301
   query3	6671	224	227	224
   query4	19131	17469	17340	17340
   query5	4151	521	522	521
   query6	251	155	154	154
   query7	4590	303	314	303
   query8	360	317	318	317
   query9	8462	2427	2410	2410
   query10	444	273	280	273
   query11	10549	10055	10115	10055
   query12	148	100	112	100
   query13	1634	368	357	357
   query14	10131	7092	7916	7092
   query15	245	207	229	207
   query16	7787	267	271	267
   query17	1375	540	526	526
   query18	1938	298	275	275
   query19	200	160	165	160
   query20	117	98	95	95
   query21	214	144	134	134
   query22	4423	4156	3949	3949
   query23	33698	33124	33284	33124
   query24	11267	2943	2865	2865
   query25	803	528	517	517
   query26	1528	165	162	162
   query27	2981	330	331	330
   query28	7590	2111	2035	2035
   query29	994	610	589	589
   query30	287	155	158	155
   query31	971	746	786	746
   query32	95	53	56	53
   query33	869	352	358	352
   query34	915	494	497	494
   query35	748	626	607	607
   query36	1078	932	946	932
   query37	165	82	82	82
   query38	2984	2822	2827	2822
   query39	874	851	817	817
   query40	286	136	131	131
   query41	64	67	62	62
   query42	133	106	108	106
   query43	608	578	570	570
   query44	1303	733	745	733
   query45	199	166	163	163
   query46	1124	737	750	737
   query47	1843	1741	1809	1741
   query48	400	324	325	324
   query49	1090	411	431	411
   query50	784	389	396	389
   query51	6836	6720	6747	6720
   query52	109	95	104	95
   query53	375	313	328	313
   query54	963	495	493	493
   query55	81	84	81	81
   query56	351	337	330	330
   query57	1137	1049	1059	1049
   query58	296	280	279	279
   query59	3377	3187	3178	3178
   query60	365	350	351	350
   query61	178	177	175	175
   query62	666	436	433	433
   query63	339	311	307	307
   query64	10338	2718	2303	2303
   query65	3238	3129	3167	3129
   query66	1210	317	319	317
   query67	15396	14924	15131	14924
   query68	6534	572	559	559
   query69	599	463	393	393
   query70	1196	1078	1098	1078
   query71	505	295	302	295
   query72	7714	5528	5502	5502
   query73	792	343	341	341
   query74	5950	5558	5506	5506
   query75	4038	2688	2686	2686
   query76	4335	908	910	908
   query77	705	331	333	331
   query78	10556	9852	9763	9763
   query79	2042	529	532	529
   query80	2242	455	456	455
   query81	576	229	225	225
   query82	1391	114	112	112
   query83	313	200	203	200
   query84	274	83	86	83
   query85	1455	261	260	260
   query86	484	312	306	306
   query87	3267	3150	3090	3090
   query88	3430	2353	2380	2353
   query89	495	393	389	389
   query90	1860	188	193	188
   query91	182	150	149	149
   query92	65	48	47	47
   query93	2180	520	501	501
   query94	1258	188	191	188
   query95	398	312	309	309
   query96	602	267	272	267
   query97	3198	3051	3008	3008
   query98	254	225	241	225
   query99	1319	816	847	816
   Total cold run time: 281412 ms
   Total hot run time: 175056 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2151734869

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 41074 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b6f4edec05426be813e0d7d65932177067f92284, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17602	4284	4226	4226
   q2	2024	192	186	186
   q3	10459	1213	1160	1160
   q4	10194	771	791	771
   q5	7509	2721	2747	2721
   q6	226	137	139	137
   q7	965	620	607	607
   q8	9211	2138	2086	2086
   q9	9436	6698	6719	6698
   q10	9749	3892	3835	3835
   q11	435	245	234	234
   q12	489	231	252	231
   q13	17557	3224	3302	3224
   q14	251	217	215	215
   q15	518	471	472	471
   q16	503	392	404	392
   q17	976	661	693	661
   q18	8381	7926	7814	7814
   q19	7563	1333	1367	1333
   q20	656	340	313	313
   q21	5200	4053	3420	3420
   q22	395	341	339	339
   Total cold run time: 120299 ms
   Total hot run time: 41074 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4641	4459	4458	4458
   q2	386	268	268	268
   q3	3124	2951	2897	2897
   q4	1887	1571	1575	1571
   q5	5501	5476	5538	5476
   q6	217	124	130	124
   q7	2190	1797	1802	1797
   q8	3230	3396	3392	3392
   q9	8675	8650	8706	8650
   q10	4038	3865	3703	3703
   q11	595	482	494	482
   q12	785	579	609	579
   q13	17217	3109	3131	3109
   q14	312	261	267	261
   q15	514	503	490	490
   q16	484	417	414	414
   q17	1836	1493	1472	1472
   q18	7937	7492	7311	7311
   q19	1690	1582	1469	1469
   q20	2079	1810	1819	1810
   q21	9935	4738	4790	4738
   q22	640	535	520	520
   Total cold run time: 77913 ms
   Total hot run time: 54991 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154256972

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39991 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e82641953f0fd77797d3445cf6b863955dfb263f, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17899	4564	4476	4476
   q2	2450	191	208	191
   q3	11867	1145	1177	1145
   q4	10617	844	756	756
   q5	7533	2700	2625	2625
   q6	225	136	139	136
   q7	964	632	615	615
   q8	9297	2064	2078	2064
   q9	8762	6479	6472	6472
   q10	8956	3711	3737	3711
   q11	475	241	239	239
   q12	398	227	218	218
   q13	17769	2949	2964	2949
   q14	263	232	208	208
   q15	517	468	480	468
   q16	513	370	380	370
   q17	964	632	729	632
   q18	8091	7446	7431	7431
   q19	5084	1421	1546	1421
   q20	657	309	305	305
   q21	5060	3233	3349	3233
   q22	383	333	326	326
   Total cold run time: 118744 ms
   Total hot run time: 39991 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4410	4244	4290	4244
   q2	360	261	261	261
   q3	3025	2760	2679	2679
   q4	1818	1595	1540	1540
   q5	5263	5271	5243	5243
   q6	217	125	126	125
   q7	2121	1672	1725	1672
   q8	3133	3595	3306	3306
   q9	8271	8355	8345	8345
   q10	3872	3621	3633	3621
   q11	578	537	471	471
   q12	758	595	566	566
   q13	16338	2965	2961	2961
   q14	277	280	275	275
   q15	521	462	480	462
   q16	475	413	417	413
   q17	1782	1470	1474	1470
   q18	7664	7454	7486	7454
   q19	1642	1564	1591	1564
   q20	1959	1801	1757	1757
   q21	4789	4674	4730	4674
   q22	645	541	511	511
   Total cold run time: 69918 ms
   Total hot run time: 53614 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2160079321

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 29.77 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit a89e21f9923da4e327a4c85ec230cb3932e71bc0, data reload: false
   
   query1	0.04	0.04	0.04
   query2	0.08	0.04	0.04
   query3	0.23	0.06	0.05
   query4	1.66	0.07	0.07
   query5	0.51	0.48	0.49
   query6	1.13	0.73	0.74
   query7	0.02	0.01	0.02
   query8	0.05	0.04	0.04
   query9	0.54	0.49	0.48
   query10	0.56	0.56	0.54
   query11	0.16	0.12	0.12
   query12	0.15	0.12	0.12
   query13	0.60	0.59	0.60
   query14	0.78	0.77	0.79
   query15	0.83	0.81	0.83
   query16	0.36	0.37	0.37
   query17	0.98	1.04	0.98
   query18	0.22	0.25	0.22
   query19	1.87	1.70	1.79
   query20	0.02	0.01	0.01
   query21	15.45	0.64	0.64
   query22	4.46	8.63	1.04
   query23	18.17	1.43	1.27
   query24	2.18	0.22	0.21
   query25	0.16	0.08	0.08
   query26	0.27	0.18	0.18
   query27	0.08	0.09	0.09
   query28	13.22	1.01	0.99
   query29	12.55	3.37	3.30
   query30	0.26	0.06	0.06
   query31	2.86	0.39	0.38
   query32	3.29	0.47	0.46
   query33	2.86	2.93	2.92
   query34	17.07	4.44	4.46
   query35	4.52	4.53	4.48
   query36	0.66	0.47	0.47
   query37	0.18	0.16	0.15
   query38	0.16	0.14	0.15
   query39	0.04	0.03	0.04
   query40	0.17	0.15	0.14
   query41	0.10	0.06	0.05
   query42	0.06	0.05	0.04
   query43	0.04	0.04	0.04
   Total cold run time: 109.6 s
   Total hot run time: 29.77 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2149385601

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support force cbo rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2172724717

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40749 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 103e16d03c62c2259ec0d0e829f3f3f7584fc742, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	5513	4509	4318	4318
   q2	1249	189	196	189
   q3	7237	1112	1107	1107
   q4	1195	725	764	725
   q5	2768	2673	2693	2673
   q6	273	163	162	162
   q7	1052	629	604	604
   q8	2039	2042	2042	2042
   q9	6625	6520	6488	6488
   q10	4432	3747	3679	3679
   q11	399	243	238	238
   q12	390	241	240	240
   q13	18127	2989	3013	2989
   q14	259	227	221	221
   q15	511	476	494	476
   q16	488	382	381	381
   q17	962	735	762	735
   q18	7882	7578	7421	7421
   q19	1632	1541	1597	1541
   q20	583	311	355	311
   q21	5281	3863	3950	3863
   q22	396	346	346	346
   Total cold run time: 69293 ms
   Total hot run time: 40749 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4261	4276	4229	4229
   q2	366	274	270	270
   q3	2980	2742	2747	2742
   q4	1866	1654	1627	1627
   q5	5252	5297	5280	5280
   q6	218	127	130	127
   q7	2127	1771	1703	1703
   q8	3172	3322	3273	3273
   q9	8381	8292	8380	8292
   q10	3872	3674	3606	3606
   q11	590	487	489	487
   q12	775	592	580	580
   q13	11641	2977	3017	2977
   q14	294	275	251	251
   q15	536	481	488	481
   q16	470	415	414	414
   q17	1763	1467	1465	1465
   q18	7578	7456	7510	7456
   q19	1669	1538	1612	1538
   q20	1973	1794	1795	1794
   q21	4915	4692	4775	4692
   q22	620	543	534	534
   Total cold run time: 65319 ms
   Total hot run time: 53818 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154273378

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 171195 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e82641953f0fd77797d3445cf6b863955dfb263f, data reload: false
   
   query1	1006	400	391	391
   query2	6461	2349	2403	2349
   query3	6741	240	242	240
   query4	19871	17292	17116	17116
   query5	4168	506	521	506
   query6	246	160	157	157
   query7	4599	309	316	309
   query8	360	307	324	307
   query9	8529	2381	2380	2380
   query10	436	282	266	266
   query11	10446	10109	9960	9960
   query12	149	93	91	91
   query13	1635	367	362	362
   query14	10315	6971	7763	6971
   query15	247	200	201	200
   query16	7261	253	250	250
   query17	1872	518	524	518
   query18	1814	274	266	266
   query19	192	154	152	152
   query20	101	117	93	93
   query21	209	132	122	122
   query22	4325	4081	4100	4081
   query23	33739	33000	32934	32934
   query24	12002	2822	2780	2780
   query25	777	478	451	451
   query26	1791	153	151	151
   query27	2938	307	319	307
   query28	7134	2035	2018	2018
   query29	1007	601	602	601
   query30	292	152	157	152
   query31	973	748	726	726
   query32	93	57	52	52
   query33	844	352	411	352
   query34	909	485	490	485
   query35	752	593	586	586
   query36	1115	922	933	922
   query37	250	87	82	82
   query38	2899	2731	2725	2725
   query39	871	807	783	783
   query40	284	128	123	123
   query41	67	63	61	61
   query42	122	104	102	102
   query43	604	542	566	542
   query44	1188	721	739	721
   query45	190	162	166	162
   query46	1119	745	715	715
   query47	1851	1776	1764	1764
   query48	401	318	323	318
   query49	1194	397	411	397
   query50	785	391	385	385
   query51	6717	6718	6652	6652
   query52	119	96	102	96
   query53	373	313	307	307
   query54	1057	505	521	505
   query55	85	84	84	84
   query56	421	392	384	384
   query57	1138	1114	1063	1063
   query58	290	290	271	271
   query59	3494	3349	3236	3236
   query60	383	343	353	343
   query61	173	174	176	174
   query62	641	447	440	440
   query63	335	310	308	308
   query64	10595	2707	2295	2295
   query65	3209	3101	3140	3101
   query66	1399	335	339	335
   query67	15452	15010	14923	14923
   query68	5896	566	567	566
   query69	619	444	378	378
   query70	1178	1087	1137	1087
   query71	488	286	281	281
   query72	7090	2736	2643	2643
   query73	791	335	335	335
   query74	5902	5515	5568	5515
   query75	3832	2662	2686	2662
   query76	3591	931	876	876
   query77	659	327	322	322
   query78	10265	9868	9784	9784
   query79	2180	553	543	543
   query80	1791	470	462	462
   query81	565	222	233	222
   query82	968	120	118	118
   query83	313	206	205	205
   query84	257	91	94	91
   query85	1379	310	267	267
   query86	468	339	324	324
   query87	3225	3079	3114	3079
   query88	3781	2327	2318	2318
   query89	500	411	414	411
   query90	1833	191	193	191
   query91	183	151	156	151
   query92	63	48	48	48
   query93	1810	529	510	510
   query94	1156	192	190	190
   query95	399	315	315	315
   query96	593	270	267	267
   query97	3249	2988	3014	2988
   query98	224	215	212	212
   query99	1268	835	833	833
   Total cold run time: 279571 ms
   Total hot run time: 171195 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "LiBinfeng-01 (via GitHub)" <gi...@apache.org>.
LiBinfeng-01 commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154319584

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154382899

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 40942 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e82641953f0fd77797d3445cf6b863955dfb263f, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17644	4307	4251	4251
   q2	2050	193	195	193
   q3	10452	1253	1065	1065
   q4	10199	811	839	811
   q5	7483	2707	2721	2707
   q6	215	134	138	134
   q7	973	630	611	611
   q8	9227	2137	2086	2086
   q9	9342	6674	6692	6674
   q10	10120	3804	3875	3804
   q11	430	238	244	238
   q12	453	238	219	219
   q13	17549	3226	3105	3105
   q14	266	213	221	213
   q15	521	472	478	472
   q16	505	405	404	404
   q17	970	626	702	626
   q18	8734	8141	7880	7880
   q19	8179	1494	1543	1494
   q20	662	329	325	325
   q21	5162	3290	4101	3290
   q22	396	340	357	340
   Total cold run time: 121532 ms
   Total hot run time: 40942 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4640	4436	4418	4418
   q2	379	265	253	253
   q3	3212	2843	2687	2687
   q4	1880	1608	1688	1608
   q5	5450	5514	5477	5477
   q6	223	125	126	125
   q7	2183	1815	1831	1815
   q8	3285	3382	3370	3370
   q9	8632	8698	8732	8698
   q10	4028	3745	3672	3672
   q11	620	489	518	489
   q12	792	625	626	625
   q13	17327	3158	3156	3156
   q14	319	282	280	280
   q15	531	477	479	477
   q16	516	447	441	441
   q17	1846	1527	1511	1511
   q18	7776	7387	7483	7387
   q19	1706	1465	1559	1465
   q20	2073	1799	1786	1786
   q21	10465	4884	4867	4867
   q22	699	552	523	523
   Total cold run time: 78582 ms
   Total hot run time: 55130 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2154401178

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 173023 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e82641953f0fd77797d3445cf6b863955dfb263f, data reload: false
   
   query1	980	410	398	398
   query2	6455	2245	2293	2245
   query3	6672	234	229	229
   query4	19358	17380	17170	17170
   query5	4170	490	492	490
   query6	245	156	166	156
   query7	4592	300	312	300
   query8	345	308	304	304
   query9	8759	2399	2373	2373
   query10	451	284	283	283
   query11	10600	10045	10076	10045
   query12	151	99	96	96
   query13	1635	372	372	372
   query14	10533	6932	6979	6932
   query15	236	194	205	194
   query16	7386	255	262	255
   query17	1373	512	537	512
   query18	1940	272	256	256
   query19	197	153	153	153
   query20	96	91	92	91
   query21	204	129	132	129
   query22	4424	4068	3946	3946
   query23	33581	33197	33048	33048
   query24	11150	2853	2840	2840
   query25	669	445	453	445
   query26	708	155	156	155
   query27	2276	313	320	313
   query28	5963	2034	2005	2005
   query29	857	613	616	613
   query30	288	156	158	156
   query31	971	749	747	747
   query32	94	51	52	51
   query33	748	353	351	351
   query34	900	480	483	480
   query35	767	608	598	598
   query36	1066	951	952	951
   query37	148	83	79	79
   query38	2903	2756	2719	2719
   query39	879	791	794	791
   query40	210	119	122	119
   query41	65	64	61	61
   query42	121	104	104	104
   query43	549	548	537	537
   query44	1059	715	727	715
   query45	197	157	156	156
   query46	1108	747	748	747
   query47	1897	1763	1801	1763
   query48	388	328	327	327
   query49	1019	392	402	392
   query50	789	388	378	378
   query51	6809	6640	6678	6640
   query52	118	94	99	94
   query53	364	308	305	305
   query54	949	494	487	487
   query55	85	81	80	80
   query56	352	323	322	322
   query57	1157	1080	1096	1080
   query58	308	287	284	284
   query59	3392	3079	3216	3079
   query60	361	339	336	336
   query61	170	168	169	168
   query62	638	441	426	426
   query63	328	316	302	302
   query64	9268	2967	2207	2207
   query65	3172	3075	3141	3075
   query66	879	329	327	327
   query67	15388	14964	14729	14729
   query68	6356	553	556	553
   query69	601	462	390	390
   query70	1230	1144	1136	1136
   query71	459	291	274	274
   query72	8004	5398	5245	5245
   query73	810	331	326	326
   query74	5872	5492	5453	5453
   query75	3905	2602	2680	2602
   query76	3998	914	895	895
   query77	681	332	325	325
   query78	10502	9735	9739	9735
   query79	2945	534	519	519
   query80	1488	466	444	444
   query81	575	220	224	220
   query82	773	115	113	113
   query83	238	203	199	199
   query84	273	84	80	80
   query85	1242	269	254	254
   query86	463	296	285	285
   query87	3255	3121	3067	3067
   query88	4275	2323	2306	2306
   query89	498	405	388	388
   query90	1806	189	189	189
   query91	177	148	145	145
   query92	64	48	51	48
   query93	4081	539	504	504
   query94	1119	188	190	188
   query95	397	302	298	298
   query96	588	265	261	261
   query97	3180	3033	3021	3021
   query98	228	207	206	206
   query99	1340	844	843	843
   Total cold run time: 277333 ms
   Total hot run time: 173023 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Feat](Nereids) support cost based rule hint [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35925:
URL: https://github.com/apache/doris/pull/35925#issuecomment-2151769820

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.5 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit b6f4edec05426be813e0d7d65932177067f92284, data reload: false
   
   query1	0.04	0.03	0.03
   query2	0.08	0.04	0.04
   query3	0.23	0.05	0.05
   query4	1.70	0.07	0.07
   query5	0.50	0.50	0.49
   query6	1.12	0.73	0.73
   query7	0.01	0.01	0.02
   query8	0.05	0.04	0.04
   query9	0.54	0.49	0.49
   query10	0.54	0.55	0.54
   query11	0.15	0.11	0.11
   query12	0.14	0.12	0.12
   query13	0.60	0.59	0.60
   query14	0.77	0.78	0.77
   query15	0.84	0.80	0.81
   query16	0.34	0.36	0.37
   query17	0.97	0.97	0.94
   query18	0.20	0.27	0.22
   query19	1.78	1.71	1.72
   query20	0.02	0.01	0.01
   query21	15.72	0.67	0.67
   query22	3.91	6.14	2.93
   query23	18.34	1.42	1.30
   query24	2.09	0.22	0.22
   query25	0.14	0.08	0.09
   query26	0.27	0.18	0.17
   query27	0.09	0.07	0.08
   query28	13.20	1.02	0.99
   query29	13.10	3.34	3.24
   query30	0.24	0.06	0.05
   query31	2.90	0.38	0.39
   query32	3.26	0.48	0.46
   query33	2.87	2.92	2.89
   query34	17.23	4.40	4.38
   query35	4.46	4.49	4.50
   query36	0.69	0.51	0.48
   query37	0.17	0.14	0.15
   query38	0.15	0.14	0.14
   query39	0.04	0.03	0.03
   query40	0.16	0.15	0.15
   query41	0.09	0.04	0.04
   query42	0.06	0.05	0.05
   query43	0.04	0.04	0.03
   Total cold run time: 109.84 s
   Total hot run time: 31.5 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org