You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HHoflittlefish777 (via GitHub)" <gi...@apache.org> on 2024/01/19 03:49:11 UTC

[PR] [improve](routine-load) optimize error msg when meet out of range [doris]

HHoflittlefish777 opened a new pull request, #30118:
URL: https://github.com/apache/doris/pull/30118

   ## Proposed changes
   
   When meet out of range in routine load, it is hard for user to deal it correctly, so add some processing method in message.
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901895541

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit e547bcf76b8b7f73a161056b9c87dbc0df1949b3 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       14.4 seconds inserted 10000000 Rows, about 694K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901791833

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1899760461

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.07 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit d3a28d640f3a5847777abd90adac993ff3502d61, data reload: false
   
   query1	0.04	0.02	0.02
   query2	0.05	0.02	0.02
   query3	0.23	0.04	0.05
   query4	1.71	0.06	0.06
   query5	0.53	0.52	0.52
   query6	1.22	0.62	0.63
   query7	0.02	0.01	0.02
   query8	0.04	0.03	0.02
   query9	0.54	0.50	0.49
   query10	0.55	0.55	0.55
   query11	0.11	0.08	0.08
   query12	0.11	0.09	0.09
   query13	0.60	0.60	0.60
   query14	0.80	0.83	0.80
   query15	0.81	0.77	0.77
   query16	0.35	0.37	0.36
   query17	1.02	1.00	1.00
   query18	0.24	0.24	0.24
   query19	1.88	1.80	1.78
   query20	0.01	0.01	0.01
   query21	15.40	0.59	0.58
   query22	3.21	2.35	2.04
   query23	17.33	0.92	0.77
   query24	2.37	1.18	0.91
   query25	0.40	0.19	0.10
   query26	0.54	0.12	0.12
   query27	0.05	0.06	0.06
   query28	12.15	0.76	0.76
   query29	12.54	3.31	3.28
   query30	0.50	0.45	0.44
   query31	2.78	0.34	0.33
   query32	3.39	0.47	0.47
   query33	3.21	3.23	3.22
   query34	15.86	4.41	4.31
   query35	4.28	4.34	4.26
   query36	1.11	1.07	1.08
   query37	0.06	0.05	0.05
   query38	0.04	0.03	0.03
   query39	0.02	0.02	0.01
   query40	0.15	0.13	0.14
   query41	0.06	0.01	0.02
   query42	0.02	0.02	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 106.35 s
   Total hot run time: 31.07 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901778792

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #30118:
URL: https://github.com/apache/doris/pull/30118


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901882015

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 176036 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit e547bcf76b8b7f73a161056b9c87dbc0df1949b3, data reload: false
   
   query1	937	340	329	329
   query2	6565	2021	1773	1773
   query3	6695	204	192	192
   query4	31006	22165	22196	22165
   query5	6905	631	623	623
   query6	254	165	168	165
   query7	4617	261	255	255
   query8	220	171	177	171
   query9	8446	2545	2522	2522
   query10	432	239	225	225
   query11	16668	15772	15420	15420
   query12	120	68	66	66
   query13	1678	368	380	368
   query14	10567	7045	6920	6920
   query15	205	182	180	180
   query16	4606	232	226	226
   query17	998	480	480	480
   query18	1786	257	262	257
   query19	186	140	134	134
   query20	68	68	65	65
   query21	186	135	116	116
   query22	4859	4527	4664	4527
   query23	31554	30913	30841	30841
   query24	11945	2766	2848	2766
   query25	574	315	311	311
   query26	1645	148	152	148
   query27	3216	275	270	270
   query28	7234	1842	1826	1826
   query29	1669	651	641	641
   query30	282	141	139	139
   query31	940	738	745	738
   query32	81	52	48	48
   query33	698	216	228	216
   query34	1130	474	469	469
   query35	897	784	782	782
   query36	1333	1182	1174	1174
   query37	92	58	63	58
   query38	3370	3266	3202	3202
   query39	1317	1266	1251	1251
   query40	333	87	83	83
   query41	37	35	34	34
   query42	93	83	86	83
   query43	511	515	441	441
   query44	1110	689	690	689
   query45	192	175	176	175
   query46	1046	658	663	658
   query47	1598	1561	1542	1542
   query48	396	307	324	307
   query49	1158	295	289	289
   query50	673	317	322	317
   query51	5285	5213	5185	5185
   query52	88	82	77	77
   query53	329	255	257	255
   query54	484	298	290	290
   query55	83	75	75	75
   query56	184	174	182	174
   query57	956	921	868	868
   query58	194	168	166	166
   query59	2866	2579	2697	2579
   query60	207	184	183	183
   query61	87	86	93	86
   query62	628	348	369	348
   query63	276	264	254	254
   query64	5838	1847	1771	1771
   query65	3320	3271	3232	3232
   query66	1256	327	316	316
   query67	15493	14957	15137	14957
   query68	10490	527	492	492
   query69	598	309	300	300
   query70	1761	1493	1386	1386
   query71	541	210	210	210
   query72	4652	2833	2871	2833
   query73	1885	313	322	313
   query74	6944	6456	6344	6344
   query75	4725	2325	2289	2289
   query76	6665	1043	1015	1015
   query77	641	232	231	231
   query78	9012	8778	8534	8534
   query79	1382	507	506	506
   query80	633	327	318	318
   query81	445	207	207	207
   query82	207	84	85	84
   query83	145	118	125	118
   query84	283	68	68	68
   query85	1059	339	344	339
   query86	386	384	386	384
   query87	3611	3335	3372	3335
   query88	3538	2191	2186	2186
   query89	437	365	344	344
   query90	2009	187	187	187
   query91	156	122	128	122
   query92	56	46	42	42
   query93	3356	440	428	428
   query94	1160	158	156	156
   query95	504	464	455	455
   query96	629	317	320	317
   query97	4282	4195	4124	4124
   query98	205	197	179	179
   query99	999	702	697	697
   Total cold run time: 294098 ms
   Total hot run time: 176036 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1899756567

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 175992 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit d3a28d640f3a5847777abd90adac993ff3502d61, data reload: false
   
   query1	914	367	324	324
   query2	6543	2095	1812	1812
   query3	6696	200	198	198
   query4	32113	22075	22131	22075
   query5	6936	521	499	499
   query6	254	148	150	148
   query7	4601	260	259	259
   query8	225	192	178	178
   query9	8471	2576	2571	2571
   query10	424	224	228	224
   query11	16992	15650	15466	15466
   query12	115	67	67	67
   query13	1691	373	385	373
   query14	10438	6923	6879	6879
   query15	209	174	174	174
   query16	4602	231	226	226
   query17	997	473	471	471
   query18	1783	259	256	256
   query19	175	139	134	134
   query20	76	68	62	62
   query21	190	137	129	129
   query22	4977	4783	4753	4753
   query23	31337	30647	30598	30598
   query24	11717	2786	2800	2786
   query25	574	318	303	303
   query26	1445	138	140	138
   query27	3229	265	269	265
   query28	7040	1853	1854	1853
   query29	1264	621	628	621
   query30	282	134	138	134
   query31	948	733	736	733
   query32	83	50	49	49
   query33	700	210	206	206
   query34	1131	451	452	451
   query35	856	759	764	759
   query36	1388	1176	1240	1176
   query37	90	60	58	58
   query38	3371	3237	3280	3237
   query39	1311	1260	1258	1258
   query40	207	89	82	82
   query41	39	35	34	34
   query42	91	85	82	82
   query43	534	480	507	480
   query44	1106	677	676	676
   query45	192	178	173	173
   query46	1060	646	650	646
   query47	1602	1575	1586	1575
   query48	392	340	321	321
   query49	1145	280	290	280
   query50	668	307	313	307
   query51	5279	5273	5195	5195
   query52	92	81	76	76
   query53	331	257	249	249
   query54	463	287	285	285
   query55	78	76	78	76
   query56	179	174	159	159
   query57	988	965	914	914
   query58	199	154	172	154
   query59	2953	2612	2761	2612
   query60	206	182	190	182
   query61	90	87	87	87
   query62	651	373	353	353
   query63	282	262	265	262
   query64	4975	1773	1735	1735
   query65	3330	3245	3222	3222
   query66	1223	331	307	307
   query67	15718	14932	15338	14932
   query68	11790	527	496	496
   query69	609	310	304	304
   query70	1694	1563	1530	1530
   query71	556	215	205	205
   query72	5072	2849	2858	2849
   query73	2301	310	310	310
   query74	7860	6400	6480	6400
   query75	4791	2293	2295	2293
   query76	6685	1069	987	987
   query77	668	230	230	230
   query78	9165	8804	8574	8574
   query79	1003	502	486	486
   query80	572	315	305	305
   query81	458	203	204	203
   query82	197	80	81	80
   query83	138	117	117	117
   query84	270	70	69	69
   query85	1048	323	311	311
   query86	385	389	361	361
   query87	3584	3347	3343	3343
   query88	2880	2162	2177	2162
   query89	420	344	342	342
   query90	1992	190	186	186
   query91	173	131	133	131
   query92	54	43	44	43
   query93	1957	441	437	437
   query94	1144	156	157	156
   query95	496	460	447	447
   query96	623	319	309	309
   query97	4243	4128	4108	4108
   query98	216	188	194	188
   query99	991	671	718	671
   Total cold run time: 294296 ms
   Total hot run time: 175992 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1903187940

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "liaoxin01 (via GitHub)" <gi...@apache.org>.
liaoxin01 commented on code in PR #30118:
URL: https://github.com/apache/doris/pull/30118#discussion_r1460159181


##########
fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadJob.java:
##########
@@ -1142,11 +1142,22 @@ public void afterAborted(TransactionState txnState, boolean txnOperated, String
                 if (txnStatusChangeReasonString != null) {
                     txnStatusChangeReason =
                             TransactionState.TxnStatusChangeReason.fromString(txnStatusChangeReasonString);
+                    String msg;
                     if (txnStatusChangeReason != null) {
                         switch (txnStatusChangeReason) {
                             case OFFSET_OUT_OF_RANGE:
+                                msg = "be " + taskBeId + " abort task "
+                                        + "with reason: " + txnStatusChangeReasonString
+                                        + " for offset used in job do not exist in kafka,"
+                                        + " we command check the offset of kafka,"

Review Comment:
   ```suggestion
                                       The offset used by job does not exist in kafaka, please check the offset.
   
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901817213

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1899762467

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit d3a28d640f3a5847777abd90adac993ff3502d61 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       14.7 seconds inserted 10000000 Rows, about 680K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1899748381

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38542 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit d3a28d640f3a5847777abd90adac993ff3502d61, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17674	5142	5305	5142
   q2	2034	140	129	129
   q3	10640	1159	1139	1139
   q4	10218	765	737	737
   q5	7761	3140	3121	3121
   q6	197	120	118	118
   q7	852	494	477	477
   q8	9258	1949	1951	1949
   q9	7281	6360	6302	6302
   q10	8178	3066	3060	3060
   q11	415	209	206	206
   q12	355	190	187	187
   q13	17992	3340	3346	3340
   q14	246	216	218	216
   q15	565	506	519	506
   q16	450	378	397	378
   q17	934	538	474	474
   q18	7426	6943	6717	6717
   q19	1555	1382	1395	1382
   q20	603	295	291	291
   q21	2749	2371	2394	2371
   q22	358	317	300	300
   Total cold run time: 107741 ms
   Total hot run time: 38542 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5380	5414	5290	5290
   q2	322	216	214	214
   q3	3307	3245	3183	3183
   q4	2077	2049	2028	2028
   q5	5980	5669	5909	5669
   q6	195	113	117	113
   q7	2360	1911	1869	1869
   q8	3197	3333	3388	3333
   q9	8907	8688	8876	8688
   q10	3905	3753	3742	3742
   q11	549	460	440	440
   q12	786	610	599	599
   q13	16908	3120	3117	3117
   q14	286	258	276	258
   q15	559	499	509	499
   q16	509	472	458	458
   q17	1895	1835	1883	1835
   q18	9439	18429	9620	9620
   q19	25679	1559	1508	1508
   q20	4638	1932	1928	1928
   q21	14447	5302	5330	5302
   q22	995	529	540	529
   Total cold run time: 112320 ms
   Total hot run time: 60222 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1900295629

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on code in PR #30118:
URL: https://github.com/apache/doris/pull/30118#discussion_r1460250874


##########
fe/fe-core/src/main/java/org/apache/doris/load/routineload/RoutineLoadJob.java:
##########
@@ -1142,11 +1142,22 @@ public void afterAborted(TransactionState txnState, boolean txnOperated, String
                 if (txnStatusChangeReasonString != null) {
                     txnStatusChangeReason =
                             TransactionState.TxnStatusChangeReason.fromString(txnStatusChangeReasonString);
+                    String msg;
                     if (txnStatusChangeReason != null) {
                         switch (txnStatusChangeReason) {
                             case OFFSET_OUT_OF_RANGE:
+                                msg = "be " + taskBeId + " abort task "
+                                        + "with reason: " + txnStatusChangeReasonString
+                                        + " for offset used in job do not exist in kafka,"
+                                        + " we command check the offset of kafka,"

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "HHoflittlefish777 (via GitHub)" <gi...@apache.org>.
HHoflittlefish777 commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1899649205

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901864571

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38521 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit e547bcf76b8b7f73a161056b9c87dbc0df1949b3, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17640	5208	5442	5208
   q2	2048	146	132	132
   q3	10638	1151	1153	1151
   q4	10222	772	790	772
   q5	7766	3151	3149	3149
   q6	198	118	123	118
   q7	868	499	485	485
   q8	9235	1928	1949	1928
   q9	7136	6379	6343	6343
   q10	8210	3039	3030	3030
   q11	418	222	215	215
   q12	353	188	185	185
   q13	17978	3361	3324	3324
   q14	245	216	215	215
   q15	544	500	518	500
   q16	421	378	371	371
   q17	926	524	490	490
   q18	7515	6964	6590	6590
   q19	1578	1328	1384	1328
   q20	564	314	295	295
   q21	2795	2379	2415	2379
   q22	353	313	316	313
   Total cold run time: 107651 ms
   Total hot run time: 38521 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5311	5206	5233	5206
   q2	322	218	212	212
   q3	3328	3206	3177	3177
   q4	2079	2078	1997	1997
   q5	6026	5808	5965	5808
   q6	198	114	118	114
   q7	2312	1891	1928	1891
   q8	3211	3358	3367	3358
   q9	8822	8882	8758	8758
   q10	3940	3765	3787	3765
   q11	557	447	460	447
   q12	799	607	626	607
   q13	16919	3148	3097	3097
   q14	283	255	261	255
   q15	563	502	502	502
   q16	521	465	462	462
   q17	5890	1795	1837	1795
   q18	9480	17189	9737	9737
   q19	21875	1556	1524	1524
   q20	4644	1930	1929	1929
   q21	14518	5452	5361	5361
   q22	1004	557	542	542
   Total cold run time: 112602 ms
   Total hot run time: 60544 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1901890351

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 29.83 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit e547bcf76b8b7f73a161056b9c87dbc0df1949b3, data reload: false
   
   query1	0.03	0.03	0.02
   query2	0.06	0.03	0.02
   query3	0.23	0.05	0.05
   query4	1.69	0.07	0.06
   query5	0.53	0.52	0.52
   query6	1.19	0.64	0.64
   query7	0.02	0.01	0.01
   query8	0.04	0.03	0.02
   query9	0.56	0.50	0.50
   query10	0.56	0.55	0.56
   query11	0.11	0.09	0.08
   query12	0.11	0.10	0.09
   query13	0.60	0.61	0.62
   query14	0.78	0.80	0.80
   query15	0.78	0.76	0.77
   query16	0.40	0.39	0.39
   query17	1.00	0.99	1.03
   query18	0.24	0.24	0.25
   query19	1.85	1.79	1.77
   query20	0.01	0.00	0.01
   query21	15.40	0.57	0.58
   query22	2.42	2.25	1.64
   query23	17.08	0.82	0.87
   query24	2.41	1.45	0.12
   query25	0.30	0.15	0.10
   query26	0.56	0.14	0.13
   query27	0.06	0.07	0.04
   query28	12.03	0.77	0.76
   query29	12.59	3.23	3.12
   query30	0.54	0.48	0.53
   query31	2.79	0.35	0.36
   query32	3.36	0.48	0.49
   query33	3.21	3.18	3.26
   query34	15.78	4.35	4.29
   query35	4.33	4.34	4.31
   query36	1.12	1.07	1.10
   query37	0.06	0.05	0.05
   query38	0.04	0.03	0.02
   query39	0.02	0.01	0.01
   query40	0.16	0.13	0.13
   query41	0.08	0.01	0.01
   query42	0.02	0.01	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 105.17 s
   Total hot run time: 29.83 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improve](routine-load) optimize error msg when meet out of range [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30118:
URL: https://github.com/apache/doris/pull/30118#issuecomment-1900295669

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org