You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zclllyybb (via GitHub)" <gi...@apache.org> on 2024/09/10 13:04:36 UTC

[PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

zclllyybb opened a new pull request, #40635:
URL: https://github.com/apache/doris/pull/40635

   ## Proposed changes
   
   Issue Number: close #xxx
   
   now in auto-partition situation it will occur. may effect the txn commit check.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2340702306

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2340701634

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
   See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2341362884

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38266 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit aa5aad7b2edb33316a9034496473f745399d88fa, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17598	4399	4262	4262
   q2	2018	194	197	194
   q3	11679	973	1141	973
   q4	10512	775	739	739
   q5	7747	2811	2812	2811
   q6	230	139	138	138
   q7	974	636	593	593
   q8	9322	2078	2085	2078
   q9	7354	6559	6548	6548
   q10	7002	2148	2201	2148
   q11	462	255	249	249
   q12	395	221	222	221
   q13	18065	3208	3153	3153
   q14	284	236	243	236
   q15	531	481	487	481
   q16	514	434	439	434
   q17	983	615	703	615
   q18	7593	6953	6979	6953
   q19	1396	1136	1001	1001
   q20	688	332	339	332
   q21	3955	3100	3114	3100
   q22	1404	1036	1007	1007
   Total cold run time: 110706 ms
   Total hot run time: 38266 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4443	4354	4385	4354
   q2	390	280	284	280
   q3	2950	2706	2690	2690
   q4	1964	1679	1744	1679
   q5	5752	5757	5838	5757
   q6	229	145	141	141
   q7	2232	1948	1855	1855
   q8	3286	3464	3561	3464
   q9	8959	9136	9184	9136
   q10	3804	3450	3401	3401
   q11	614	524	572	524
   q12	926	688	732	688
   q13	15518	3210	3289	3210
   q14	310	324	308	308
   q15	535	527	525	525
   q16	548	503	539	503
   q17	1853	1565	1524	1524
   q18	8437	7883	7931	7883
   q19	1803	1592	1534	1534
   q20	2148	1919	1910	1910
   q21	5768	5583	5579	5579
   q22	1150	1091	1121	1091
   Total cold run time: 73619 ms
   Total hot run time: 58036 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "BiteTheDDDDt (via GitHub)" <gi...@apache.org>.
BiteTheDDDDt merged PR #40635:
URL: https://github.com/apache/doris/pull/40635


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2341107806

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2340754753

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2341256172

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2341415573

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.31 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit aa5aad7b2edb33316a9034496473f745399d88fa, data reload: false
   
   query1	0.04	0.05	0.04
   query2	0.08	0.04	0.04
   query3	0.22	0.06	0.05
   query4	1.67	0.08	0.07
   query5	0.49	0.49	0.49
   query6	1.13	0.74	0.73
   query7	0.02	0.01	0.01
   query8	0.06	0.05	0.04
   query9	0.55	0.49	0.48
   query10	0.54	0.55	0.55
   query11	0.16	0.12	0.12
   query12	0.15	0.12	0.13
   query13	0.60	0.60	0.58
   query14	1.38	1.39	1.40
   query15	0.86	0.84	0.83
   query16	0.38	0.37	0.35
   query17	1.07	1.00	1.07
   query18	0.21	0.20	0.20
   query19	1.90	1.74	1.83
   query20	0.01	0.01	0.01
   query21	15.39	0.66	0.65
   query22	4.71	6.82	1.80
   query23	18.25	1.41	1.25
   query24	2.03	0.23	0.22
   query25	0.15	0.08	0.09
   query26	0.27	0.18	0.18
   query27	0.07	0.07	0.08
   query28	13.25	1.02	1.00
   query29	12.60	3.41	3.34
   query30	0.24	0.06	0.05
   query31	2.86	0.41	0.39
   query32	3.25	0.49	0.48
   query33	3.00	3.04	2.99
   query34	17.15	4.38	4.45
   query35	4.40	4.51	4.55
   query36	0.64	0.46	0.47
   query37	0.20	0.16	0.16
   query38	0.16	0.15	0.16
   query39	0.05	0.04	0.04
   query40	0.16	0.13	0.13
   query41	0.10	0.05	0.05
   query42	0.05	0.05	0.05
   query43	0.05	0.04	0.04
   Total cold run time: 110.55 s
   Total hot run time: 31.31 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2341400548

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 196369 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit aa5aad7b2edb33316a9034496473f745399d88fa, data reload: false
   
   query1	1258	883	896	883
   query2	6331	1897	1958	1897
   query3	10629	3846	3756	3756
   query4	60332	29143	23261	23261
   query5	5003	510	503	503
   query6	399	174	162	162
   query7	5628	293	284	284
   query8	311	212	224	212
   query9	7840	2496	2479	2479
   query10	405	268	273	268
   query11	16400	15178	15341	15178
   query12	159	105	108	105
   query13	1457	431	403	403
   query14	10422	6572	7253	6572
   query15	203	184	175	175
   query16	6850	511	430	430
   query17	1144	601	611	601
   query18	1629	313	309	309
   query19	220	156	146	146
   query20	124	111	110	110
   query21	204	108	103	103
   query22	4605	4502	4607	4502
   query23	34578	33485	33738	33485
   query24	6045	2880	2840	2840
   query25	475	392	390	390
   query26	613	149	153	149
   query27	1615	277	277	277
   query28	3880	2052	2040	2040
   query29	640	412	405	405
   query30	228	157	156	156
   query31	933	794	779	779
   query32	73	53	57	53
   query33	428	292	278	278
   query34	887	488	465	465
   query35	840	733	753	733
   query36	1051	950	935	935
   query37	147	89	83	83
   query38	4078	3864	3882	3864
   query39	1471	1392	1395	1392
   query40	197	112	113	112
   query41	46	46	46	46
   query42	112	95	98	95
   query43	521	493	474	474
   query44	1092	756	742	742
   query45	196	162	165	162
   query46	1094	790	742	742
   query47	1887	1791	1811	1791
   query48	373	285	288	285
   query49	760	428	446	428
   query50	835	418	415	415
   query51	7140	6790	6729	6729
   query52	99	83	86	83
   query53	250	179	183	179
   query54	559	458	468	458
   query55	79	77	76	76
   query56	283	257	257	257
   query57	1209	1092	1114	1092
   query58	223	244	234	234
   query59	3158	2826	2873	2826
   query60	308	274	275	274
   query61	105	102	102	102
   query62	762	632	667	632
   query63	211	185	184	184
   query64	1404	684	689	684
   query65	3234	3157	3161	3157
   query66	666	329	333	329
   query67	15891	15504	15153	15153
   query68	1893	577	570	570
   query69	396	277	280	277
   query70	1208	1058	1107	1058
   query71	328	272	272	272
   query72	4783	4064	3968	3968
   query73	743	320	322	320
   query74	9164	9008	8880	8880
   query75	3313	2737	2723	2723
   query76	1289	1052	970	970
   query77	518	320	321	320
   query78	10477	9500	10492	9500
   query79	917	897	860	860
   query80	881	822	789	789
   query81	549	259	263	259
   query82	269	264	267	264
   query83	251	192	191	191
   query84	257	112	108	108
   query85	710	405	381	381
   query86	311	311	311	311
   query87	4330	4295	4354	4295
   query88	4533	4063	4076	4063
   query89	371	359	361	359
   query90	1988	317	304	304
   query91	187	124	124	124
   query92	80	76	77	76
   query93	903	899	906	899
   query94	730	392	344	344
   query95	435	423	414	414
   query96	479	465	470	465
   query97	3162	3104	3125	3104
   query98	233	231	230	230
   query99	1466	1267	1307	1267
   Total cold run time: 299383 ms
   Total hot run time: 196369 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2340743904

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Fix](load) fix wrong replica number when loading to table with no partition [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #40635:
URL: https://github.com/apache/doris/pull/40635#issuecomment-2342824661

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org