You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "w41ter (via GitHub)" <gi...@apache.org> on 2024/03/12 07:18:43 UTC

[PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

w41ter opened a new pull request, #32102:
URL: https://github.com/apache/doris/pull/32102

   ## Proposed changes
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990930114

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990930178

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990968845

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 36640 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit acfcd2f0fbc3d5f279a2a9ca26b2a8fdd5538b2c, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17648	4258	4133	4133
   q2	2057	161	153	153
   q3	10635	924	912	912
   q4	4657	713	689	689
   q5	7594	2741	2751	2741
   q6	184	126	126	126
   q7	1222	817	804	804
   q8	9500	2073	2053	2053
   q9	7803	6505	6493	6493
   q10	8116	2481	2458	2458
   q11	427	217	214	214
   q12	785	304	298	298
   q13	17959	3035	3002	3002
   q14	276	248	264	248
   q15	495	464	451	451
   q16	466	404	392	392
   q17	946	549	537	537
   q18	6749	5992	5789	5789
   q19	1582	1341	1447	1341
   q20	550	291	294	291
   q21	7343	3273	3213	3213
   q22	799	304	302	302
   Total cold run time: 107793 ms
   Total hot run time: 36640 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4116	4085	4107	4085
   q2	326	226	224	224
   q3	2979	2846	2892	2846
   q4	1817	1597	1538	1538
   q5	5236	5243	5252	5243
   q6	198	115	118	115
   q7	2290	1870	1820	1820
   q8	3149	3290	3269	3269
   q9	8558	8534	8532	8532
   q10	6162	3672	3639	3639
   q11	538	441	452	441
   q12	739	527	536	527
   q13	13271	2839	2861	2839
   q14	280	245	255	245
   q15	481	442	449	442
   q16	453	410	407	407
   q17	1747	1490	1443	1443
   q18	7786	7309	7003	7003
   q19	5542	1536	1550	1536
   q20	1908	1707	1715	1707
   q21	4888	4678	4816	4678
   q22	522	461	463	461
   Total cold run time: 72986 ms
   Total hot run time: 53040 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #32102:
URL: https://github.com/apache/doris/pull/32102


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990985014

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 187739 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit acfcd2f0fbc3d5f279a2a9ca26b2a8fdd5538b2c, data reload: false
   
   query1	916	357	348	348
   query2	7381	2068	2003	2003
   query3	6706	215	212	212
   query4	31248	20702	20813	20702
   query5	4569	405	486	405
   query6	272	170	174	170
   query7	4618	318	293	293
   query8	239	175	173	173
   query9	9962	2329	2290	2290
   query10	443	237	254	237
   query11	17313	14323	14271	14271
   query12	132	84	82	82
   query13	1624	420	420	420
   query14	11820	10531	10461	10461
   query15	281	222	193	193
   query16	8071	277	269	269
   query17	1926	578	558	558
   query18	2109	295	282	282
   query19	235	156	155	155
   query20	95	82	85	82
   query21	198	130	123	123
   query22	4713	4443	4427	4427
   query23	31788	31221	31390	31221
   query24	10751	2833	2852	2833
   query25	632	374	377	374
   query26	1389	162	154	154
   query27	3026	370	354	354
   query28	8033	1920	1885	1885
   query29	913	651	633	633
   query30	307	152	157	152
   query31	950	703	737	703
   query32	92	61	57	57
   query33	767	265	261	261
   query34	1056	471	490	471
   query35	841	614	606	606
   query36	1011	868	878	868
   query37	133	80	77	77
   query38	3295	3186	3126	3126
   query39	1440	1370	1397	1370
   query40	206	115	111	111
   query41	50	47	50	47
   query42	99	96	98	96
   query43	489	444	458	444
   query44	1310	722	718	718
   query45	274	267	268	267
   query46	1066	690	684	684
   query47	1678	1606	1584	1584
   query48	482	360	370	360
   query49	1130	339	353	339
   query50	752	376	390	376
   query51	6599	6585	6630	6585
   query52	106	93	125	93
   query53	341	278	278	278
   query54	311	235	249	235
   query55	86	83	79	79
   query56	252	229	228	228
   query57	1099	1013	1012	1012
   query58	238	205	233	205
   query59	2803	2586	2577	2577
   query60	288	250	271	250
   query61	115	110	115	110
   query62	611	408	406	406
   query63	297	275	278	275
   query64	6926	3792	3859	3792
   query65	3100	3015	3014	3014
   query66	1405	328	326	326
   query67	15088	14474	14661	14474
   query68	6950	522	531	522
   query69	632	382	373	373
   query70	1294	1204	1172	1172
   query71	530	277	273	273
   query72	6543	2664	2479	2479
   query73	724	317	319	317
   query74	7031	6612	6577	6577
   query75	9356	8054	8057	8054
   query76	4868	966	946	946
   query77	642	260	257	257
   query78	10483	9613	9711	9613
   query79	10269	515	519	515
   query80	1535	377	376	376
   query81	532	205	205	205
   query82	1116	211	201	201
   query83	217	135	141	135
   query84	290	88	78	78
   query85	1487	341	313	313
   query86	466	308	308	308
   query87	3450	3251	3311	3251
   query88	5003	2373	2329	2329
   query89	532	359	368	359
   query90	2057	180	178	178
   query91	169	128	126	126
   query92	62	47	45	45
   query93	7217	503	489	489
   query94	1174	176	173	173
   query95	426	328	330	328
   query96	608	274	276	274
   query97	4422	4247	4278	4247
   query98	234	209	203	203
   query99	1238	757	772	757
   Total cold run time: 320053 ms
   Total hot run time: 187739 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990992345

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.2 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit acfcd2f0fbc3d5f279a2a9ca26b2a8fdd5538b2c, data reload: false
   
   query1	0.04	0.04	0.03
   query2	0.06	0.02	0.03
   query3	0.23	0.06	0.06
   query4	1.65	0.10	0.10
   query5	0.52	0.52	0.48
   query6	1.19	0.61	0.63
   query7	0.02	0.02	0.02
   query8	0.04	0.03	0.03
   query9	0.54	0.50	0.49
   query10	0.53	0.55	0.55
   query11	0.12	0.09	0.08
   query12	0.12	0.09	0.09
   query13	0.57	0.56	0.56
   query14	0.73	0.75	0.75
   query15	0.79	0.79	0.79
   query16	0.40	0.39	0.38
   query17	0.99	0.93	0.93
   query18	0.21	0.24	0.23
   query19	1.84	1.72	1.75
   query20	0.01	0.00	0.01
   query21	15.41	0.58	0.56
   query22	2.81	1.94	1.76
   query23	17.22	0.92	0.67
   query24	3.44	2.00	2.49
   query25	0.11	0.25	0.04
   query26	0.82	0.13	0.13
   query27	0.03	0.03	0.04
   query28	10.79	0.91	0.91
   query29	12.53	3.23	3.15
   query30	0.66	0.56	0.60
   query31	2.79	0.34	0.34
   query32	3.36	0.44	0.43
   query33	2.80	2.78	2.78
   query34	16.11	4.32	4.35
   query35	4.28	4.33	4.31
   query36	1.08	1.01	1.01
   query37	0.07	0.05	0.05
   query38	0.05	0.03	0.03
   query39	0.02	0.01	0.02
   query40	0.17	0.13	0.14
   query41	0.08	0.02	0.02
   query42	0.03	0.02	0.02
   query43	0.02	0.03	0.02
   Total cold run time: 105.28 s
   Total hot run time: 31.2 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990996943

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit acfcd2f0fbc3d5f279a2a9ca26b2a8fdd5538b2c with default session variables
   Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
   Insert into select:       16.0 seconds inserted 10000000 Rows, about 625K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1991524215

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](merge-cloud) Keep RecyclePartitionInfo compatible with the cloud mode [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32102:
URL: https://github.com/apache/doris/pull/32102#issuecomment-1990947323

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org