You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "w41ter (via GitHub)" <gi...@apache.org> on 2024/01/22 09:50:11 UTC

[PR] [feature](merge-cloud) Support cloud snapshot version [doris]

w41ter opened a new pull request, #30232:
URL: https://github.com/apache/doris/pull/30232

   ## Proposed changes
   
   Issue Number: close #xxx
   
   In cloud mode, the meta-read lock cannot keep a snapshot of the partition versions.  After all scan nodes are collected, it is possible to gain a snapshot of the partition version.  This PR batches the requests to obtain a snapshot version and reduce the query latency.
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #30232:
URL: https://github.com/apache/doris/pull/30232


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905836901

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905151794

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1904071854

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38680 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit a3f9d3e8509595e01e3c8e2fdabc07bc221bc2b1, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17670	5301	5237	5237
   q2	2034	144	131	131
   q3	10636	1141	1143	1141
   q4	10224	727	829	727
   q5	7756	3130	3157	3130
   q6	195	121	124	121
   q7	847	489	471	471
   q8	9218	1907	1938	1907
   q9	7262	6365	6306	6306
   q10	8229	3019	3045	3019
   q11	419	207	208	207
   q12	354	187	190	187
   q13	17987	3362	3387	3362
   q14	263	213	215	213
   q15	551	514	504	504
   q16	430	384	403	384
   q17	926	522	522	522
   q18	7538	7039	6740	6740
   q19	1584	1400	1397	1397
   q20	611	303	292	292
   q21	2715	2383	2429	2383
   q22	361	299	310	299
   Total cold run time: 107810 ms
   Total hot run time: 38680 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5471	5359	5263	5263
   q2	327	216	217	216
   q3	3390	3284	3241	3241
   q4	2099	2099	2098	2098
   q5	6073	5853	5936	5853
   q6	192	120	116	116
   q7	2296	1846	1926	1846
   q8	3232	3389	3388	3388
   q9	8993	8896	8917	8896
   q10	3982	4075	4085	4075
   q11	584	490	481	481
   q12	836	651	645	645
   q13	17277	3463	3347	3347
   q14	488	276	279	276
   q15	614	541	638	541
   q16	574	532	522	522
   q17	1889	1884	1900	1884
   q18	10312	19355	9937	9937
   q19	24403	1603	1536	1536
   q20	4649	1977	1954	1954
   q21	15025	5466	5525	5466
   q22	993	545	534	534
   Total cold run time: 113699 ms
   Total hot run time: 62115 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905184086

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.67 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit df0f0d389881e8d222144509ebb4ddd80c151d36, data reload: false
   
   query1	0.03	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.23	0.05	0.05
   query4	1.69	0.06	0.07
   query5	0.54	0.52	0.52
   query6	1.29	0.65	0.64
   query7	0.02	0.02	0.01
   query8	0.04	0.02	0.03
   query9	0.54	0.51	0.49
   query10	0.55	0.55	0.57
   query11	0.11	0.09	0.09
   query12	0.11	0.09	0.09
   query13	0.60	0.60	0.61
   query14	0.81	0.80	0.82
   query15	0.78	0.79	0.78
   query16	0.36	0.37	0.39
   query17	1.03	1.03	1.02
   query18	0.21	0.28	0.26
   query19	1.90	1.78	1.80
   query20	0.02	0.01	0.01
   query21	15.43	0.57	0.56
   query22	2.66	2.98	1.56
   query23	17.40	0.77	0.76
   query24	2.42	1.11	1.37
   query25	0.44	0.16	0.12
   query26	0.61	0.14	0.13
   query27	0.06	0.05	0.05
   query28	10.78	0.75	0.76
   query29	12.50	3.19	3.12
   query30	0.54	0.52	0.49
   query31	2.78	0.33	0.34
   query32	3.38	0.47	0.48
   query33	3.20	3.24	3.20
   query34	15.69	4.25	4.35
   query35	4.33	4.26	4.37
   query36	1.10	1.08	1.06
   query37	0.06	0.05	0.05
   query38	0.04	0.02	0.02
   query39	0.02	0.01	0.02
   query40	0.16	0.14	0.16
   query41	0.07	0.02	0.01
   query42	0.02	0.02	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 104.63 s
   Total hot run time: 30.67 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905179377

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 176778 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit df0f0d389881e8d222144509ebb4ddd80c151d36, data reload: false
   
   query1	949	332	326	326
   query2	6583	1922	1901	1901
   query3	6705	198	196	196
   query4	33015	22111	22222	22111
   query5	4451	370	433	370
   query6	240	177	161	161
   query7	4612	264	255	255
   query8	234	193	194	193
   query9	8356	2524	2503	2503
   query10	419	226	234	226
   query11	16984	15508	15510	15508
   query12	123	71	68	68
   query13	1677	377	387	377
   query14	10537	7049	6900	6900
   query15	214	179	183	179
   query16	5783	258	268	258
   query17	931	471	480	471
   query18	1781	253	257	253
   query19	173	133	127	127
   query20	69	72	71	71
   query21	187	121	132	121
   query22	4997	4763	4784	4763
   query23	32069	31020	31094	31020
   query24	12601	2773	2841	2773
   query25	575	318	299	299
   query26	1838	140	140	140
   query27	3242	286	289	286
   query28	7249	1833	1833	1833
   query29	2220	624	619	619
   query30	291	144	134	134
   query31	941	735	773	735
   query32	83	51	48	48
   query33	712	213	208	208
   query34	1164	456	456	456
   query35	870	822	818	818
   query36	1419	1318	1276	1276
   query37	92	58	60	58
   query38	3368	3212	3209	3209
   query39	1296	1267	1260	1260
   query40	338	87	82	82
   query41	38	39	34	34
   query42	104	78	82	78
   query43	506	457	467	457
   query44	1102	687	683	683
   query45	196	179	177	177
   query46	1082	648	669	648
   query47	1652	1541	1588	1541
   query48	371	314	307	307
   query49	1218	296	283	283
   query50	684	309	315	309
   query51	5296	5312	5202	5202
   query52	94	76	74	74
   query53	331	255	259	255
   query54	264	178	191	178
   query55	83	76	80	76
   query56	177	180	178	178
   query57	1053	951	935	935
   query58	188	170	162	162
   query59	2999	2686	2743	2686
   query60	211	183	185	183
   query61	84	81	82	81
   query62	618	382	372	372
   query63	287	265	264	264
   query64	6113	1752	1737	1737
   query65	3323	3271	3249	3249
   query66	1390	319	309	309
   query67	15641	15120	15178	15120
   query68	12630	557	515	515
   query69	623	301	289	289
   query70	1694	1449	1530	1449
   query71	555	210	219	210
   query72	4887	2829	2832	2829
   query73	2774	319	320	319
   query74	6973	6329	6463	6329
   query75	5094	2316	2289	2289
   query76	6730	980	980	980
   query77	725	224	232	224
   query78	9658	8844	8666	8666
   query79	1017	499	507	499
   query80	553	319	310	310
   query81	454	213	205	205
   query82	205	82	76	76
   query83	138	113	119	113
   query84	272	69	74	69
   query85	1108	330	332	330
   query86	398	387	391	387
   query87	3544	3398	3263	3263
   query88	3164	2188	2185	2185
   query89	450	368	367	367
   query90	1962	185	183	183
   query91	152	119	128	119
   query92	58	48	44	44
   query93	1497	450	412	412
   query94	1248	157	158	157
   query95	504	450	453	450
   query96	626	317	321	317
   query97	4281	4122	4173	4122
   query98	198	196	190	190
   query99	1083	711	736	711
   Total cold run time: 299748 ms
   Total hot run time: 176778 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1903622194

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1903831866

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1904014901

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1904094104

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 176650 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit a3f9d3e8509595e01e3c8e2fdabc07bc221bc2b1, data reload: false
   
   query1	956	333	328	328
   query2	6553	2046	1812	1812
   query3	6715	203	199	199
   query4	32495	22295	22196	22196
   query5	4456	431	422	422
   query6	238	162	153	153
   query7	4615	270	259	259
   query8	235	174	177	174
   query9	8295	2533	2525	2525
   query10	427	226	228	226
   query11	16987	15385	15458	15385
   query12	124	71	65	65
   query13	1669	377	386	377
   query14	10398	6998	7002	6998
   query15	217	175	187	175
   query16	5786	256	251	251
   query17	948	470	481	470
   query18	1797	259	260	259
   query19	170	134	136	134
   query20	70	72	69	69
   query21	189	123	119	119
   query22	4867	4736	4752	4736
   query23	31409	30776	30853	30776
   query24	11833	2777	2804	2777
   query25	567	301	310	301
   query26	1603	140	140	140
   query27	3227	285	286	285
   query28	7251	1835	1827	1827
   query29	1532	641	624	624
   query30	280	138	146	138
   query31	958	740	753	740
   query32	77	52	49	49
   query33	705	220	212	212
   query34	1150	459	462	459
   query35	906	776	756	756
   query36	1317	1165	1219	1165
   query37	89	58	56	56
   query38	3328	3240	3231	3231
   query39	1316	1282	1261	1261
   query40	202	87	84	84
   query41	37	35	34	34
   query42	93	82	84	82
   query43	485	480	452	452
   query44	1050	678	696	678
   query45	189	177	178	177
   query46	1075	663	665	663
   query47	1665	1604	1577	1577
   query48	376	306	321	306
   query49	1127	282	279	279
   query50	693	310	309	309
   query51	5404	5155	5183	5155
   query52	90	81	82	81
   query53	318	260	258	258
   query54	242	181	187	181
   query55	80	77	76	76
   query56	189	169	175	169
   query57	1000	934	930	930
   query58	178	157	154	154
   query59	2759	2723	2581	2581
   query60	207	186	187	186
   query61	81	88	81	81
   query62	597	369	358	358
   query63	276	252	252	252
   query64	5070	1770	1763	1763
   query65	3301	3238	3243	3238
   query66	1289	315	310	310
   query67	15660	15164	15131	15131
   query68	10762	518	499	499
   query69	616	312	292	292
   query70	1722	1523	1536	1523
   query71	550	210	210	210
   query72	4826	2822	2851	2822
   query73	2124	316	311	311
   query74	6983	6494	6460	6460
   query75	4704	2361	2330	2330
   query76	6719	1034	1012	1012
   query77	658	223	230	223
   query78	9083	8823	8730	8730
   query79	998	508	494	494
   query80	565	324	303	303
   query81	467	201	202	201
   query82	202	76	78	76
   query83	135	117	123	117
   query84	278	68	68	68
   query85	1076	334	341	334
   query86	404	384	380	380
   query87	3546	3380	3383	3380
   query88	2917	2183	2180	2180
   query89	425	359	342	342
   query90	1979	186	178	178
   query91	157	122	140	122
   query92	56	48	43	43
   query93	936	457	421	421
   query94	1145	159	155	155
   query95	493	452	456	452
   query96	615	312	325	312
   query97	4277	4117	4114	4114
   query98	204	196	198	196
   query99	990	697	696	696
   Total cold run time: 290100 ms
   Total hot run time: 176650 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1904110960

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit a3f9d3e8509595e01e3c8e2fdabc07bc221bc2b1 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       14.9 seconds inserted 10000000 Rows, about 671K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905168839

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 39074 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit df0f0d389881e8d222144509ebb4ddd80c151d36, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17794	5309	5414	5309
   q2	2672	144	139	139
   q3	11023	1172	1189	1172
   q4	10879	787	868	787
   q5	8081	3170	3130	3130
   q6	216	124	123	123
   q7	882	496	473	473
   q8	9226	1923	1938	1923
   q9	7245	6403	6371	6371
   q10	8192	3068	3064	3064
   q11	418	204	213	204
   q12	358	195	192	192
   q13	17967	3372	3340	3340
   q14	247	223	214	214
   q15	535	530	504	504
   q16	426	377	390	377
   q17	940	505	514	505
   q18	7591	6888	6882	6882
   q19	1575	1351	1430	1351
   q20	583	313	297	297
   q21	2743	2466	2419	2419
   q22	362	300	298	298
   Total cold run time: 109955 ms
   Total hot run time: 39074 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5400	5236	5329	5236
   q2	323	219	213	213
   q3	3347	3224	3192	3192
   q4	2110	2065	2021	2021
   q5	6114	5967	5954	5954
   q6	194	116	117	116
   q7	2282	1864	1913	1864
   q8	3212	3366	3403	3366
   q9	8976	9016	8776	8776
   q10	3973	3842	3808	3808
   q11	563	466	478	466
   q12	784	620	603	603
   q13	16923	3180	3174	3174
   q14	281	251	265	251
   q15	558	507	507	507
   q16	511	489	477	477
   q17	2008	1786	1824	1786
   q18	9548	14495	9665	9665
   q19	19220	1640	1539	1539
   q20	4642	1922	1907	1907
   q21	14925	5578	5463	5463
   q22	1122	518	571	518
   Total cold run time: 107016 ms
   Total hot run time: 60902 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905257574

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1905186534

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit df0f0d389881e8d222144509ebb4ddd80c151d36 with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       15.0 seconds inserted 10000000 Rows, about 666K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [feature](merge-cloud) Support cloud snapshot version [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30232:
URL: https://github.com/apache/doris/pull/30232#issuecomment-1904104768

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.49 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit a3f9d3e8509595e01e3c8e2fdabc07bc221bc2b1, data reload: false
   
   query1	0.03	0.03	0.02
   query2	0.06	0.02	0.03
   query3	0.22	0.04	0.05
   query4	1.70	0.10	0.10
   query5	0.53	0.52	0.52
   query6	1.26	0.65	0.65
   query7	0.02	0.01	0.01
   query8	0.04	0.02	0.02
   query9	0.55	0.49	0.49
   query10	0.56	0.54	0.55
   query11	0.11	0.09	0.08
   query12	0.11	0.09	0.09
   query13	0.60	0.60	0.60
   query14	0.77	0.81	0.80
   query15	0.78	0.77	0.77
   query16	0.37	0.37	0.37
   query17	1.02	0.99	1.03
   query18	0.24	0.24	0.24
   query19	1.83	1.78	1.74
   query20	0.01	0.00	0.01
   query21	15.40	0.57	0.55
   query22	2.53	2.10	1.88
   query23	17.43	0.84	0.80
   query24	2.30	0.73	1.45
   query25	0.45	0.24	0.06
   query26	0.48	0.14	0.14
   query27	0.06	0.05	0.05
   query28	11.48	0.80	0.75
   query29	12.51	3.17	3.15
   query30	0.56	0.45	0.48
   query31	2.78	0.34	0.34
   query32	3.42	0.47	0.48
   query33	3.20	3.38	3.24
   query34	15.88	4.24	4.24
   query35	4.31	4.26	4.32
   query36	1.10	1.06	1.05
   query37	0.06	0.05	0.05
   query38	0.04	0.02	0.02
   query39	0.02	0.02	0.01
   query40	0.15	0.12	0.12
   query41	0.08	0.01	0.01
   query42	0.03	0.01	0.02
   query43	0.02	0.02	0.02
   Total cold run time: 105.1 s
   Total hot run time: 30.49 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org