You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "morningman (via GitHub)" <gi...@apache.org> on 2024/03/07 06:22:50 UTC

[PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

morningman opened a new pull request, #31916:
URL: https://github.com/apache/doris/pull/31916

   bp #31568


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #31916:
URL: https://github.com/apache/doris/pull/31916


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31916:
URL: https://github.com/apache/doris/pull/31916#issuecomment-1982894467

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 49890 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit c9c48faa3c8154f8527d1881a9b2e4ad42171606, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18136	4365	4356	4356
   q2	2033	150	143	143
   q3	10431	1851	1904	1851
   q4	10217	1264	1331	1264
   q5	8405	3943	3983	3943
   q6	229	121	121	121
   q7	2042	1584	1600	1584
   q8	9308	2707	2698	2698
   q9	10743	10547	10447	10447
   q10	8644	3528	3537	3528
   q11	414	245	244	244
   q12	461	296	296	296
   q13	18528	4003	4098	4003
   q14	369	325	335	325
   q15	508	462	446	446
   q16	708	614	602	602
   q17	1127	941	974	941
   q18	7358	6817	6982	6817
   q19	1662	1581	1526	1526
   q20	509	313	320	313
   q21	4457	4044	4084	4044
   q22	510	403	398	398
   Total cold run time: 116799 ms
   Total hot run time: 49890 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4313	4296	4319	4296
   q2	315	222	223	222
   q3	4134	4116	4162	4116
   q4	2758	2731	2740	2731
   q5	7267	7144	7211	7144
   q6	238	120	118	118
   q7	3218	2857	2806	2806
   q8	4361	4461	4505	4461
   q9	17053	17009	17056	17009
   q10	4250	4254	4243	4243
   q11	765	706	688	688
   q12	1029	864	842	842
   q13	7081	3746	3712	3712
   q14	461	427	418	418
   q15	490	452	465	452
   q16	767	693	695	693
   q17	3868	3806	3802	3802
   q18	8750	8825	8667	8667
   q19	1685	1683	1679	1679
   q20	2346	2136	2124	2124
   q21	8506	8547	8496	8496
   q22	1005	934	945	934
   Total cold run time: 84660 ms
   Total hot run time: 79653 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #31916:
URL: https://github.com/apache/doris/pull/31916#issuecomment-1982805905

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31916:
URL: https://github.com/apache/doris/pull/31916#issuecomment-1982965836

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit c9c48faa3c8154f8527d1881a9b2e4ad42171606 with default session variables
   Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       20.6 seconds inserted 10000000 Rows, about 485K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31916:
URL: https://github.com/apache/doris/pull/31916#issuecomment-1982938382

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 202836 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit c9c48faa3c8154f8527d1881a9b2e4ad42171606, data reload: false
   
   query1	914	386	377	377
   query2	6532	2273	2146	2146
   query3	6912	202	193	193
   query4	20171	18001	18021	18001
   query5	19720	6497	6518	6497
   query6	292	212	223	212
   query7	4154	296	294	294
   query8	251	259	237	237
   query9	3107	2699	2646	2646
   query10	424	297	296	296
   query11	11355	10712	10707	10707
   query12	125	76	72	72
   query13	5587	648	643	643
   query14	18017	13351	13458	13351
   query15	383	233	228	228
   query16	6452	267	262	262
   query17	1732	1469	865	865
   query18	2303	406	400	400
   query19	203	149	147	147
   query20	72	79	75	75
   query21	192	93	97	93
   query22	5203	5160	5009	5009
   query23	32571	31975	32013	31975
   query24	7023	6597	6541	6541
   query25	511	421	425	421
   query26	520	155	160	155
   query27	1902	295	293	293
   query28	6021	2239	2195	2195
   query29	2814	2697	2700	2697
   query30	242	159	158	158
   query31	907	765	749	749
   query32	63	59	55	55
   query33	400	240	264	240
   query34	846	467	474	467
   query35	1105	900	873	873
   query36	1681	1425	1358	1358
   query37	89	62	63	62
   query38	3088	2909	2900	2900
   query39	1373	1339	1310	1310
   query40	211	91	92	91
   query41	34	32	32	32
   query42	80	86	84	84
   query43	609	600	577	577
   query44	1126	730	725	725
   query45	241	224	223	223
   query46	1234	990	974	974
   query47	1971	1768	1828	1768
   query48	969	689	661	661
   query49	618	364	356	356
   query50	863	643	615	615
   query51	4735	4670	4620	4620
   query52	97	87	84	84
   query53	440	334	312	312
   query54	2624	2467	2463	2463
   query55	83	76	76	76
   query56	211	205	201	201
   query57	1136	1180	1100	1100
   query58	205	198	194	194
   query59	3559	3337	3325	3325
   query60	210	196	192	192
   query61	82	78	104	78
   query62	874	476	469	469
   query63	473	330	339	330
   query64	2539	1482	1336	1336
   query65	3647	3613	3553	3553
   query66	758	366	366	366
   query67	17294	16053	17156	16053
   query68	5801	625	647	625
   query69	545	337	346	337
   query70	1834	1579	1925	1579
   query71	384	309	301	301
   query72	6234	3455	3382	3382
   query73	714	322	321	321
   query74	6307	5835	5811	5811
   query75	4479	3662	3776	3662
   query76	3334	1186	1359	1186
   query77	534	245	250	245
   query78	12519	11647	11655	11647
   query79	7432	632	619	619
   query80	2927	395	379	379
   query81	520	237	234	234
   query82	1600	106	93	93
   query83	249	128	129	128
   query84	259	68	69	68
   query85	1399	276	266	266
   query86	396	387	415	387
   query87	3286	3036	2995	2995
   query88	5056	2286	2289	2286
   query89	363	284	280	280
   query90	1731	209	206	206
   query91	146	124	116	116
   query92	55	52	49	49
   query93	3106	577	593	577
   query94	899	198	199	198
   query95	1104	1063	1037	1037
   query96	627	323	325	323
   query97	6505	6341	6407	6341
   query98	191	175	169	169
   query99	3051	931	976	931
   Total cold run time: 305767 ms
   Total hot run time: 202836 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31916:
URL: https://github.com/apache/doris/pull/31916#issuecomment-1982955277

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.19 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit c9c48faa3c8154f8527d1881a9b2e4ad42171606, data reload: false
   
   query1	0.02	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.24	0.05	0.05
   query4	1.83	0.05	0.06
   query5	0.54	0.52	0.52
   query6	1.25	0.62	0.61
   query7	0.02	0.01	0.01
   query8	0.04	0.02	0.02
   query9	0.52	0.48	0.49
   query10	0.54	0.55	0.55
   query11	0.11	0.09	0.08
   query12	0.11	0.09	0.09
   query13	0.62	0.61	0.61
   query14	0.78	0.80	0.77
   query15	0.78	0.76	0.76
   query16	0.37	0.37	0.37
   query17	1.02	1.00	1.01
   query18	0.20	0.28	0.24
   query19	1.95	1.88	1.82
   query20	0.01	0.01	0.01
   query21	15.47	0.55	0.54
   query22	2.01	2.30	1.31
   query23	17.53	1.02	0.96
   query24	6.29	0.79	1.00
   query25	0.39	0.11	0.06
   query26	0.64	0.15	0.16
   query27	0.04	0.03	0.03
   query28	7.14	0.72	0.72
   query29	12.60	2.38	2.23
   query30	0.59	0.52	0.51
   query31	2.81	0.38	0.38
   query32	3.40	0.49	0.49
   query33	3.03	3.08	3.07
   query34	15.32	4.82	4.78
   query35	4.87	4.83	4.83
   query36	1.09	1.02	1.01
   query37	0.06	0.05	0.04
   query38	0.04	0.02	0.03
   query39	0.02	0.01	0.02
   query40	0.16	0.14	0.14
   query41	0.06	0.01	0.02
   query42	0.02	0.02	0.02
   query43	0.02	0.01	0.02
   Total cold run time: 104.61 s
   Total hot run time: 30.19 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](paimon) auto deplay paimon oss/s3 jar file (#31568) [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on PR #31916:
URL: https://github.com/apache/doris/pull/31916#issuecomment-1982535678

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org