You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wuwenchi (via GitHub)" <gi...@apache.org> on 2024/02/01 06:27:29 UTC

[PR] [bugfix](paimon)add class loader [doris]

wuwenchi opened a new pull request, #30690:
URL: https://github.com/apache/doris/pull/30690

   ## Proposed changes
   
   #30483
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "wuwenchi (via GitHub)" <gi...@apache.org>.
wuwenchi commented on PR #30690:
URL: https://github.com/apache/doris/pull/30690#issuecomment-1920677722

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30690:
URL: https://github.com/apache/doris/pull/30690#issuecomment-1920598469

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30690:
URL: https://github.com/apache/doris/pull/30690#issuecomment-1920748263

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit 6c730154895d3cf7cae20a28482acf5b02e7d0dc with default session variables
   Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
   Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #30690:
URL: https://github.com/apache/doris/pull/30690


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30690:
URL: https://github.com/apache/doris/pull/30690#issuecomment-1920713494

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 50450 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 6c730154895d3cf7cae20a28482acf5b02e7d0dc, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17548	4421	4318	4318
   q2	2035	165	140	140
   q3	10261	1872	1939	1872
   q4	10096	1259	1337	1259
   q5	8323	3982	3954	3954
   q6	230	123	124	123
   q7	2052	1607	1606	1606
   q8	9256	2735	2736	2735
   q9	10933	11203	10985	10985
   q10	8694	3528	3477	3477
   q11	427	243	250	243
   q12	477	295	303	295
   q13	18325	3942	4021	3942
   q14	347	332	319	319
   q15	503	446	448	446
   q16	698	586	600	586
   q17	1130	977	971	971
   q18	7259	6935	7104	6935
   q19	1706	1559	1491	1491
   q20	541	289	302	289
   q21	4435	4105	4068	4068
   q22	513	401	396	396
   Total cold run time: 115789 ms
   Total hot run time: 50450 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	4300	4304	4313	4304
   q2	318	224	229	224
   q3	4171	4152	4183	4152
   q4	2775	2752	2751	2751
   q5	7345	7240	7261	7240
   q6	237	118	118	118
   q7	3287	2840	2880	2840
   q8	4362	4452	4498	4452
   q9	17165	16974	17042	16974
   q10	4263	4315	4268	4268
   q11	788	687	668	668
   q12	1015	864	860	860
   q13	7301	3724	3768	3724
   q14	436	424	426	424
   q15	504	460	459	459
   q16	768	729	700	700
   q17	3855	3866	3843	3843
   q18	8895	8904	8931	8904
   q19	1725	1710	1668	1668
   q20	2381	2181	2097	2097
   q21	8465	8636	8454	8454
   q22	1054	962	942	942
   Total cold run time: 85410 ms
   Total hot run time: 80066 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30690:
URL: https://github.com/apache/doris/pull/30690#issuecomment-1920734660

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 241940 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 6c730154895d3cf7cae20a28482acf5b02e7d0dc, data reload: false
   
   query1	912	391	383	383
   query2	6528	2241	2125	2125
   query3	6909	206	202	202
   query4	21208	18117	18118	18117
   query5	19716	6293	6237	6237
   query6	283	207	236	207
   query7	4167	296	301	296
   query8	274	221	233	221
   query9	3048	2667	2596	2596
   query10	417	315	292	292
   query11	11424	10822	10707	10707
   query12	115	78	78	78
   query13	5649	654	642	642
   query14	17267	13038	13574	13038
   query15	367	242	233	233
   query16	6439	256	257	256
   query17	3194	874	836	836
   query18	2270	407	408	407
   query19	196	149	149	149
   query20	74	78	74	74
   query21	191	99	96	96
   query22	5282	5175	5081	5081
   query23	32584	31909	31930	31909
   query24	7067	6535	6527	6527
   query25	510	438	412	412
   query26	529	159	154	154
   query27	1881	289	292	289
   query28	6092	2214	2202	2202
   query29	2948	2748	2801	2748
   query30	241	162	164	162
   query31	909	742	744	742
   query32	68	57	58	57
   query33	392	257	241	241
   query34	834	463	471	463
   query35	1121	928	879	879
   query36	1804	1418	1504	1418
   query37	96	61	60	60
   query38	3111	2918	2922	2918
   query39	1365	1315	1320	1315
   query40	201	94	93	93
   query41	33	31	32	31
   query42	81	91	93	91
   query43	701	561	560	560
   query44	1128	702	703	702
   query45	240	226	225	225
   query46	1240	974	995	974
   query47	1848	1710	1754	1710
   query48	979	702	666	666
   query49	616	371	355	355
   query50	858	665	616	616
   query51	5542	5469	5497	5469
   query52	93	82	85	82
   query53	437	329	322	322
   query54	2445	2281	2264	2264
   query55	87	75	76	75
   query56	210	199	200	199
   query57	1102	1112	1304	1112
   query58	232	202	189	189
   query59	3651	3288	3272	3272
   query60	206	206	192	192
   query61	89	82	80	80
   query62	757	515	513	513
   query63	475	333	333	333
   query64	2007	1308	1397	1308
   query65	3694	3644	3574	3574
   query66	803	361	365	361
   query67	15833	16202	15625	15625
   query68	10128	651	669	651
   query69	566	338	335	335
   query70	2446	1836	1736	1736
   query71	390	307	294	294
   query72	4424	3283	3335	3283
   query73	721	322	340	322
   query74	6372	5786	5804	5786
   query75	4839	3570	3486	3486
   query76	6602	1145	1165	1145
   query77	1115	264	249	249
   query78	32855	51255	52841	51255
   query79	16197	681	611	611
   query80	5184	377	375	375
   query81	559	232	234	232
   query82	1153	100	96	96
   query83	413	130	130	130
   query84	268	69	72	69
   query85	2610	283	276	276
   query86	483	380	389	380
   query87	3253	2986	2951	2951
   query88	7220	2334	2362	2334
   query89	471	311	281	281
   query90	2505	210	211	210
   query91	152	113	113	113
   query92	62	52	54	52
   query93	6525	593	564	564
   query94	1851	203	209	203
   query95	1109	1070	1039	1039
   query96	646	329	328	328
   query97	6484	6289	6393	6289
   query98	202	171	169	169
   query99	3926	934	952	934
   Total cold run time: 354801 ms
   Total hot run time: 241940 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [bugfix](paimon)add class loader [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30690:
URL: https://github.com/apache/doris/pull/30690#issuecomment-1920743045

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 30.95 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 6c730154895d3cf7cae20a28482acf5b02e7d0dc, data reload: false
   
   query1	0.02	0.02	0.02
   query2	0.06	0.02	0.02
   query3	0.24	0.04	0.04
   query4	1.82	0.06	0.07
   query5	0.52	0.52	0.52
   query6	1.31	0.60	0.61
   query7	0.01	0.01	0.01
   query8	0.03	0.02	0.02
   query9	0.51	0.47	0.48
   query10	0.53	0.54	0.53
   query11	0.12	0.09	0.08
   query12	0.10	0.08	0.09
   query13	0.62	0.61	0.61
   query14	0.79	0.79	0.81
   query15	0.77	0.76	0.76
   query16	0.38	0.36	0.37
   query17	0.99	1.03	1.00
   query18	0.21	0.26	0.25
   query19	1.93	1.84	1.91
   query20	0.02	0.02	0.01
   query21	15.47	0.57	0.57
   query22	2.02	2.51	1.72
   query23	17.17	0.96	0.83
   query24	4.04	1.06	1.57
   query25	1.54	0.11	0.11
   query26	0.22	0.13	0.14
   query27	0.10	0.11	0.11
   query28	8.31	0.77	0.70
   query29	12.72	2.36	2.30
   query30	0.56	0.52	0.52
   query31	2.81	0.37	0.38
   query32	3.41	0.50	0.49
   query33	3.10	3.12	3.06
   query34	15.26	4.81	4.81
   query35	4.86	4.85	4.83
   query36	1.05	1.02	1.02
   query37	0.06	0.04	0.05
   query38	0.04	0.02	0.02
   query39	0.02	0.01	0.02
   query40	0.16	0.14	0.14
   query41	0.06	0.01	0.01
   query42	0.02	0.02	0.02
   query43	0.03	0.01	0.02
   Total cold run time: 104.01 s
   Total hot run time: 30.95 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org