You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "LuGuangming (via GitHub)" <gi...@apache.org> on 2023/12/29 08:18:45 UTC

[PR] [fix][security]security optimize for executable binary file doris_be … [doris]

LuGuangming opened a new pull request, #29303:
URL: https://github.com/apache/doris/pull/29303

   …access should be restricted #29301
   
   ## Proposed changes
   
   Issue Number: close #29301
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "LuGuangming (via GitHub)" <gi...@apache.org>.
LuGuangming commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1871831557

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1871863596

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 61146a1169c486acede6c97f5f0c2e34559dde95, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	18890	5196	5125	5125
   q2	2030	161	154	154
   q3	10597	1143	1145	1143
   q4	10198	813	827	813
   q5	7802	3024	2992	2992
   q6	215	137	135	135
   q7	928	535	535	535
   q8	9295	2053	2063	2053
   q9	6908	6429	6430	6429
   q10	8277	3111	3036	3036
   q11	418	223	228	223
   q12	398	242	241	241
   q13	18003	3643	3591	3591
   q14	254	223	221	221
   q15	597	564	559	559
   q16	456	400	402	400
   q17	987	520	522	520
   q18	7402	6718	6678	6678
   q19	1609	1353	1368	1353
   q20	704	359	354	354
   q21	2817	2364	2452	2364
   q22	378	321	331	321
   Total cold run time: 109163 ms
   Total hot run time: 39240 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5118	5091	5017	5017
   q2	340	260	252	252
   q3	3317	3302	3256	3256
   q4	2129	2001	1992	1992
   q5	5819	5819	5817	5817
   q6	222	126	131	126
   q7	2349	1875	1946	1875
   q8	3404	3470	3497	3470
   q9	8894	8813	8835	8813
   q10	3798	3876	3860	3860
   q11	582	503	484	484
   q12	790	644	655	644
   q13	4116	3223	3179	3179
   q14	291	279	283	279
   q15	622	554	540	540
   q16	555	511	504	504
   q17	1986	1758	1748	1748
   q18	8716	8476	8262	8262
   q19	1651	1603	1598	1598
   q20	2224	1967	1975	1967
   q21	5605	5233	5187	5187
   q22	536	485	451	451
   Total cold run time: 63064 ms
   Total hot run time: 59321 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1871877264

   TeamCity be ut coverage result:
    Function Coverage: 36.61% (8604/23504) 
    Line Coverage: 28.67% (69953/243993)
    Region Coverage: 27.67% (36201/130830)
    Branch Coverage: 24.38% (18500/75888)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/61146a1169c486acede6c97f5f0c2e34559dde95_61146a1169c486acede6c97f5f0c2e34559dde95/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1871874495

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 47.59 seconds
    stream load tsv:          577 seconds loaded 74807831229 Bytes, about 123 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.3 seconds inserted 10000000 Rows, about 353K ops/s
    storage size: 17184136759 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1872529846

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #29303:
URL: https://github.com/apache/doris/pull/29303


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1871871402

   
   TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
   ```
   TPC-DS sf100 test result on commit 61146a1169c486acede6c97f5f0c2e34559dde95, data reload: false
   
   run tpcds-sf100 query with default conf and session variables
   query1	917	361	339	339
   query2	6415	1990	1920	1920
   query3	6642	232	218	218
   query4	26461	22516	22482	22482
   query5	5323	549	574	549
   query6	276	181	182	181
   query7	4582	270	265	265
   query8	228	211	198	198
   query9	8061	2681	2642	2642
   query10	436	268	237	237
   query11	16178	15612	15573	15573
   query12	141	86	76	76
   query13	1661	320	329	320
   query14	12233	7350	7208	7208
   query15	244	184	195	184
   query16	6460	298	290	290
   query17	1753	502	492	492
   query18	1918	271	253	253
   query19	265	136	136	136
   query20	85	82	79	79
   query21	180	94	98	94
   query22	5073	4853	4803	4803
   query23	32175	31289	31334	31289
   query24	11882	2847	2826	2826
   query25	588	338	341	338
   query26	1707	148	148	148
   query27	2910	279	291	279
   query28	7268	1996	1973	1973
   query29	2067	413	391	391
   query30	287	138	144	138
   query31	972	767	769	767
   query32	90	62	63	62
   query33	713	283	277	277
   query34	880	459	447	447
   query35	889	756	751	751
   query36	1332	1195	1236	1195
   query37	195	83	89	83
   query38	3450	3280	3264	3264
   query39	1328	1297	1284	1284
   query40	301	92	94	92
   query41	41	35	34	34
   query42	103	95	94	94
   query43	516	504	486	486
   query44	1108	762	772	762
   query45	199	191	181	181
   query46	1084	652	636	636
   query47	1678	1546	1630	1546
   query48	337	278	256	256
   query49	1206	336	329	329
   query50	808	337	347	337
   query51	5423	5229	5213	5213
   query52	102	90	90	90
   query53	220	150	151	150
   query54	1343	588	596	588
   query55	102	96	87	87
   query56	217	202	199	199
   query57	1044	983	967	967
   query58	226	211	206	206
   query59	2866	2715	2724	2715
   query60	265	234	238	234
   query61	81	78	79	78
   query62	655	494	478	478
   query63	171	150	155	150
   query64	5883	1746	1754	1746
   query65	3347	3271	3261	3261
   query66	1310	339	325	325
   query67	15482	15192	15264	15192
   query68	13428	534	500	500
   query69	611	262	259	259
   query70	1734	1624	1585	1585
   query71	574	232	230	230
   query72	5498	3532	3522	3522
   query73	2106	331	333	331
   query74	7229	6387	6478	6387
   query75	5995	2320	2249	2249
   query76	6119	1123	1090	1090
   query77	918	289	307	289
   query78	9118	8753	8572	8572
   query79	3338	500	516	500
   query80	1018	373	356	356
   query81	520	210	206	206
   query82	447	124	116	116
   query83	400	147	140	140
   query84	261	59	63	59
   query85	1352	280	276	276
   query86	407	391	374	374
   query87	3558	3396	3395	3395
   query88	3063	2413	2426	2413
   query89	344	263	262	262
   query90	1877	251	255	251
   query91	122	90	93	90
   query92	71	54	59	54
   query93	3093	498	490	490
   query94	870	216	216	216
   query95	519	477	463	463
   query96	652	336	344	336
   query97	4310	4141	4210	4141
   query98	215	190	182	182
   query99	1233	849	850	849
   Total cold run time: 301383 ms
   Total hot run time: 180666 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1872529856

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix][security]security optimize for executable binary file doris_be … [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29303:
URL: https://github.com/apache/doris/pull/29303#issuecomment-1871873445

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
   ```
   Tpch sf100 test result on commit 61146a1169c486acede6c97f5f0c2e34559dde95, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	5358	5120	5173	5120
   q2	384	170	157	157
   q3	1473	1172	1126	1126
   q4	1078	847	769	769
   q5	3173	3121	3124	3121
   q6	230	141	142	141
   q7	999	546	555	546
   q8	2161	2223	2169	2169
   q9	6764	6693	6662	6662
   q10	3173	3135	3154	3135
   q11	346	234	229	229
   q12	394	241	246	241
   q13	4393	3639	3650	3639
   q14	246	222	213	213
   q15	622	575	561	561
   q16	467	401	415	401
   q17	1053	570	492	492
   q18	7140	6769	6835	6769
   q19	1643	1550	1497	1497
   q20	596	384	367	367
   q21	2933	2428	2473	2428
   q22	383	313	334	313
   Total cold run time: 45009 ms
   Total hot run time: 40096 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	5145	5081	5053	5053
   q2	343	273	257	257
   q3	3374	3285	3276	3276
   q4	2149	2048	2012	2012
   q5	5951	5926	5942	5926
   q6	234	136	136	136
   q7	2438	1941	1928	1928
   q8	3582	3660	3651	3651
   q9	9067	9031	9042	9031
   q10	3878	3929	3949	3929
   q11	611	515	474	474
   q12	832	644	691	644
   q13	3905	3225	3217	3217
   q14	309	272	295	272
   q15	624	572	567	567
   q16	545	522	497	497
   q17	2033	1841	1811	1811
   q18	8762	8370	8310	8310
   q19	1741	1755	1711	1711
   q20	2285	2013	1984	1984
   q21	5727	5299	5396	5299
   q22	543	527	502	502
   Total cold run time: 64078 ms
   Total hot run time: 60487 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org