You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wsjz (via GitHub)" <gi...@apache.org> on 2023/11/19 17:55:09 UTC

[PR] [fix](multi-catalog)add properties converter fe ut [doris]

wsjz opened a new pull request, #27254:
URL: https://github.com/apache/doris/pull/27254

   ## Proposed changes
   
   [fix](multi-catalog)add properties converter fe ut
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1824274318

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1817930985

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827546744

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 46.58 seconds
    stream load tsv:          568 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         28 seconds loaded 2358488459 Bytes, about 80 MB/s
    stream load orc:          69 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          29.0 seconds inserted 10000000 Rows, about 344K ops/s
    storage size: 17097538203 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1818221701

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.67 seconds
    stream load tsv:          568 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
    stream load orc:          65 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.5 seconds inserted 10000000 Rows, about 350K ops/s
    storage size: 17098396150 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1818104149

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827798070

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1817931030

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827226768

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1818102986

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827444549

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827226805

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827486344

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827289187

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1818224931

   
   <details>
   <summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
   
   ```
   Tpch sf100 test result on commit 2cf00ffe77dece95313a7ecdbc9545de05a25dee, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4894	4656	4647	4647
   q2	359	157	159	157
   q3	2025	1931	1910	1910
   q4	1385	1236	1239	1236
   q5	3958	3931	4010	3931
   q6	253	129	132	129
   q7	1431	888	913	888
   q8	2767	2766	2754	2754
   q9	9548	9407	9400	9400
   q10	3469	3497	3511	3497
   q11	378	247	231	231
   q12	436	299	292	292
   q13	4522	3845	3839	3839
   q14	319	292	285	285
   q15	581	537	526	526
   q16	679	585	572	572
   q17	1125	952	905	905
   q18	7856	7459	7410	7410
   q19	1663	1660	1670	1660
   q20	558	309	317	309
   q21	4391	3993	4029	3993
   q22	476	363	362	362
   Total cold run time: 53073 ms
   Total hot run time: 48933 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4564	4567	4543	4543
   q2	336	238	267	238
   q3	4010	4007	4005	4005
   q4	2704	2690	2693	2690
   q5	9729	9667	9686	9667
   q6	246	121	125	121
   q7	3019	2505	2508	2505
   q8	4406	4421	4414	4414
   q9	12933	12818	12840	12818
   q10	4015	4120	4143	4120
   q11	763	679	704	679
   q12	970	809	825	809
   q13	4278	3586	3566	3566
   q14	363	366	340	340
   q15	553	525	518	518
   q16	753	672	664	664
   q17	3850	3861	3844	3844
   q18	9672	9159	9300	9159
   q19	1799	1770	1770	1770
   q20	2375	2061	2058	2058
   q21	8744	8595	8743	8595
   q22	883	800	765	765
   Total cold run time: 80965 ms
   Total hot run time: 77888 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #27254:
URL: https://github.com/apache/doris/pull/27254


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1827568237

   
   <details>
   <summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
   
   ```
   Tpch sf100 test result on commit 0c69655475730209c4d605efbba13deb9e9430db, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4916	4661	4627	4627
   q2	359	157	158	157
   q3	2049	1955	1918	1918
   q4	1396	1285	1241	1241
   q5	4013	4014	4088	4014
   q6	259	139	134	134
   q7	1447	882	886	882
   q8	2799	2824	2793	2793
   q9	9981	9744	9736	9736
   q10	3457	3513	3513	3513
   q11	371	244	246	244
   q12	435	291	294	291
   q13	4637	3816	3811	3811
   q14	324	304	289	289
   q15	587	531	531	531
   q16	667	592	591	591
   q17	1174	1009	948	948
   q18	7957	7407	7545	7407
   q19	1704	1690	1683	1683
   q20	547	321	306	306
   q21	4471	4018	4051	4018
   q22	476	394	390	390
   Total cold run time: 54026 ms
   Total hot run time: 49524 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4588	4591	4598	4591
   q2	365	232	268	232
   q3	4044	4019	4032	4019
   q4	2732	2738	2729	2729
   q5	9649	9541	9609	9541
   q6	246	126	126	126
   q7	3044	2538	2501	2501
   q8	4401	4422	4427	4422
   q9	13271	13175	13194	13175
   q10	4069	4154	4197	4154
   q11	826	673	704	673
   q12	980	802	809	802
   q13	4343	3578	3606	3578
   q14	387	360	349	349
   q15	579	523	538	523
   q16	747	686	703	686
   q17	3879	3830	3919	3830
   q18	9752	9140	9171	9140
   q19	1853	1792	1779	1779
   q20	2404	2088	2076	2076
   q21	8894	8728	8780	8728
   q22	958	794	845	794
   Total cold run time: 82011 ms
   Total hot run time: 78448 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "wsjz (via GitHub)" <gi...@apache.org>.
wsjz commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1818125906

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1824453607

   
   <details>
   <summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
   
   ```
   Tpch sf100 test result on commit ba771c952522453dea582d6a7135ae3a00575c09, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4896	4693	4648	4648
   q2	387	150	143	143
   q3	2058	2002	1890	1890
   q4	1396	1244	1248	1244
   q5	3952	3942	4000	3942
   q6	246	129	133	129
   q7	1415	894	872	872
   q8	2785	2804	2784	2784
   q9	9572	9529	9450	9450
   q10	3467	3516	3528	3516
   q11	385	252	240	240
   q12	442	292	301	292
   q13	4581	3801	3828	3801
   q14	312	281	287	281
   q15	580	531	531	531
   q16	659	573	589	573
   q17	1163	998	960	960
   q18	7879	7311	7352	7311
   q19	1690	1675	1703	1675
   q20	549	300	296	296
   q21	4387	3948	4022	3948
   q22	465	372	372	372
   Total cold run time: 53266 ms
   Total hot run time: 48898 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4616	4564	4561	4561
   q2	332	230	248	230
   q3	4028	3994	4008	3994
   q4	2707	2698	2690	2690
   q5	9692	9582	9688	9582
   q6	246	123	123	123
   q7	3043	2503	2504	2503
   q8	4444	4458	4471	4458
   q9	13003	12883	12866	12866
   q10	4074	4189	4183	4183
   q11	840	638	660	638
   q12	984	834	813	813
   q13	4262	3589	3524	3524
   q14	399	351	343	343
   q15	574	509	521	509
   q16	746	679	679	679
   q17	3927	3950	3934	3934
   q18	9642	9037	9077	9037
   q19	1808	1796	1800	1796
   q20	2364	2065	2060	2060
   q21	8819	8620	8656	8620
   q22	944	747	827	747
   Total cold run time: 81494 ms
   Total hot run time: 77890 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](multi-catalog)add properties converter fe ut [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27254:
URL: https://github.com/apache/doris/pull/27254#issuecomment-1824458140

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.95 seconds
    stream load tsv:          585 seconds loaded 74807831229 Bytes, about 121 MB/s
    stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
    stream load orc:          65 seconds loaded 1101869774 Bytes, about 16 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.2 seconds inserted 10000000 Rows, about 354K ops/s
    storage size: 17099309294 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org