You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "seawinde (via GitHub)" <gi...@apache.org> on 2023/12/25 08:40:38 UTC

[PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

seawinde opened a new pull request, #28973:
URL: https://github.com/apache/doris/pull/28973

   
   
   ## Proposed changes
   
   Get partition related table disable nullable field 
   Complete agg matched pattern mv rules
   Modify the regression test to make sure the result is not null, which we can check the data correctness
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #28973:
URL: https://github.com/apache/doris/pull/28973


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868946412

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement](nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868976168

   run pull_request


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868859353

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868952294

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.71 seconds
    stream load tsv:          577 seconds loaded 74807831229 Bytes, about 123 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          33 seconds loaded 861443392 Bytes, about 24 MB/s
    insert into select:          38.7 seconds inserted 10000000 Rows, about 258K ops/s
    storage size: 17183544475 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868877390

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.64 seconds
    stream load tsv:          566 seconds loaded 74807831229 Bytes, about 126 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          39.2 seconds inserted 10000000 Rows, about 255K ops/s
    storage size: 17183741852 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868947305

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 022ab838670a5bfa58764168978c24ae86e20f42, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4687	4378	4447	4378
   q2	368	146	159	146
   q3	1454	1290	1240	1240
   q4	1101	884	874	874
   q5	3139	3151	3174	3151
   q6	253	131	129	129
   q7	1009	492	485	485
   q8	2185	2241	2191	2191
   q9	6688	6696	6671	6671
   q10	3247	3287	3271	3271
   q11	311	178	197	178
   q12	354	209	209	209
   q13	4559	3830	3835	3830
   q14	243	219	217	217
   q15	569	521	523	521
   q16	443	386	374	374
   q17	1023	582	464	464
   q18	7061	6730	6848	6730
   q19	1562	1428	1470	1428
   q20	507	298	310	298
   q21	3090	2633	2667	2633
   q22	351	281	276	276
   Total cold run time: 44204 ms
   Total hot run time: 39694 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4339	4342	4353	4342
   q2	267	168	175	168
   q3	3502	3499	3490	3490
   q4	2400	2374	2373	2373
   q5	5692	5702	5704	5702
   q6	242	121	121	121
   q7	2357	1833	1844	1833
   q8	3528	3537	3547	3537
   q9	8984	8996	9015	8996
   q10	3915	3976	4029	3976
   q11	483	361	376	361
   q12	766	583	588	583
   q13	4285	3536	3548	3536
   q14	286	252	259	252
   q15	578	531	525	525
   q16	497	442	451	442
   q17	1894	1861	1835	1835
   q18	8465	8186	8016	8016
   q19	1762	1745	1764	1745
   q20	2251	1945	1943	1943
   q21	6508	6147	6130	6130
   q22	500	470	423	423
   Total cold run time: 63501 ms
   Total hot run time: 60329 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868949043

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868881033

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit 607463486dd537af969e7d5aaf0f41ee7c45385e, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4739	4437	4434	4434
   q2	369	147	159	147
   q3	1457	1296	1219	1219
   q4	1111	908	892	892
   q5	3152	3169	3192	3169
   q6	251	130	130	130
   q7	1009	492	504	492
   q8	2179	2238	2197	2197
   q9	6695	6708	6679	6679
   q10	3215	3295	3271	3271
   q11	316	193	189	189
   q12	359	212	215	212
   q13	4573	3821	3815	3815
   q14	242	211	211	211
   q15	576	526	520	520
   q16	446	381	387	381
   q17	1030	663	564	564
   q18	7111	6746	6934	6746
   q19	1511	1437	1419	1419
   q20	548	328	305	305
   q21	3072	2651	2687	2651
   q22	351	286	290	286
   Total cold run time: 44312 ms
   Total hot run time: 39929 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4385	4355	4375	4355
   q2	270	169	174	169
   q3	3528	3512	3493	3493
   q4	2417	2381	2398	2381
   q5	5723	5757	5729	5729
   q6	242	123	125	123
   q7	2376	1834	1889	1834
   q8	3539	3549	3516	3516
   q9	9061	9059	8975	8975
   q10	3948	4024	3995	3995
   q11	492	361	384	361
   q12	774	609	614	609
   q13	4279	3575	3560	3560
   q14	280	261	256	256
   q15	579	516	518	516
   q16	508	494	458	458
   q17	1871	1892	1877	1877
   q18	8525	8168	8176	8168
   q19	1721	1757	1772	1757
   q20	2257	1946	1958	1946
   q21	6511	6144	6181	6144
   q22	494	428	426	426
   Total cold run time: 63780 ms
   Total hot run time: 60648 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]

Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868934771

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org