You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "seawinde (via GitHub)" <gi...@apache.org> on 2023/12/25 08:40:38 UTC
[PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
seawinde opened a new pull request, #28973:
URL: https://github.com/apache/doris/pull/28973
## Proposed changes
Get partition related table disable nullable field
Complete agg matched pattern mv rules
Modify the regression test to make sure the result is not null, which we can check the data correctness
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #28973:
URL: https://github.com/apache/doris/pull/28973
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868946412
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868976168
run pull_request
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868859353
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868952294
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.71 seconds
stream load tsv: 577 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 38.7 seconds inserted 10000000 Rows, about 258K ops/s
storage size: 17183544475 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868877390
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.64 seconds
stream load tsv: 566 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 39.2 seconds inserted 10000000 Rows, about 255K ops/s
storage size: 17183741852 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868947305
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 022ab838670a5bfa58764168978c24ae86e20f42, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4687 4378 4447 4378
q2 368 146 159 146
q3 1454 1290 1240 1240
q4 1101 884 874 874
q5 3139 3151 3174 3151
q6 253 131 129 129
q7 1009 492 485 485
q8 2185 2241 2191 2191
q9 6688 6696 6671 6671
q10 3247 3287 3271 3271
q11 311 178 197 178
q12 354 209 209 209
q13 4559 3830 3835 3830
q14 243 219 217 217
q15 569 521 523 521
q16 443 386 374 374
q17 1023 582 464 464
q18 7061 6730 6848 6730
q19 1562 1428 1470 1428
q20 507 298 310 298
q21 3090 2633 2667 2633
q22 351 281 276 276
Total cold run time: 44204 ms
Total hot run time: 39694 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4339 4342 4353 4342
q2 267 168 175 168
q3 3502 3499 3490 3490
q4 2400 2374 2373 2373
q5 5692 5702 5704 5702
q6 242 121 121 121
q7 2357 1833 1844 1833
q8 3528 3537 3547 3537
q9 8984 8996 9015 8996
q10 3915 3976 4029 3976
q11 483 361 376 361
q12 766 583 588 583
q13 4285 3536 3548 3536
q14 286 252 259 252
q15 578 531 525 525
q16 497 442 451 442
q17 1894 1861 1835 1835
q18 8465 8186 8016 8016
q19 1762 1745 1764 1745
q20 2251 1945 1943 1943
q21 6508 6147 6130 6130
q22 500 470 423 423
Total cold run time: 63501 ms
Total hot run time: 60329 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868949043
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868881033
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 607463486dd537af969e7d5aaf0f41ee7c45385e, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4739 4437 4434 4434
q2 369 147 159 147
q3 1457 1296 1219 1219
q4 1111 908 892 892
q5 3152 3169 3192 3169
q6 251 130 130 130
q7 1009 492 504 492
q8 2179 2238 2197 2197
q9 6695 6708 6679 6679
q10 3215 3295 3271 3271
q11 316 193 189 189
q12 359 212 215 212
q13 4573 3821 3815 3815
q14 242 211 211 211
q15 576 526 520 520
q16 446 381 387 381
q17 1030 663 564 564
q18 7111 6746 6934 6746
q19 1511 1437 1419 1419
q20 548 328 305 305
q21 3072 2651 2687 2651
q22 351 286 290 286
Total cold run time: 44312 ms
Total hot run time: 39929 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4385 4355 4375 4355
q2 270 169 174 169
q3 3528 3512 3493 3493
q4 2417 2381 2398 2381
q5 5723 5757 5729 5729
q6 242 123 125 123
q7 2376 1834 1889 1834
q8 3539 3549 3516 3516
q9 9061 9059 8975 8975
q10 3948 4024 3995 3995
q11 492 361 384 361
q12 774 609 614 609
q13 4279 3575 3560 3560
q14 280 261 256 256
q15 579 516 518 516
q16 508 494 458 458
q17 1871 1892 1877 1877
q18 8525 8168 8176 8168
q19 1721 1757 1772 1757
q20 2257 1946 1958 1946
q21 6511 6144 6181 6144
q22 494 428 426 426
Total cold run time: 63780 ms
Total hot run time: 60648 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement] (nereids) Get partition related table disable nullable field and complete agg matched pattern mv rules. [doris]
Posted by "seawinde (via GitHub)" <gi...@apache.org>.
seawinde commented on PR #28973:
URL: https://github.com/apache/doris/pull/28973#issuecomment-1868934771
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org