You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2023/11/20 09:08:06 UTC
[PR] [opt](Nereids)assertOneRowNode cis effective [doris]
englefly opened a new pull request, #27279:
URL: https://github.com/apache/doris/pull/27279
## Proposed changes
1. optimize rf prune when col stats are not avaliable
2. add regression case to check plan and rf for tpcds_sf100 with stats
3. add regression case to check plan and rf for tpcds_sf100 without stats
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids) AssertNumRows node should triger runtime filter pruning [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly merged PR #27279:
URL: https://github.com/apache/doris/pull/27279
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids) AssertNumRows node should triger runtime filter pruning [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27279:
URL: https://github.com/apache/doris/pull/27279#issuecomment-1820036607
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)assertOneRowNode cis effective [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #27279:
URL: https://github.com/apache/doris/pull/27279#issuecomment-1818505062
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids) AssertNumRows node should triger runtime filter pruning [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27279:
URL: https://github.com/apache/doris/pull/27279#issuecomment-1820036641
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids) AssertNumRows node should triger runtime filter pruning [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27279:
URL: https://github.com/apache/doris/pull/27279#issuecomment-1818649092
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit cbc88cd9f861abe81d94406ec0afa9890fc4c4d7, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4918 4641 4649 4641
q2 383 171 157 157
q3 2049 1984 1908 1908
q4 1396 1289 1253 1253
q5 3982 3974 4003 3974
q6 247 125 125 125
q7 1403 892 900 892
q8 2767 2781 2786 2781
q9 9941 9641 9649 9641
q10 3479 3538 3514 3514
q11 368 251 237 237
q12 434 291 293 291
q13 4580 3856 3831 3831
q14 311 287 279 279
q15 589 538 523 523
q16 670 588 581 581
q17 1143 984 931 931
q18 7899 7427 7325 7325
q19 1666 1678 1670 1670
q20 526 303 289 289
q21 4361 3969 3950 3950
q22 460 378 369 369
Total cold run time: 53572 ms
Total hot run time: 49162 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4566 4552 4543 4543
q2 337 224 263 224
q3 4014 4000 3987 3987
q4 2686 2687 2684 2684
q5 9734 9618 9649 9618
q6 245 120 120 120
q7 2991 2483 2476 2476
q8 4488 4524 4532 4524
q9 13189 13075 13185 13075
q10 4125 4168 4211 4168
q11 804 663 670 663
q12 983 820 802 802
q13 4256 3556 3543 3543
q14 392 357 343 343
q15 566 513 516 513
q16 744 669 663 663
q17 3917 3877 3928 3877
q18 9618 9094 8888 8888
q19 1795 1777 1767 1767
q20 2394 2039 2052 2039
q21 8746 8754 8707 8707
q22 879 799 795 795
Total cold run time: 81469 ms
Total hot run time: 78019 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids) AssertNumRows node should triger runtime filter pruning [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27279:
URL: https://github.com/apache/doris/pull/27279#issuecomment-1818661893
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.96 seconds
stream load tsv: 567 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17100039908 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org