You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "qidaye (via GitHub)" <gi...@apache.org> on 2023/12/19 11:20:02 UTC
[PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
qidaye opened a new pull request, #28661:
URL: https://github.com/apache/doris/pull/28661
…tring indexing
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1863734827
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862678171
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.25 seconds
stream load tsv: 569 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17183664891 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye merged PR #28661:
URL: https://github.com/apache/doris/pull/28661
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862582039
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1863811753
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862585620
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1863752369
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1863729785
run pipelinex
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862846441
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit aec29123990bd088b9c81e460473e5cb4e149e6a, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4753 4462 4464 4462
q2 371 172 148 148
q3 1465 1255 1217 1217
q4 1114 920 930 920
q5 3143 3155 3134 3134
q6 250 129 127 127
q7 981 475 475 475
q8 2215 2204 2175 2175
q9 6700 6688 6692 6688
q10 3210 3294 3264 3264
q11 314 194 188 188
q12 350 210 211 210
q13 4580 3845 3805 3805
q14 241 208 211 208
q15 559 518 520 518
q16 435 383 385 383
q17 990 581 545 545
q18 7138 6839 6892 6839
q19 1503 1385 1419 1385
q20 545 322 284 284
q21 3107 2609 2709 2609
q22 342 274 287 274
Total cold run time: 44306 ms
Total hot run time: 39858 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4400 4418 4415 4415
q2 272 165 181 165
q3 3523 3513 3515 3513
q4 2375 2368 2355 2355
q5 5772 5752 5753 5752
q6 240 123 124 123
q7 2362 1883 1895 1883
q8 3510 3527 3524 3524
q9 9019 9000 8991 8991
q10 3936 3988 4009 3988
q11 477 369 380 369
q12 764 601 616 601
q13 4290 3578 3539 3539
q14 295 267 252 252
q15 573 523 531 523
q16 510 471 454 454
q17 1881 1936 1849 1849
q18 8623 8321 8164 8164
q19 1770 1740 1732 1732
q20 2261 1947 1937 1937
q21 6512 6174 6166 6166
q22 482 432 430 430
Total cold run time: 63847 ms
Total hot run time: 60725 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1863774657
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862587386
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "qidaye (via GitHub)" <gi...@apache.org>.
qidaye commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862682454
run pipelinex
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](inverted index) Add null document interface to optimize empty s… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28661:
URL: https://github.com/apache/doris/pull/28661#issuecomment-1862708375
TeamCity be ut coverage result:
Function Coverage: 36.48% (8532/23389)
Line Coverage: 28.61% (69345/242349)
Region Coverage: 27.63% (35882/129874)
Branch Coverage: 24.36% (18335/75254)
Coverage Report: http://coverage.selectdb-in.cc/coverage/aec29123990bd088b9c81e460473e5cb4e149e6a_aec29123990bd088b9c81e460473e5cb4e149e6a/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org