You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by GitBox <gi...@apache.org> on 2020/09/17 13:57:52 UTC
[GitHub] [lucene-solr] jpountz opened a new pull request #1888: Further tune Lucene87StoredFieldsFormat for small documents.
jpountz opened a new pull request #1888:
URL: https://github.com/apache/lucene-solr/pull/1888
The increase of the maximum number of chunks per doc done in previous
issues was mostly random. I'd like to provide users with a similar
trade-off with what the old versions of BEST_SPEED and BEST_COMPRESSION
used to do. So since BEST_SPEED used to compress at most 128 docs at
once, I think we should roughly make it 128*10 now. I made it 1024 to
account for the fact that there is a preset dict as well that need
decompressing. And similarly BEST_COMPRESSION used to allow 4x more docs
than BEST_SPEED, so I made it 4096.
With such larger numbers of docs per chunk, the decoding of metadata
became a bottleneck for stored field access so I made it a bit faster by
doing bulk decoding of the packed longs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
[GitHub] [lucene-solr] jpountz merged pull request #1888: Further tune Lucene87StoredFieldsFormat for small documents.
Posted by GitBox <gi...@apache.org>.
jpountz merged pull request #1888:
URL: https://github.com/apache/lucene-solr/pull/1888
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
[GitHub] [lucene-solr] rmuir commented on pull request #1888: Further tune Lucene87StoredFieldsFormat for small documents.
Posted by GitBox <gi...@apache.org>.
rmuir commented on pull request #1888:
URL: https://github.com/apache/lucene-solr/pull/1888#issuecomment-694337503
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org