[PR] Store DocValuesSkippers in a separate file [lucene]

["romseygeek (via GitHub)" <gi...@apache.org>]

romseygeek opened a new pull request, #15976:
URL: https://github.com/apache/lucene/pull/15976

   Skippers are very useful for excluding large chunks of documents from range queries. However, the way they are currently stored interleaved with dv values makes it difficult to cleanly load only skip values, and interacts badly with page caches and memory mapping, especially as the skip data for an individual field tends to be fairly small and often doesn't fill an OS page.
   
   This updates the Lucene90DocValuesFormat to store skip data in a separate file, which can be mapped or preloaded separately from the DV data.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org

Re: [PR] Store DocValuesSkippers in a separate file [lucene]

["romseygeek (via GitHub)" <gi...@apache.org>]

romseygeek merged PR #15976:
URL: https://github.com/apache/lucene/pull/15976


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org