[jira] [Commented] (LUCENE-9539) Improve memory footprint of SortingCodecReader

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LUCENE-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200066#comment-17200066 ] 

ASF subversion and git services commented on LUCENE-9539:
---------------------------------------------------------

Commit c82b99464dae6379380f214f250592a450bbe23b in lucene-solr's branch refs/heads/master from Simon Willnauer
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=c82b994 ]

LUCENE-9539: Use more compact datastructures for sorting doc-values (#1908)

This change cuts over from object based data-structures to primitive / compressed data-structures.

> Improve memory footprint of SortingCodecReader
> ----------------------------------------------
>
>                 Key: LUCENE-9539
>                 URL: https://issues.apache.org/jira/browse/LUCENE-9539
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Simon Willnauer
>            Priority: Major
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> SortingCodecReader is a very memory heavy since it needs to re-sort and load large parts of the index into memory. We can try to make it more efficient by using more compact internal data-structures, remove the caches it uses provided we define it's usage as a merge only reader wrapper. Ultimately we need to find a way to allow the reader or some other structure to minimize its heap memory. One way is to slice existing readers and merge them in multiple steps. There will be multiple steps towards a more useable version of this class.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org