You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@lucene.apache.org by "Simon Willnauer (Jira)" <ji...@apache.org> on 2020/09/22 08:50:00 UTC

[jira] [Created] (LUCENE-9539) Improve memory footprint of SortingCodecReader

Simon Willnauer created LUCENE-9539:
---------------------------------------

             Summary: Improve memory footprint of SortingCodecReader
                 Key: LUCENE-9539
                 URL: https://issues.apache.org/jira/browse/LUCENE-9539
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Simon Willnauer


SortingCodecReader is a very memory heavy since it needs to re-sort and load large parts of the index into memory. We can try to make it more efficient by using more compact internal data-structures, remove the caches it uses provided we define it's usage as a merge only reader wrapper. Ultimately we need to find a way to allow the reader or some other structure to minimize its heap memory. One way is to slice existing readers and merge them in multiple steps. There will be multiple steps towards a more useable version of this class.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org