You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@lucene.apache.org by "Robert Muir (Jira)" <ji...@apache.org> on 2021/02/28 16:27:00 UTC

[jira] [Created] (LUCENE-9816) lazy-init LZ4-HC hashtable in blocktreewriter

Robert Muir created LUCENE-9816:
-----------------------------------

             Summary: lazy-init LZ4-HC hashtable in blocktreewriter
                 Key: LUCENE-9816
                 URL: https://issues.apache.org/jira/browse/LUCENE-9816
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Robert Muir


Based upon the data for a field, blocktree may compress with LZ4-HC (or with simple lowercase compression or none at all).

But we currently eagerly initialize HC hashtable (132k) for each field regardless of whether it will be even "tried". This shows up as top cpu and heap hotspot when profiling tests. It creates unnecessary overhead for small flushes.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org