You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2020/09/03 09:38:00 UTC
[jira] [Commented] (LUCENE-9483) Disable per-thread caching of
buffers for stored fields
[ https://issues.apache.org/jira/browse/LUCENE-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17190005#comment-17190005 ]
ASF subversion and git services commented on LUCENE-9483:
---------------------------------------------------------
Commit 0d37e4dc768fdb50ba030d69447c927687a7b70f in lucene-solr's branch refs/heads/master from Adrien Grand
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=0d37e4d ]
LUCENE-9483: Disable per-thread caching of buffers for decompression of stored fields. (#1787)
These buffers can use lots of memory when the number of segments,
threads or both is high.
> Disable per-thread caching of buffers for stored fields
> -------------------------------------------------------
>
> Key: LUCENE-9483
> URL: https://issues.apache.org/jira/browse/LUCENE-9483
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Adrien Grand
> Priority: Minor
> Fix For: 8.7
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Stored fields currently cache buffers that are used to decompress data. However with one buffer per thread per segment, these buffers can start using non-negligible amounts of data.
> I think we should keep them for merges, but either remove them completely for regular reads, or sharing them across all segments. As I'd like to avoid relying on global threadlocals, I'm leaning towards removing them.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org