You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/02/22 20:44:00 UTC
[jira] [Commented] (SOLR-12753) Async logging ring buffer and OOM
error
[ https://issues.apache.org/jira/browse/SOLR-12753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775580#comment-16775580 ]
ASF subversion and git services commented on SOLR-12753:
--------------------------------------------------------
Commit 0de3905ce71c53b91b28972fb327d35c6a604e6b in lucene-solr's branch refs/heads/master from Erick Erickson
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=0de3905 ]
SOLR-12055: Enable async logging by default SOLR-12753: Async logging ring buffer and OOM error
> Async logging ring buffer and OOM error
> ---------------------------------------
>
> Key: SOLR-12753
> URL: https://issues.apache.org/jira/browse/SOLR-12753
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Components: logging
> Affects Versions: 7.5
> Reporter: Andrzej Bialecki
> Assignee: Erick Erickson
> Priority: Major
> Attachments: SOLR-12753.patch
>
>
> I’m using a simulated environment for autoscaling tests, which may create some pretty degenerate cases (like collections with 50,000 replicas and Policy calculations over these, times 500 nodes).
> I noticed that when I turned on debug logging I occasionally would get an OOM error, and the heap dump showed that the biggest objects were a bunch of extremely large strings in the async logger’s ring buffer. These strings were admittedly extremely large (million chars or so) but the previously used sync logging didn’t have any issue with them, because they were consumed one by one.
> For sure, Solr should not attempt to be logging multi-megabyte data. But I also feel like the framework could perhaps help here by enforcing large but sane limits on maximum size of log messages.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org