You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Clemens Wyss <cl...@mysign.ch> on 2012/04/16 10:46:12 UTC
IndexWriteConfig ignored?
We limit the memory consumption of our IndexWriters by setting RAMBufferSizeMB to 5MB (IndexWriterConfig.setRAMBufferSizeMB).
Inspecting a heapdump unveils that I still have writers wich consume/retain more than 35MB!
How come?
Any help/advice appreciated
Clemens
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
AW: IndexWriteConfig ignored?
Posted by Clemens Wyss <cl...@mysign.ch>.
No nrt-reader opened.
My heapdump says that the freeCharBlocks-member of DocumentsWriter is holding >20MB. I must say that I keep the IndexWriter open "forever", which (memorywise) does not seem to be "optimal".
-----Ursprüngliche Nachricht-----
Von: Michael McCandless [mailto:lucene@mikemccandless.com]
Gesendet: Montag, 16. April 2012 14:56
An: java-user@lucene.apache.org
Betreff: Re: IndexWriteConfig ignored?
RAM can be used in IndexWriter for other reasons: merge is running, near-real-time reader was opened.
The RAMBufferSizeMB only applies to buffered postings (indexed documents)
If you turn on IndexWriter's infoStream, do you see output saying it's flushing a new segment because RAM is > 5.0 MB?
Mike McCandless
http://blog.mikemccandless.com
On Mon, Apr 16, 2012 at 4:46 AM, Clemens Wyss <cl...@mysign.ch> wrote:
> We limit the memory consumption of our IndexWriters by setting RAMBufferSizeMB to 5MB (IndexWriterConfig.setRAMBufferSizeMB).
> Inspecting a heapdump unveils that I still have writers wich consume/retain more than 35MB!
> How come?
> Any help/advice appreciated
> Clemens
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: IndexWriteConfig ignored?
Posted by Michael McCandless <lu...@mikemccandless.com>.
RAM can be used in IndexWriter for other reasons: merge is running,
near-real-time reader was opened.
The RAMBufferSizeMB only applies to buffered postings (indexed documents)
If you turn on IndexWriter's infoStream, do you see output saying it's
flushing a new segment because RAM is > 5.0 MB?
Mike McCandless
http://blog.mikemccandless.com
On Mon, Apr 16, 2012 at 4:46 AM, Clemens Wyss <cl...@mysign.ch> wrote:
> We limit the memory consumption of our IndexWriters by setting RAMBufferSizeMB to 5MB (IndexWriterConfig.setRAMBufferSizeMB).
> Inspecting a heapdump unveils that I still have writers wich consume/retain more than 35MB!
> How come?
> Any help/advice appreciated
> Clemens
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org