You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Otis Gospodnetic <ot...@yahoo.com> on 2005/03/12 06:12:39 UTC

Re: Reloading LARGE index causes OutOfMemory... intern Terms?

Kevin, have you tried interning Terms, and did that have the desired
effect?

Otis

--- "Kevin A. Burton" <bu...@newsmonster.org> wrote:
> We nighly optimizing one of our main indexes which takes up about 70%
> of 
> system memory when loaded due to Term objects being stored in memory.
> 
> We perform the optimization out of process then tell Tomcat to reload
> 
> its index.  This then causes us to open the index again which would
> need 
> 140% of system memory and so causes an  OutOfMemory exception.
> 
> Whats the best way to handle this?  Do I open the index again or is 
> there a better way to tell Lucene that I'm reloading an existing
> index 
> so it uses less memory?
> 
> Is it possible to intern the Term objects so that I only have one
> term 
> per virtual machine instead of one per index?
> 
> Kevin
> 
> -- 
> 
> Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an
> 
> invite!  Also see irc.freenode.net #rojo if you want to chat.
> 
> Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
> 
> If you're interested in RSS, Weblogs, Social Networking, etc... then
> you 
> should work for Rojo!  If you recommend someone and we hire them
> you'll 
> get a free iPod!
>     
> Kevin A. Burton, Location - San Francisco, CA
>        AIM/YIM - sfburtonator,  Web - http://peerfear.org/
> GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
> 
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org