You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Otis Gospodnetic <ot...@yahoo.com> on 2005/03/12 06:12:39 UTC
Re: Reloading LARGE index causes OutOfMemory... intern Terms?
Kevin, have you tried interning Terms, and did that have the desired
effect?
Otis
--- "Kevin A. Burton" <bu...@newsmonster.org> wrote:
> We nighly optimizing one of our main indexes which takes up about 70%
> of
> system memory when loaded due to Term objects being stored in memory.
>
> We perform the optimization out of process then tell Tomcat to reload
>
> its index. This then causes us to open the index again which would
> need
> 140% of system memory and so causes an OutOfMemory exception.
>
> Whats the best way to handle this? Do I open the index again or is
> there a better way to tell Lucene that I'm reloading an existing
> index
> so it uses less memory?
>
> Is it possible to intern the Term objects so that I only have one
> term
> per virtual machine instead of one per index?
>
> Kevin
>
> --
>
> Use Rojo (RSS/Atom aggregator). Visit http://rojo.com. Ask me for an
>
> invite! Also see irc.freenode.net #rojo if you want to chat.
>
> Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
>
> If you're interested in RSS, Weblogs, Social Networking, etc... then
> you
> should work for Rojo! If you recommend someone and we hire them
> you'll
> get a free iPod!
>
> Kevin A. Burton, Location - San Francisco, CA
> AIM/YIM - sfburtonator, Web - http://peerfear.org/
> GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org