You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Martin Kobele <ma...@netsweeper.com> on 2006/08/26 15:11:33 UTC
How to warm up
Hi,
I have read it several times that sometimes it is practical to warm up a
searcher. What exactly does that mean? Would I simply perform a search
for "foo bar" or something like that? What happens inside the searcher so
that it becomes 'warmed up'?
Thank you!
Regards,
Martin
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: How to warm up
Posted by Paul Borgermans <pa...@gmail.com>.
Hi
It are mainly the internal caches that are of interest. If you use
sorting other than the default relevance for example, use a warmin up
search that uses a custom sort. You may also look at what happens in
Solr (http://incubator.apache.org/solr/) related to caching.
I use Java Lucene from a PHP based frontend and found that just using
a Java object cache (like ehcache) can speed up searches a lot by
caching filters that implement security rules for instance. I guess
this also applies to pure Java implementations where Lucene does not
caches on its own.
hth
--paul
On 8/26/06, Martin Kobele <ma...@netsweeper.com> wrote:
> Hi,
>
> I have read it several times that sometimes it is practical to warm up a
> searcher. What exactly does that mean? Would I simply perform a search
> for "foo bar" or something like that? What happens inside the searcher so
> that it becomes 'warmed up'?
>
> Thank you!
>
> Regards,
> Martin
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
--
http://walhalla.wordpress.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: How to warm up
Posted by Chris Hostetter <ho...@fucit.org>.
: searcher. What exactly does that mean? Would I simply perform a search
: for "foo bar" or something like that? What happens inside the searcher so
: that it becomes 'warmed up'?
The key do warming up an index is do execute some *typical* queries. If
your users typically query the contents and author fields, and sort on
pubDate or score then do at least one query that looks at both of those
fields, and does a sort on pubDate (there's nothing to be warmed with
regards to sorting on score)
the benefits of warming are that any initial "costs" are "paid" in advance
... getting the index files into your OS's filesystem cache is one cost,
building up the FilterCache for sorting is another cost ... i also seem to
recall that SegmentReaders cache every N terms (and their offset in the
file) so it's faster to find a sepcific Term when needed, but i'm not sure
if that is done when the SegmentReader is opened or if it happens the
first time it's asked for a TermEnum.
-Hoss
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org