Re: [jira] LUCENE-831 and FieldCache warming

[bo_b <bo...@staff.jubii.dk>]

Chris Hostetter wrote:
> 
> 
> i just wanted to draw peoples attention to a Lucene-Java patch i've been
> experimenting with to change the way the internal FieldCaches work...
> 
> http://issues.apache.org/jira/browse/LUCENE-831
> 
> ...this might be of special itnerest to Solr developers because it would
> let us change the low levels of the FieldCache (used by sorting and
> faceting) so that it could be backed by a SolrCache and autoWarmed when
> new IndexReaders are opened.  (this isn't in the patch)
> 
> 

Sounds interesting. I am not sure I quite understand what this patch does,
but if it helps improve the first sort after a commit that would rock :)

We have a number of services where we would like to support sorting search
results so we can show newest articles/posts first, but currently cannot,
because of relatively high volume of inserts/commits(15000 new posts pr day
on our forum).
-- 
View this message in context: http://www.nabble.com/LUCENE-831-and-FieldCache-warming-tf3416220.html#a9568054
Sent from the Solr - Dev mailing list archive at Nabble.com.

Re: [jira] LUCENE-831 and FieldCache warming

[Chris Hostetter <ho...@fucit.org>]

: Sounds interesting. I am not sure I quite understand what this patch does,
: but if it helps improve the first sort after a commit that would rock :)

the main issue is that Solr currently has no visibility into much of hte
caching done by the underlying Lucene implementation, so it can't
"autowarm" anything ... you as a Solr instance owner can explicitly warm
fields you know you sort on, or fields you know you facet on -- but that
requires keeping that config upto date ... adding an API like this to
Lucene would help make it possible for Solr to do this automaticaly based
on simpler config (ie; declaring an autowarmCount on the new fieldCache)

: results so we can show newest articles/posts first, but currently cannot,
: because of relatively high volume of inserts/commits(15000 new posts pr day
: on our forum).

as i said, if you just want to support sorting on a few fields, you can
configure explicit warming queries that do that sorting (and populate
those caches) in your solrconfig.xml



-Hoss