Solr Warming Up Doubts

[Birender Rawat <bi...@gmail.com>]

henever i am running the full-import, my response time for some request
increases from 80ms to 3000ms.

This must be indicating my poor choice of warming up.

*1. FirstSearcher* I have added some 2 frequent used query but all my
autowarmCount are set to 0. I have also added facet for warming. So if my
autowarmCount=0, does this mean by queries are not getting cached.

*2. useColdSearcher = false* Despite reading many document, i am not able
to understand how it works after full import (assuming this is not my first
full-import)

*3. not defined maxWarmingSearchers in solrconfig.*

Am i doing anything wrong as why my autowarm is not working proprtly?

Note: I am using solr6.6.0

Re: Solr Warming Up Doubts

[Alessandro Benedetti <a....@sease.io>]

I see quite a bit of confusion here :

*1. FirstSearcher* I have added some 2 frequent used query but all my 
autowarmCount are set to 0. I have also added facet for warming. So if my 
autowarmCount=0, does this mean by queries are not getting cached. 

/First Searcher as the name suggests is the First searcher opened on the
Solr instance on startup.
NewSearcher refers to the new searcher opened every commit instead.
If your autowarm count for your caches are set to 0 it means that 0 entries
for the old caches will be used to warm up the new caches ( old caches get
invalidated on both soft or hard commit)./


*2. useColdSearcher = false* Despite reading many document, i am not able 
to understand how it works after full import (assuming this is not my first 
full-import) 

Normally when a commit happens, the searcher is first warmed up and then is
registered to serve queries.
If you want to use a Cold Searcher you can, setting this property.

*3. not defined maxWarmingSearchers in solrconfig.* 
This refers to the number of warming searcher in background, if you have
frequent commits you may have different searchers concurrently warming up.
This parameter limit this number ( normally to 2 searchers)

So, in short, you are definitely doing something wrong and your auto warming
is not going to work as you like :)

Cheers




-----
---------------
Alessandro Benedetti
Search Consultant, R&D Software Engineer, Director
Sease Ltd. - www.sease.io
--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr Warming Up Doubts

[Shawn Heisey <ap...@elyograg.org>]

First, I need to state my agreement with what Alessandro told you.  A 
lot of what I am saying below is the same as that reply.

On 3/7/2018 9:08 AM, Birender Rawat wrote:
> *1. FirstSearcher* I have added some 2 frequent used query but all my
> autowarmCount are set to 0. I have also added facet for warming. So if my
> autowarmCount=0, does this mean by queries are not getting cached.

The firstSearcher config is run precisely once -- when you first start 
Solr, before any imports happen.  Use newSearcher as well -- the queries 
in that config are run every time a new searcher opens.  Or, instead of 
newSearcher, use autowarmCount.You could even use both.

> *2. useColdSearcher = false* Despite reading many document, i am not able
> to understand how it works after full import (assuming this is not my first
> full-import)

It doesn't affect ANYTHING after full import.  This parameter ONLY 
affects the very first searcher opened -- the one that runs 
firstSearcher queries.  When it is true, the searcher is available for 
queries *before* the firstSearcher config is executed.  The system 
allows it to be used even though it is cold.  When it is false, the 
first searcher will not be available for queries until the firstSearcher 
config has finished running.

> *3. not defined maxWarmingSearchers in solrconfig.*

I wouldn't worry about this.  Increasing this value is almost never the 
right thing to do.  If you are running into a situation where you're 
exceeding the max warming searchers, chances are that you are doing 
commits with openSearcher=true too frequently and need to dial it back.

> Am i doing anything wrong as why my autowarm is not working proprtly?

With the configuration you have, you are NOT doing ANY warming that will 
help your imports.  You've set autowarmCount to 0 and you don't have 
newSearcher configured.

Thanks,
Shawn