You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "vidit.asthana" <vi...@gmail.com> on 2014/07/01 10:53:46 UTC

Disable all caches in Solr

I want to run some query benchmarks, so I want to disable all type of caches
in solr. I commented out filterCache, queryResultCache and documentCache in
solrConfig.xml. I don't care about Result Window Size cause numdocs is 10 in
all the cases.

Are there any other hidden caches which I should know about before running
my tests?



--
View this message in context: http://lucene.472066.n3.nabble.com/Disable-all-caches-in-Solr-tp4144933.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Disable all caches in Solr

Posted by "vidit.asthana" <vi...@gmail.com>.
Thanks Chris. I understand this. But this test is to determine the *maximum*
latency a query can have and hence I have disabled all caches. 

After disabling all caches in solrconfig, I was able to remove "latency
variation" for a single query in most of the cases. But still *sort* queries
are showing variation in latency when executed multiple times. Is there some
hidden cache for sorting?

When I run query below for first time, it shows higher latency, but when I
run it second time it shows lower QTime.

http://localhost:7000/solr/collection1/select?q=field1:keyword&rows=20&sort=field2
desc

*If I remove the sorting then I always get fixed QTime*. "field2" is of type
tlong.

Any ideas why this is happening and how to prevent this variation?






--
View this message in context: http://lucene.472066.n3.nabble.com/Disable-all-caches-in-Solr-tp4144933p4146039.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Disable all caches in Solr

Posted by Chris Hostetter <ho...@fucit.org>.
: I want to run some query benchmarks, so I want to disable all type of caches

Just to be clear: disabling all internal caching because you want to run a 
benchmark means you're probably going to wind up running a useless 
benchmark.

Solr's internal caching is a key component of it's perormance in real 
world situations.

Even if you are confident *every* query you get will always be unique, the 
caches can be helpful even in the span of a single request depending on 
the combination of features you use.



-Hoss
http://www.lucidworks.com/

Re: Disable all caches in Solr

Posted by "vidit.asthana" <vi...@gmail.com>.
Yes, I have also commented "newSearcher" and "firstSearcher" queries in
solrConfig.xml



--
View this message in context: http://lucene.472066.n3.nabble.com/Disable-all-caches-in-Solr-tp4144933p4144935.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Disable all caches in Solr

Posted by Alexandre Rafalovitch <ar...@gmail.com>.
Have you also disabled the queries used to initialize searchers after commit?
Personal website: http://www.outerthoughts.com/
Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency


On Tue, Jul 1, 2014 at 3:53 PM, vidit.asthana <vi...@gmail.com> wrote:
> I want to run some query benchmarks, so I want to disable all type of caches
> in solr. I commented out filterCache, queryResultCache and documentCache in
> solrConfig.xml. I don't care about Result Window Size cause numdocs is 10 in
> all the cases.
>
> Are there any other hidden caches which I should know about before running
> my tests?
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Disable-all-caches-in-Solr-tp4144933.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Re: Disable all caches in Solr

Posted by Toke Eskildsen <te...@statsbiblioteket.dk>.
On Tue, 2014-07-01 at 10:53 +0200, vidit.asthana wrote:
> Are there any other hidden caches which I should know about before running
> my tests?

Clear the disk cache?

- Toke Eskildsen, State and University Library, Denmark