You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by John Stric <js...@gmail.com> on 2015/11/10 18:39:47 UTC
Search query speed
The speed of particular query has gone from about 42 msec to 66 msec
without any changes.
How do I go about troubleshooting what may have happened? And how do I
improve that speed?
Thanks
Re: Search query speed
Posted by Emir Arnautovic <em...@sematext.com>.
What are HW specs. 4 threads is not much but still makes test less
deterministic, especially in case when queries are not equally "heavy".
Can you also collect QTime from Solr response and see if differences are
caused by networking.
Emir
On 11.11.2015 20:44, John Stric wrote:
> There is a .NET app that is calling solr. I am measuring time span using
> .NET provided methods. It used to take about 42 msec and it started taking
> 66 msec from the time to compose the call and query solr, get results and
> parse them back. Interestingly today it was close to 44 msec.
> I am testing using 4 threads and 1000 iterations i.e. each thread makes 250
> requests. I then do the average.
>
> The query is being done using dismax parser with mm, qf, qs and bf. There
> are 5 query fields. The query includes filter on 3 fields and facet on two
> fields
>
> No changes were done: no new docs, no updated or deleted docs. I did try to
> restart machine and test multiple time/multiple ways and still the average
> was about 66 msec.
>
>
>
> On Wed, Nov 11, 2015 at 12:18 PM, Chris Hostetter <ho...@fucit.org>
> wrote:
>
>> : The speed of particular query has gone from about 42 msec to 66 msec
>> : without any changes.
>>
>> 1) Define "speed" ?
>>
>> how are you measuring?
>> where are you measuring?
>> are you measuring averages? over what sample size?
>>
>> 2) define "particular query" ?
>>
>> what types of queries?
>> what types of params are in the request?
>> what do the results look like?
>>
>> 3) Define "any changes" ?
>>
>> new docs?
>> deleted docs?
>> updated docs?
>> restarted server?
>> restarted solr?
>> increased query load?
>>
>>
>>
>> -Hoss
>> http://www.lucidworks.com/
>>
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
Re: Search query speed
Posted by John Stric <js...@gmail.com>.
There is a .NET app that is calling solr. I am measuring time span using
.NET provided methods. It used to take about 42 msec and it started taking
66 msec from the time to compose the call and query solr, get results and
parse them back. Interestingly today it was close to 44 msec.
I am testing using 4 threads and 1000 iterations i.e. each thread makes 250
requests. I then do the average.
The query is being done using dismax parser with mm, qf, qs and bf. There
are 5 query fields. The query includes filter on 3 fields and facet on two
fields
No changes were done: no new docs, no updated or deleted docs. I did try to
restart machine and test multiple time/multiple ways and still the average
was about 66 msec.
On Wed, Nov 11, 2015 at 12:18 PM, Chris Hostetter <ho...@fucit.org>
wrote:
>
> : The speed of particular query has gone from about 42 msec to 66 msec
> : without any changes.
>
> 1) Define "speed" ?
>
> how are you measuring?
> where are you measuring?
> are you measuring averages? over what sample size?
>
> 2) define "particular query" ?
>
> what types of queries?
> what types of params are in the request?
> what do the results look like?
>
> 3) Define "any changes" ?
>
> new docs?
> deleted docs?
> updated docs?
> restarted server?
> restarted solr?
> increased query load?
>
>
>
> -Hoss
> http://www.lucidworks.com/
>
Re: Search query speed
Posted by Chris Hostetter <ho...@fucit.org>.
: The speed of particular query has gone from about 42 msec to 66 msec
: without any changes.
1) Define "speed" ?
how are you measuring?
where are you measuring?
are you measuring averages? over what sample size?
2) define "particular query" ?
what types of queries?
what types of params are in the request?
what do the results look like?
3) Define "any changes" ?
new docs?
deleted docs?
updated docs?
restarted server?
restarted solr?
increased query load?
-Hoss
http://www.lucidworks.com/
Re: Search query speed
Posted by Gopal Patwa <go...@gmail.com>.
You could start adding debug=true in your request, it will show complete
query execution time
On Tue, Nov 10, 2015 at 9:39 AM John Stric <js...@gmail.com> wrote:
> The speed of particular query has gone from about 42 msec to 66 msec
> without any changes.
>
> How do I go about troubleshooting what may have happened? And how do I
> improve that speed?
>
> Thanks
>
Re: Search query speed
Posted by Toke Eskildsen <te...@statsbiblioteket.dk>.
John Stric <js...@gmail.com> wrote:
> The speed of particular query has gone from about 42 msec to 66 msec
> without any changes.
- Your JVM has allocated a bit more RAM, leaving less for disk cache.
- Your index has grown.
- The amount of concurrent requests has increased, pushing objects from Eden space to main heap, causing heavier garbage collection.
- A backup job is running.
- Another program has started, eating free mem from disk cache.
- Swap activity has increased.
The list goes on. Java performance is a fickle beast and Solr performance doubly so.
> How do I go about troubleshooting what may have happened?
Try to restore to a previous state and see if that changes response time: Shut down all running programs on the machine, start Solr again, warm it and test?
- Toke Eskildsen