You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by wojtekpia <wo...@hotmail.com> on 2009/02/11 02:26:36 UTC

Recent Paging Change?

Has there been a recent change (since Dec 2/08) in the paging algorithm? I'm
seeing much worse performance (75% drop in throughput) when I request 20
records starting at record 180 (page 10 in my application).

Thanks.

Wojtek
-- 
View this message in context: http://www.nabble.com/Recent-Paging-Change--tp21946610p21946610.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Recent Paging Change?

Posted by wojtekpia <wo...@hotmail.com>.
I'll run a profiler on new and old code and let you know what I find.

I have changed my schema between tests: I used to have termVectors turned on
for several fields, and now they are always off. My underlying data has not
changed.
-- 
View this message in context: http://www.nabble.com/Recent-Paging-Change--tp21946610p21958267.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Recent Paging Change?

Posted by Grant Ingersoll <gs...@apache.org>.
Has anything else changed index-wise?  For instance, do you have  
larger stored fields or are you retrieving more fields?

On Feb 10, 2009, at 8:26 PM, wojtekpia wrote:

>
> Has there been a recent change (since Dec 2/08) in the paging  
> algorithm? I'm
> seeing much worse performance (75% drop in throughput) when I  
> request 20
> records starting at record 180 (page 10 in my application).
>
> Thanks.
>
> Wojtek
> -- 
> View this message in context: http://www.nabble.com/Recent-Paging-Change--tp21946610p21946610.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids)  
using Solr/Lucene:
http://www.lucidimagination.com/search


Re: Recent Paging Change?

Posted by wojtekpia <wo...@hotmail.com>.
This was a false alarm, sorry. I misinterpreted some results.



wojtekpia wrote:
> 
> Has there been a recent change (since Dec 2/08) in the paging algorithm?
> I'm seeing much worse performance (75% drop in throughput) when I request
> 20 records starting at record 180 (page 10 in my application). 
> 
> Edit: the 75% drop is compared to my throughput for page 10 queries using
> Dec 2/08 code.
> 
> Thanks.
> 
> Wojtek
> 

-- 
View this message in context: http://www.nabble.com/Recent-Paging-Change--tp21946610p21969121.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Recent Paging Change?

Posted by Otis Gospodnetic <ot...@yahoo.com>.
Hi,

I don't recall any paging changes.  Perhaps you can run things with something like YouKit and see where queries were spending the most time in the old version and where they are spending time in the new version?


Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch




________________________________
From: wojtekpia <wo...@hotmail.com>
To: solr-user@lucene.apache.org
Sent: Tuesday, February 10, 2009 8:26:36 PM
Subject: Recent Paging Change?


Has there been a recent change (since Dec 2/08) in the paging algorithm? I'm
seeing much worse performance (75% drop in throughput) when I request 20
records starting at record 180 (page 10 in my application).

Thanks.

Wojtek
-- 
View this message in context: http://www.nabble.com/Recent-Paging-Change--tp21946610p21946610.html
Sent from the Solr - User mailing list archive at Nabble.com.