You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Rajat Garg <ra...@yahoo.com> on 2010/02/03 07:54:34 UTC

Solr response extremely slow

I have solr running with 275K docs on 4GB ram vps server

Logs look like this from info and log file ->

03-Feb-2010 06:43:08 org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select
params={facet.limit=-1&wt=ruby&rows=300&start=1&sort=supplier_count+desc&facet=true&facet.mincount=1&q=country_seo:united-states+AND+state_seo:florida+AND+city_seo:tampa+AND+room_service:Y&fl=*,score&qt=standard&facet.field=rating_facet&facet.field=city_facet&facet.field=country_facet&facet.field=state_facet&facet.field=supplier_name_facet&facet.field=property_type_facet&facet.field=airport_shuttle_facet&facet.field=business_center_facet&facet.field=concierge_facet&facet.field=fitness_center_facet&facet.field=highspeed_internet_facet&facet.field=pets_accepted_facet&facet.field=car_parking_facet&facet.field=restaurant_facet&facet.field=room_service_facet&facet.field=swimming_pool_facet&facet.sort=true}
hits=121 status=0 QTime=1124

03-Feb-2010 06:43:28 org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select
params={facet.limit=-1&wt=ruby&rows=300&start=1&sort=supplier_count+desc&facet=true&facet.mincount=1&q=country_seo:united-states+AND+state_seo:massachusetts+AND+city_seo:boston&fl=*,score&qt=standard&facet.field=rating_facet&facet.field=city_facet&facet.field=country_facet&facet.field=state_facet&facet.field=supplier_name_facet&facet.field=property_type_facet&facet.field=airport_shuttle_facet&facet.field=business_center_facet&facet.field=concierge_facet&facet.field=fitness_center_facet&facet.field=highspeed_internet_facet&facet.field=pets_accepted_facet&facet.field=car_parking_facet&facet.field=restaurant_facet&facet.field=room_service_facet&facet.field=swimming_pool_facet&facet.sort=true}
hits=131 status=0 QTime=1215


127.0.0.1 -  -  [03/02/2010:06:43:07 +0000] "POST /solr/select HTTP/1.1" 200
90571
127.0.0.1 -  -  [03/02/2010:06:43:26 +0000] "POST /solr/select HTTP/1.1" 200
101974


For same queries, QTime is 1124 but log / handler shows 90571 seconds.
Similar thing happens across all queries...

Any pointers on why this may be happening?

RG
-- 
View this message in context: http://old.nabble.com/Solr-response-extremely-slow-tp27432229p27432229.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr response extremely slow

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
On Wed, Feb 3, 2010 at 12:24 PM, Rajat Garg <ra...@yahoo.com> wrote:

>
> I have solr running with 275K docs on 4GB ram vps server
>
> Logs look like this from info and log file ->
>
> 03-Feb-2010 06:43:08 org.apache.solr.core.SolrCore execute
> INFO: [] webapp=/solr path=/select
>
> params={facet.limit=-1&wt=ruby&rows=300&start=1&sort=supplier_count+desc&facet=true&facet.mincount=1&q=country_seo:united-states+AND+state_seo:florida+AND+city_seo:tampa+AND+room_service:Y&fl=*,score&qt=standard&facet.field=rating_facet&facet.field=city_facet&facet.field=country_facet&facet.field=state_facet&facet.field=supplier_name_facet&facet.field=property_type_facet&facet.field=airport_shuttle_facet&facet.field=business_center_facet&facet.field=concierge_facet&facet.field=fitness_center_facet&facet.field=highspeed_internet_facet&facet.field=pets_accepted_facet&facet.field=car_parking_facet&facet.field=restaurant_facet&facet.field=room_service_facet&facet.field=swimming_pool_facet&facet.sort=true}
> hits=121 status=0 QTime=1124
>
>
<snip/>


> 127.0.0.1 -  -  [03/02/2010:06:43:07 +0000] "POST /solr/select HTTP/1.1"
> 200
> 90571
> 127.0.0.1 -  -  [03/02/2010:06:43:26 +0000] "POST /solr/select HTTP/1.1"
> 200
> 101974
>
>
> For same queries, QTime is 1124 but log / handler shows 90571 seconds.
> Similar thing happens across all queries...
>
> Any pointers on why this may be happening?
>
>
Which Solr version are you using? Is the performance as bad on a non
virtualized instance too?

-- 
Regards,
Shalin Shekhar Mangar.

Re: Solr response extremely slow

Posted by Lance Norskog <go...@gmail.com>.
Is it possible that the virtual machine does not give clean system
millisecond numbers?

On Wed, Feb 3, 2010 at 5:43 PM, Erik Hatcher <er...@gmail.com> wrote:
>
> On Feb 3, 2010, at 1:38 PM, Rajat Garg wrote:
>>
>> Solr Specification Version: 1.3.0
>> Solr Implementation Version: 1.3.0 694707 - grantingersoll - 2008-09-12
>> 11:06:47
>
> There's the problem right there... that grantingersoll guy :)
>
> (kidding)
>
>
> Sounds like you're just hitting cache warming which can take a while.
>
> Have you tried Solr 1.4?  Faceting performance, for example, is dramatically
> improved, among many other improvements.
>
>        Erik
>
>



-- 
Lance Norskog
goksron@gmail.com

RE: Solr response extremely slow

Posted by Fuad Efendi <fu...@efendi.ca>.
'!'
:)))

Plus, FastLRUCache (previous one was synchronized)
(and of course warming-up time) := start complains after ensuring there are
no complains :)
(and of course OS needs time to cache filesystem blocks, and Java HotSpot,
... - few minutes at least...)

> On Feb 3, 2010, at 1:38 PM, Rajat Garg wrote:
> > Solr Specification Version: 1.3.0
> > Solr Implementation Version: 1.3.0 694707 - grantingersoll -
> > 2008-09-12
> > 11:06:47
> 
> There's the problem right there... that grantingersoll guy :)
> 
> (kidding)
> 
> 
> Sounds like you're just hitting cache warming which can take a while.
> 
> Have you tried Solr 1.4?  Faceting performance, for example, is
> dramatically improved, among many other improvements.
> 
> 	Erik




Re: Solr response extremely slow

Posted by Erik Hatcher <er...@gmail.com>.
On Feb 3, 2010, at 1:38 PM, Rajat Garg wrote:
> Solr Specification Version: 1.3.0
> Solr Implementation Version: 1.3.0 694707 - grantingersoll -  
> 2008-09-12
> 11:06:47

There's the problem right there... that grantingersoll guy :)

(kidding)


Sounds like you're just hitting cache warming which can take a while.

Have you tried Solr 1.4?  Faceting performance, for example, is  
dramatically improved, among many other improvements.

	Erik


Re: Solr response extremely slow

Posted by Rajat Garg <ra...@yahoo.com>.
Here you go -

Solr Specification Version: 1.3.0
Solr Implementation Version: 1.3.0 694707 - grantingersoll - 2008-09-12
11:06:47
Lucene Specification Version: 2.4-dev
Lucene Implementation Version: 2.4-dev 691741 - 2008-09-03 15:25:16


-- 
View this message in context: http://old.nabble.com/Solr-response-extremely-slow-tp27432229p27441205.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr response extremely slow

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
On Wed, Feb 3, 2010 at 2:18 PM, Doddamani, Prakash <
prakash.doddamani@corp.aol.com> wrote:

> Hey
> Can any one say which is the latest and stable version,
> We are using 1.2
>
>        Solr Specification Version: 1.2.0
>        Solr Implementation Version: 1.2.0 - Yonik - 2007-06-02 17:35:12
>        Lucene Specification Version: 2007-05-20_00-04-53
>        Lucene Implementation Version: build 2007-05-20
>        Current Time: Wed Feb 03 03:45:56 EST 2010
>
>
Solr 1.4 is the latest stable release.

In future, please don't reply to an unrelated email thread. Start a new
thread instead.

-- 
Regards,
Shalin Shekhar Mangar.

RE: Solr response extremely slow

Posted by "Doddamani, Prakash" <pr...@corp.aol.com>.
Hey 
Can any one say which is the latest and stable version,
We are using 1.2

	Solr Specification Version: 1.2.0
	Solr Implementation Version: 1.2.0 - Yonik - 2007-06-02 17:35:12
	Lucene Specification Version: 2007-05-20_00-04-53
	Lucene Implementation Version: build 2007-05-20
	Current Time: Wed Feb 03 03:45:56 EST 2010


Regards
Prakash

-----Original Message-----
From: Vijayant Kumar [mailto:vijayant@websitetoolbox.com] 
Sent: Wednesday, February 03, 2010 1:12 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr response extremely slow

Hi Rajat,

You can find the version of solr by

http://localhost:8983/solr/admin/registry.jsp

-- 

Thank you,
Vijayant Kumar
Software Engineer
Website Toolbox Inc.
http://www.websitetoolbox.com
1-800-921-7803 x211
>
> Java version is ->
>
> java version "1.5.0_18"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_18-b02) 
> Java HotSpot(TM) Server VM (build 1.5.0_18-b02, mixed mode)
>
> Not sure how to find solr version. Can you tell me how to look it up?
>
> Also, i don't have a dedicated server to run this on.
> --
> View this message in context:
> http://old.nabble.com/Solr-response-extremely-slow-tp27432229p27432419
> .html Sent from the Solr - User mailing list archive at Nabble.com.
>





Re: Solr response extremely slow

Posted by Vijayant Kumar <vi...@websitetoolbox.com>.
Hi Rajat,

You can find the version of solr by

http://localhost:8983/solr/admin/registry.jsp

-- 

Thank you,
Vijayant Kumar
Software Engineer
Website Toolbox Inc.
http://www.websitetoolbox.com
1-800-921-7803 x211
>
> Java version is ->
>
> java version "1.5.0_18"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_18-b02)
> Java HotSpot(TM) Server VM (build 1.5.0_18-b02, mixed mode)
>
> Not sure how to find solr version. Can you tell me how to look it up?
>
> Also, i don't have a dedicated server to run this on.
> --
> View this message in context:
> http://old.nabble.com/Solr-response-extremely-slow-tp27432229p27432419.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>





Re: Solr response extremely slow

Posted by Rajat Garg <ra...@yahoo.com>.
Java version is ->

java version "1.5.0_18"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_18-b02)
Java HotSpot(TM) Server VM (build 1.5.0_18-b02, mixed mode)

Not sure how to find solr version. Can you tell me how to look it up?

Also, i don't have a dedicated server to run this on.
-- 
View this message in context: http://old.nabble.com/Solr-response-extremely-slow-tp27432229p27432419.html
Sent from the Solr - User mailing list archive at Nabble.com.