You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by dudes dudes <ak...@hotmail.co.uk> on 2008/12/01 21:12:46 UTC
maxWarmingSearchers
Hello all,
I'm having this issue and I hope I get some help.. :)
This following happens quite often ... even though searching and indexing are on a safe side...
SolrException: HTTP code=503, reason=Error opening new searcher. exceeded
limit of maxWarmingSearchers=4, try again later.
I have increased the value of maxWarmingSearchers to 8 and I still experience the same problem....
This issue is happening to the master solr server ,,,, changing maxWarmingSearchers to higher value would help overcoming this issue ? or I should consider some other points ?
Another question is ? from your experience, do you think such error introduces server crash ?
thanks for your time..
ak
_________________________________________________________________
Get a bird’s eye view of the world with Multimap
http://clk.atdmt.com/GBL/go/115454059/direct/01/
RE: maxWarmingSearchers
Posted by dudes dudes <ak...@hotmail.co.uk>.
thanks for your explanation and time :)
> Subject: RE: maxWarmingSearchers
> Date: Mon, 1 Dec 2008 13:57:59 -0800
> From: Todd.Feak@smss.sony.com
> To: solr-user@lucene.apache.org
>
> The commit after each one may be hurting you.
>
> I believe that a new searcher is created after each commit. That searcher then runs through its warm up, which can be costly depending on your warming settings. Even if it's not overly costly, creating another one while the first one is running makes both of them run just a bit slower. Then creating a third exacerbates it, etc. If you are commiting faster then it can warm, you will get the pile-up of searchers you are seeing. And the more that pile up, the longer it takes each one to finish up.
>
> I would suggest trying to group those 4-10 documents into a single update job and doing a single commit. That way only 1 searcher is created per 4 minute window.
>
> Also (sorry I forgot this earlier) you can see how long your searcher is spending warming up by looking at the stats page under the admin. (/admin/stats.jsp) There is timing information on how long it took for the searcher and caches to warm up.
>
> -Todd Feak
>
> -----Original Message-----
> From: dudes dudes [mailto:akam123@hotmail.co.uk]
> Sent: Monday, December 01, 2008 1:46 PM
> To: solr-user@lucene.apache.org
> Subject: RE: maxWarmingSearchers
>
>
>
>
> > Subject: RE: maxWarmingSearchers
> > Date: Mon, 1 Dec 2008 13:35:53 -0800
> > From: Todd.Feak@smss.sony.com
> > To: solr-user@lucene.apache.org
> >
> > Ok sounds reasonable. When you index/update those 4-10 documents, are
> > you doing a single commit? OR are you doing a commit after each one?
>
> well, commits after each one..
>
> > How big is your index? How big are your documents? Ballpark figures are
> > ok.
>
> more than couple of MBs
>
> one final piece of information: I only have 2 G of RAM on that machine( linux on VMware environment ) and increased the memory of tomcat to 1 G
>
> thanks
>
>
> >
> > -ToddFeak
> >
> > -----Original Message-----
> > From: dudes dudes [mailto:akam123@hotmail.co.uk]
> > Sent: Monday, December 01, 2008 1:24 PM
> > To: solr-user@lucene.apache.org
> > Subject: RE: maxWarmingSearchers
> >
> >
> > Hi ToddFeak,
> >
> > thanks for your response...
> >
> > solr version is 1.3. Roughly about every 4 minutes there are
> > indexing/updaing of 4 to 10 documents ....that is from multiple clients
> > to one master server...
> >
> > It is also worth mentioning that I have
> >
> >
> >
> >
> >
> > postCommit uncommented under solrconfig ... QueryCache and
> > FilterCache settings are left as default....
> >
> > thanks
> > ak
> >
> >
> >
> >
> >
> >
> > > Subject: RE: maxWarmingSearchers
> > > Date: Mon, 1 Dec 2008 13:13:15 -0800
> > > From: Todd.Feak@smss.sony.com
> > > To: solr-user@lucene.apache.org
> > >
> > > Probably going to need a bit more information.
> > >
> > > Such as:
> > > What version of Solr and a little info on doc count, index size, etc.
> > > How often are you sending updates to your Master?
> > > How often are you committing?
> > > What are your QueryCache and FilterCache settings for autowarm?
> > > Do you have queries set up for newSearcher and firstSearcher?
> > >
> > > To start looking for your problem, you usually get a pile up of
> > > searchers if you are committing too fast, and/or the warming of new
> > > searchers is taking an extraordinary long time. If is happening in a
> > > repeatable fashion, increasing the number of warming searchers
> > probably
> > > won't fix the issue, just delay it.
> > >
> > > -ToddFeak
> > >
> > > -----Original Message-----
> > > From: dudes dudes [mailto:akam123@hotmail.co.uk]
> > > Sent: Monday, December 01, 2008 12:13 PM
> > > To: solr-user@lucene.apache.org
> > > Subject: maxWarmingSearchers
> > >
> > >
> > > Hello all,
> > >
> > > I'm having this issue and I hope I get some help.. :)
> > >
> > > This following happens quite often ... even though searching and
> > > indexing are on a safe side...
> > >
> > > SolrException: HTTP code=503, reason=Error opening new searcher.
> > > exceeded
> > >
> > > limit of maxWarmingSearchers=4, try again later.
> > >
> > > I have increased the value of maxWarmingSearchers to 8 and I still
> > > experience the same problem....
> > >
> > > This issue is happening to the master solr server ,,,, changing
> > > maxWarmingSearchers to higher value would help overcoming this issue
> > ?
> > > or I should consider some other points ?
> > >
> > > Another question is ? from your experience, do you think such error
> > > introduces server crash ?
> > >
> > >
> > > thanks for your time..
> > > ak
> > >
> > >
> > >
> > > _________________________________________________________________
> > > Get a bird's eye view of the world with Multimap
> > > http://clk.atdmt.com/GBL/go/115454059/direct/01/
> >
> > _________________________________________________________________
> > Get Windows Live Messenger on your Mobile
> > http://clk.atdmt.com/UKM/go/msnnkmgl0010000001ukm/direct/01/
>
> _________________________________________________________________
> Imagine a life without walls. See the possibilities.
> http://clk.atdmt.com/UKM/go/122465943/direct/01/
_________________________________________________________________
Get a bird’s eye view of the world with Multimap
http://clk.atdmt.com/GBL/go/115454059/direct/01/
RE: maxWarmingSearchers
Posted by "Feak, Todd" <To...@smss.sony.com>.
The commit after each one may be hurting you.
I believe that a new searcher is created after each commit. That searcher then runs through its warm up, which can be costly depending on your warming settings. Even if it's not overly costly, creating another one while the first one is running makes both of them run just a bit slower. Then creating a third exacerbates it, etc. If you are commiting faster then it can warm, you will get the pile-up of searchers you are seeing. And the more that pile up, the longer it takes each one to finish up.
I would suggest trying to group those 4-10 documents into a single update job and doing a single commit. That way only 1 searcher is created per 4 minute window.
Also (sorry I forgot this earlier) you can see how long your searcher is spending warming up by looking at the stats page under the admin. (/admin/stats.jsp) There is timing information on how long it took for the searcher and caches to warm up.
-Todd Feak
-----Original Message-----
From: dudes dudes [mailto:akam123@hotmail.co.uk]
Sent: Monday, December 01, 2008 1:46 PM
To: solr-user@lucene.apache.org
Subject: RE: maxWarmingSearchers
> Subject: RE: maxWarmingSearchers
> Date: Mon, 1 Dec 2008 13:35:53 -0800
> From: Todd.Feak@smss.sony.com
> To: solr-user@lucene.apache.org
>
> Ok sounds reasonable. When you index/update those 4-10 documents, are
> you doing a single commit? OR are you doing a commit after each one?
well, commits after each one..
> How big is your index? How big are your documents? Ballpark figures are
> ok.
more than couple of MBs
one final piece of information: I only have 2 G of RAM on that machine( linux on VMware environment ) and increased the memory of tomcat to 1 G
thanks
>
> -ToddFeak
>
> -----Original Message-----
> From: dudes dudes [mailto:akam123@hotmail.co.uk]
> Sent: Monday, December 01, 2008 1:24 PM
> To: solr-user@lucene.apache.org
> Subject: RE: maxWarmingSearchers
>
>
> Hi ToddFeak,
>
> thanks for your response...
>
> solr version is 1.3. Roughly about every 4 minutes there are
> indexing/updaing of 4 to 10 documents ....that is from multiple clients
> to one master server...
>
> It is also worth mentioning that I have
>
>
>
>
>
> postCommit uncommented under solrconfig ... QueryCache and
> FilterCache settings are left as default....
>
> thanks
> ak
>
>
>
>
>
>
> > Subject: RE: maxWarmingSearchers
> > Date: Mon, 1 Dec 2008 13:13:15 -0800
> > From: Todd.Feak@smss.sony.com
> > To: solr-user@lucene.apache.org
> >
> > Probably going to need a bit more information.
> >
> > Such as:
> > What version of Solr and a little info on doc count, index size, etc.
> > How often are you sending updates to your Master?
> > How often are you committing?
> > What are your QueryCache and FilterCache settings for autowarm?
> > Do you have queries set up for newSearcher and firstSearcher?
> >
> > To start looking for your problem, you usually get a pile up of
> > searchers if you are committing too fast, and/or the warming of new
> > searchers is taking an extraordinary long time. If is happening in a
> > repeatable fashion, increasing the number of warming searchers
> probably
> > won't fix the issue, just delay it.
> >
> > -ToddFeak
> >
> > -----Original Message-----
> > From: dudes dudes [mailto:akam123@hotmail.co.uk]
> > Sent: Monday, December 01, 2008 12:13 PM
> > To: solr-user@lucene.apache.org
> > Subject: maxWarmingSearchers
> >
> >
> > Hello all,
> >
> > I'm having this issue and I hope I get some help.. :)
> >
> > This following happens quite often ... even though searching and
> > indexing are on a safe side...
> >
> > SolrException: HTTP code=503, reason=Error opening new searcher.
> > exceeded
> >
> > limit of maxWarmingSearchers=4, try again later.
> >
> > I have increased the value of maxWarmingSearchers to 8 and I still
> > experience the same problem....
> >
> > This issue is happening to the master solr server ,,,, changing
> > maxWarmingSearchers to higher value would help overcoming this issue
> ?
> > or I should consider some other points ?
> >
> > Another question is ? from your experience, do you think such error
> > introduces server crash ?
> >
> >
> > thanks for your time..
> > ak
> >
> >
> >
> > _________________________________________________________________
> > Get a bird's eye view of the world with Multimap
> > http://clk.atdmt.com/GBL/go/115454059/direct/01/
>
> _________________________________________________________________
> Get Windows Live Messenger on your Mobile
> http://clk.atdmt.com/UKM/go/msnnkmgl0010000001ukm/direct/01/
_________________________________________________________________
Imagine a life without walls. See the possibilities.
http://clk.atdmt.com/UKM/go/122465943/direct/01/
RE: maxWarmingSearchers
Posted by dudes dudes <ak...@hotmail.co.uk>.
> Subject: RE: maxWarmingSearchers
> Date: Mon, 1 Dec 2008 13:35:53 -0800
> From: Todd.Feak@smss.sony.com
> To: solr-user@lucene.apache.org
>
> Ok sounds reasonable. When you index/update those 4-10 documents, are
> you doing a single commit? OR are you doing a commit after each one?
well, commits after each one..
> How big is your index? How big are your documents? Ballpark figures are
> ok.
more than couple of MBs
one final piece of information: I only have 2 G of RAM on that machine( linux on VMware environment ) and increased the memory of tomcat to 1 G
thanks
>
> -ToddFeak
>
> -----Original Message-----
> From: dudes dudes [mailto:akam123@hotmail.co.uk]
> Sent: Monday, December 01, 2008 1:24 PM
> To: solr-user@lucene.apache.org
> Subject: RE: maxWarmingSearchers
>
>
> Hi ToddFeak,
>
> thanks for your response...
>
> solr version is 1.3. Roughly about every 4 minutes there are
> indexing/updaing of 4 to 10 documents ....that is from multiple clients
> to one master server...
>
> It is also worth mentioning that I have
>
>
>
>
>
> postCommit uncommented under solrconfig ... QueryCache and
> FilterCache settings are left as default....
>
> thanks
> ak
>
>
>
>
>
>
> > Subject: RE: maxWarmingSearchers
> > Date: Mon, 1 Dec 2008 13:13:15 -0800
> > From: Todd.Feak@smss.sony.com
> > To: solr-user@lucene.apache.org
> >
> > Probably going to need a bit more information.
> >
> > Such as:
> > What version of Solr and a little info on doc count, index size, etc.
> > How often are you sending updates to your Master?
> > How often are you committing?
> > What are your QueryCache and FilterCache settings for autowarm?
> > Do you have queries set up for newSearcher and firstSearcher?
> >
> > To start looking for your problem, you usually get a pile up of
> > searchers if you are committing too fast, and/or the warming of new
> > searchers is taking an extraordinary long time. If is happening in a
> > repeatable fashion, increasing the number of warming searchers
> probably
> > won't fix the issue, just delay it.
> >
> > -ToddFeak
> >
> > -----Original Message-----
> > From: dudes dudes [mailto:akam123@hotmail.co.uk]
> > Sent: Monday, December 01, 2008 12:13 PM
> > To: solr-user@lucene.apache.org
> > Subject: maxWarmingSearchers
> >
> >
> > Hello all,
> >
> > I'm having this issue and I hope I get some help.. :)
> >
> > This following happens quite often ... even though searching and
> > indexing are on a safe side...
> >
> > SolrException: HTTP code=503, reason=Error opening new searcher.
> > exceeded
> >
> > limit of maxWarmingSearchers=4, try again later.
> >
> > I have increased the value of maxWarmingSearchers to 8 and I still
> > experience the same problem....
> >
> > This issue is happening to the master solr server ,,,, changing
> > maxWarmingSearchers to higher value would help overcoming this issue
> ?
> > or I should consider some other points ?
> >
> > Another question is ? from your experience, do you think such error
> > introduces server crash ?
> >
> >
> > thanks for your time..
> > ak
> >
> >
> >
> > _________________________________________________________________
> > Get a bird's eye view of the world with Multimap
> > http://clk.atdmt.com/GBL/go/115454059/direct/01/
>
> _________________________________________________________________
> Get Windows Live Messenger on your Mobile
> http://clk.atdmt.com/UKM/go/msnnkmgl0010000001ukm/direct/01/
_________________________________________________________________
Imagine a life without walls. See the possibilities.
http://clk.atdmt.com/UKM/go/122465943/direct/01/
RE: maxWarmingSearchers
Posted by "Feak, Todd" <To...@smss.sony.com>.
Ok sounds reasonable. When you index/update those 4-10 documents, are
you doing a single commit? OR are you doing a commit after each one?
How big is your index? How big are your documents? Ballpark figures are
ok.
-ToddFeak
-----Original Message-----
From: dudes dudes [mailto:akam123@hotmail.co.uk]
Sent: Monday, December 01, 2008 1:24 PM
To: solr-user@lucene.apache.org
Subject: RE: maxWarmingSearchers
Hi ToddFeak,
thanks for your response...
solr version is 1.3. Roughly about every 4 minutes there are
indexing/updaing of 4 to 10 documents ....that is from multiple clients
to one master server...
It is also worth mentioning that I have
postCommit uncommented under solrconfig ... QueryCache and
FilterCache settings are left as default....
thanks
ak
> Subject: RE: maxWarmingSearchers
> Date: Mon, 1 Dec 2008 13:13:15 -0800
> From: Todd.Feak@smss.sony.com
> To: solr-user@lucene.apache.org
>
> Probably going to need a bit more information.
>
> Such as:
> What version of Solr and a little info on doc count, index size, etc.
> How often are you sending updates to your Master?
> How often are you committing?
> What are your QueryCache and FilterCache settings for autowarm?
> Do you have queries set up for newSearcher and firstSearcher?
>
> To start looking for your problem, you usually get a pile up of
> searchers if you are committing too fast, and/or the warming of new
> searchers is taking an extraordinary long time. If is happening in a
> repeatable fashion, increasing the number of warming searchers
probably
> won't fix the issue, just delay it.
>
> -ToddFeak
>
> -----Original Message-----
> From: dudes dudes [mailto:akam123@hotmail.co.uk]
> Sent: Monday, December 01, 2008 12:13 PM
> To: solr-user@lucene.apache.org
> Subject: maxWarmingSearchers
>
>
> Hello all,
>
> I'm having this issue and I hope I get some help.. :)
>
> This following happens quite often ... even though searching and
> indexing are on a safe side...
>
> SolrException: HTTP code=503, reason=Error opening new searcher.
> exceeded
>
> limit of maxWarmingSearchers=4, try again later.
>
> I have increased the value of maxWarmingSearchers to 8 and I still
> experience the same problem....
>
> This issue is happening to the master solr server ,,,, changing
> maxWarmingSearchers to higher value would help overcoming this issue
?
> or I should consider some other points ?
>
> Another question is ? from your experience, do you think such error
> introduces server crash ?
>
>
> thanks for your time..
> ak
>
>
>
> _________________________________________________________________
> Get a bird's eye view of the world with Multimap
> http://clk.atdmt.com/GBL/go/115454059/direct/01/
_________________________________________________________________
Get Windows Live Messenger on your Mobile
http://clk.atdmt.com/UKM/go/msnnkmgl0010000001ukm/direct/01/
Re: maxWarmingSearchers
Posted by Otis Gospodnetic <ot...@yahoo.com>.
How long does it take for 1 of your searchers to warm up?
How often do slaves copy the index from the master?
It looks like the first one is slow relative to how often the index is being copied (and a new searcher is therefore being opened on the slave). Reduce how often your index is being copied and your slaves should be happier.... or see why searchers are so slow to warm up.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ----
> From: dudes dudes <ak...@hotmail.co.uk>
> To: solr-user@lucene.apache.org
> Sent: Monday, December 1, 2008 4:23:47 PM
> Subject: RE: maxWarmingSearchers
>
>
> Hi ToddFeak,
>
> thanks for your response...
>
> solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing of
> 4 to 10 documents ....that is from multiple clients to one master server...
>
> It is also worth mentioning that I have
>
>
>
>
>
> postCommit uncommented under solrconfig ... QueryCache and FilterCache
> settings are left as default....
>
> thanks
> ak
>
>
>
>
>
>
> > Subject: RE: maxWarmingSearchers
> > Date: Mon, 1 Dec 2008 13:13:15 -0800
> > From: Todd.Feak@smss.sony.com
> > To: solr-user@lucene.apache.org
> >
> > Probably going to need a bit more information.
> >
> > Such as:
> > What version of Solr and a little info on doc count, index size, etc.
> > How often are you sending updates to your Master?
> > How often are you committing?
> > What are your QueryCache and FilterCache settings for autowarm?
> > Do you have queries set up for newSearcher and firstSearcher?
> >
> > To start looking for your problem, you usually get a pile up of
> > searchers if you are committing too fast, and/or the warming of new
> > searchers is taking an extraordinary long time. If is happening in a
> > repeatable fashion, increasing the number of warming searchers probably
> > won't fix the issue, just delay it.
> >
> > -ToddFeak
> >
> > -----Original Message-----
> > From: dudes dudes [mailto:akam123@hotmail.co.uk]
> > Sent: Monday, December 01, 2008 12:13 PM
> > To: solr-user@lucene.apache.org
> > Subject: maxWarmingSearchers
> >
> >
> > Hello all,
> >
> > I'm having this issue and I hope I get some help.. :)
> >
> > This following happens quite often ... even though searching and
> > indexing are on a safe side...
> >
> > SolrException: HTTP code=503, reason=Error opening new searcher.
> > exceeded
> >
> > limit of maxWarmingSearchers=4, try again later.
> >
> > I have increased the value of maxWarmingSearchers to 8 and I still
> > experience the same problem....
> >
> > This issue is happening to the master solr server ,,,, changing
> > maxWarmingSearchers to higher value would help overcoming this issue ?
> > or I should consider some other points ?
> >
> > Another question is ? from your experience, do you think such error
> > introduces server crash ?
> >
> >
> > thanks for your time..
> > ak
> >
> >
> >
> > _________________________________________________________________
> > Get a bird's eye view of the world with Multimap
> > http://clk.atdmt.com/GBL/go/115454059/direct/01/
>
> _________________________________________________________________
> Get Windows Live Messenger on your Mobile
> http://clk.atdmt.com/UKM/go/msnnkmgl0010000001ukm/direct/01/
RE: maxWarmingSearchers
Posted by dudes dudes <ak...@hotmail.co.uk>.
Hi ToddFeak,
thanks for your response...
solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing of 4 to 10 documents ....that is from multiple clients to one master server...
It is also worth mentioning that I have
postCommit uncommented under solrconfig ... QueryCache and FilterCache settings are left as default....
thanks
ak
> Subject: RE: maxWarmingSearchers
> Date: Mon, 1 Dec 2008 13:13:15 -0800
> From: Todd.Feak@smss.sony.com
> To: solr-user@lucene.apache.org
>
> Probably going to need a bit more information.
>
> Such as:
> What version of Solr and a little info on doc count, index size, etc.
> How often are you sending updates to your Master?
> How often are you committing?
> What are your QueryCache and FilterCache settings for autowarm?
> Do you have queries set up for newSearcher and firstSearcher?
>
> To start looking for your problem, you usually get a pile up of
> searchers if you are committing too fast, and/or the warming of new
> searchers is taking an extraordinary long time. If is happening in a
> repeatable fashion, increasing the number of warming searchers probably
> won't fix the issue, just delay it.
>
> -ToddFeak
>
> -----Original Message-----
> From: dudes dudes [mailto:akam123@hotmail.co.uk]
> Sent: Monday, December 01, 2008 12:13 PM
> To: solr-user@lucene.apache.org
> Subject: maxWarmingSearchers
>
>
> Hello all,
>
> I'm having this issue and I hope I get some help.. :)
>
> This following happens quite often ... even though searching and
> indexing are on a safe side...
>
> SolrException: HTTP code=503, reason=Error opening new searcher.
> exceeded
>
> limit of maxWarmingSearchers=4, try again later.
>
> I have increased the value of maxWarmingSearchers to 8 and I still
> experience the same problem....
>
> This issue is happening to the master solr server ,,,, changing
> maxWarmingSearchers to higher value would help overcoming this issue ?
> or I should consider some other points ?
>
> Another question is ? from your experience, do you think such error
> introduces server crash ?
>
>
> thanks for your time..
> ak
>
>
>
> _________________________________________________________________
> Get a bird's eye view of the world with Multimap
> http://clk.atdmt.com/GBL/go/115454059/direct/01/
_________________________________________________________________
Get Windows Live Messenger on your Mobile
http://clk.atdmt.com/UKM/go/msnnkmgl0010000001ukm/direct/01/
RE: maxWarmingSearchers
Posted by "Feak, Todd" <To...@smss.sony.com>.
Probably going to need a bit more information.
Such as:
What version of Solr and a little info on doc count, index size, etc.
How often are you sending updates to your Master?
How often are you committing?
What are your QueryCache and FilterCache settings for autowarm?
Do you have queries set up for newSearcher and firstSearcher?
To start looking for your problem, you usually get a pile up of
searchers if you are committing too fast, and/or the warming of new
searchers is taking an extraordinary long time. If is happening in a
repeatable fashion, increasing the number of warming searchers probably
won't fix the issue, just delay it.
-ToddFeak
-----Original Message-----
From: dudes dudes [mailto:akam123@hotmail.co.uk]
Sent: Monday, December 01, 2008 12:13 PM
To: solr-user@lucene.apache.org
Subject: maxWarmingSearchers
Hello all,
I'm having this issue and I hope I get some help.. :)
This following happens quite often ... even though searching and
indexing are on a safe side...
SolrException: HTTP code=503, reason=Error opening new searcher.
exceeded
limit of maxWarmingSearchers=4, try again later.
I have increased the value of maxWarmingSearchers to 8 and I still
experience the same problem....
This issue is happening to the master solr server ,,,, changing
maxWarmingSearchers to higher value would help overcoming this issue ?
or I should consider some other points ?
Another question is ? from your experience, do you think such error
introduces server crash ?
thanks for your time..
ak
_________________________________________________________________
Get a bird's eye view of the world with Multimap
http://clk.atdmt.com/GBL/go/115454059/direct/01/