You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Loka <lo...@zensar.in> on 2013/11/14 11:13:01 UTC
Re: exceeded limit of maxWarmingSearchers ERROR
Hi Naveen,
Iam also getting the similar problem where I do not know how to use the
commitWithin Tag, can you help me how to use commitWithin Tag. can you give
me the example
--
View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Loka <lo...@zensar.in>.
Erickson,
Thanks for your reply, before your reply, I have googled and found the following and added under
<updateHandler class="solr.DirectUpdateHandler2"> tag of solrconfig.xml file.
<autoCommit>
<maxTime>30000</maxTime>
</autoCommit>
<autoSoftCommit>
<maxTime>10000</maxTime>
</autoSoftCommit>
Is the above one is fine or should I go strictly as per ypur suggestion means as below:
<autoCommit>
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
<openSearcher>false</openSearcher>
</autoCommit>
<!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
-->
<autoSoftCommit>
<maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
</autoSoftCommit>
Please confirm me.
But how can I check how much autowarming that Iam doing, as of now I have set the maxWarmingSearchers as 2, should I increase the value?
Regards,
Lokanadham Ganta
----- Original Message -----
From: "Erick Erickson [via Lucene]" <ml...@n3.nabble.com>
To: "Loka" <lo...@zensar.in>
Sent: Friday, November 15, 2013 6:07:12 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Where did you get that syntax? I've never seen that before.
What you want to configure is the "maxTime" in your
autocommit and autosoftcommit sections of solrconfig.xml,
as:
<autoCommit>
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
<openSearcher>false</openSearcher>
</autoCommit>
<!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
-->
<autoSoftCommit>
<maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
</autoSoftCommit>
And you do NOT want to commit from your client.
Depending on how long autowarm takes, you may still see this error,
so check how much autowarming you're doing, i.e. how you've
configured the caches in solrconfig.xml and what you
have for newSearcher and firstSearcher.
I'd start with autowarm numbers of, maybe, 16 or so at most.
Best,
Erick
On Fri, Nov 15, 2013 at 2:46 AM, Loka < [hidden email] > wrote:
> Hi Erickson,
>
> Thanks for your reply, basically, I used commitWithin tag as below in
> solrconfig.xml file
>
>
> <requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
> <lst name="defaults">
> <str name="update.processor">dedupe</str>
> </lst>
> <add commitWithin="10000"/>
> </requestHandler>
>
> <updateRequestProcessorChain name="dedupe">
> <processor
> class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
> <bool name="enabled">true</bool>
> <str name="signatureField">id</str>
> <bool name="overwriteDupes">false</bool>
> <str name="fields">name,features,cat</str>
> <str
> name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
> </processor>
> <processor class="solr.LogUpdateProcessorFactory" />
> <processor class="solr.RunUpdateProcessorFactory" />
> </updateRequestProcessorChain>
>
>
> But this fix did not solve my problem, I mean I again got the same error.
> PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
> messaging-spring.xml, can you sugest me where Iam doing wrong.
>
> Regards,
> Lokanadham Ganta
>
>
>
>
>
>
>
>
>
>
> ----- Original Message -----
> From: "Erick Erickson [via Lucene]" <
> [hidden email] >
> To: "Loka" < [hidden email] >
> Sent: Thursday, November 14, 2013 8:38:17 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> CommitWithin is either configured in solrconfig.xml for the
> <autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
> recommend you do use this.
>
> The other way you can do it is if you're using SolrJ, one of the
> forms of the server.add() method takes a number of milliseconds
> to force a commit.
>
> You really, really do NOT want to use ridiculously short times for this
> like a few milliseconds. That will cause new searchers to be
> warmed, and when too many of them are warming at once you
> get this error.
>
> Seriously, make your commitWithin or autocommit parameters
> as long as you can, for many reasons.
>
> Here's a bunch of background:
>
> http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
>
> Best,
> Erick
>
>
> On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
>
>
> > Hi Naveen,
> > Iam also getting the similar problem where I do not know how to use the
> > commitWithin Tag, can you help me how to use commitWithin Tag. can you
> give
> > me the example
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
>
>
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
> To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> here .
> NAML
>
> solr-spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml >
> messaging-spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml
> >
> schema.xml (6K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml >
> solrconfig.xml (61K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml >
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101203.html
To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click here .
NAML
--
View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101208.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Erick Erickson <er...@gmail.com>.
You're using Solr 1.4? That's long enough ago that I've mostly forgotten
the quirks there, sorry.
Erick
On Mon, Nov 18, 2013 at 2:38 AM, Loka <lo...@zensar.in> wrote:
> Hi Erickson,
>
> Thanks for your reply.
>
> Iam getting the following error with liferay tomcat.
>
> 2013/11/18 07:29:42 ERROR
> com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:90)
> []
>
> [liferay/search_writer]
> org.apache.solr.common.SolrException: Not Found
>
> Not Found
>
> request:
> http://10.43.4.155:8080/apache-solr-1.4.1/liferay/update?wt=javabin&version=2.2
> org.apache.solr.common.SolrException: Not Found
>
> Not Found
>
> request:
> http://10.43.4.155:8080/apache-solr-1.4.1/liferay/update?wt=javabin&version=2.2
> at
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343)
> at
> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183)
> at
> com.liferay.portal.search.solr.server.BasicAuthSolrServer.request(BasicAuthSolrServer.java:93)
> at
> org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217)
> at
> org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:97)
> at
> com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:83)
> at
> com.liferay.portal.search.solr.SolrIndexWriterImpl.updateDocument(SolrIndexWriterImpl.java:133)
> at
> com.liferay.portal.kernel.search.messaging.SearchWriterMessageListener.doReceive
>
> (SearchWriterMessageListener.java:86)
> at
> com.liferay.portal.kernel.search.messaging.SearchWriterMessageListener.receive
>
> (SearchWriterMessageListener.java:33)
> at
> com.liferay.portal.kernel.messaging.InvokerMessageListener.receive(InvokerMessageListener.java:63)
> at
> com.liferay.portal.kernel.messaging.ParallelDestination$1.run(ParallelDestination.java:61)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)...
>
>
>
>
> Can you help me why Iam getting this error.
>
> PFA of the same error log and the solr-spring.xml files.
>
> Regards,
> Lokanadham Ganta
>
> ----- Original Message -----
> From: "Erick Erickson [via Lucene]" <
> ml-node+s472066n4101220h58@n3.nabble.com>
> To: "Loka" <lo...@zensar.in>
> Sent: Friday, November 15, 2013 7:14:26 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> That's a fine place to start. This form:
>
> <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
>
> just allows you to define a sysvar to override the 15 second default, like
> java -Dsolr.autoCommti.maxTime=30000 -jar start.jar
>
>
> On Fri, Nov 15, 2013 at 8:11 AM, Loka < [hidden email] > wrote:
>
>
> > Hi Erickson,
> >
> > I have seen the following also from google, can I use the same in
> > <updateHandler class="solr.DirectUpdateHandler2">:
> > <commitWithin> <softCommit>false</softCommit></commitWithin>
> >
> > If the above one is correct to add, can I add the below tags aslo in
> > <updateHandler class="solr.DirectUpdateHandler2"> along with the above
> tag:
> >
> > <autoCommit>
> > <maxTime>30000</maxTime>
> > </autoCommit>
> >
> > <autoSoftCommit>
> > <maxTime>10000</maxTime>
> > </autoSoftCommit>
> >
> >
> > so finally, it will look like as:
> >
> > <updateHandler class="solr.DirectUpdateHandler2">
> > <autoCommit>
> > <maxTime>30000</maxTime>
> > </autoCommit>
> >
> > <autoSoftCommit>
> > <maxTime>10000</maxTime>
> > </autoSoftCommit>
> > <commitWithin> <softCommit>false</softCommit></commitWithin>
> >
> > </updateHandler>
> >
> >
> > Is the above one fine?
> >
> >
> > Regards,
> > Lokanadham Ganta
> >
> >
> >
> >
> > ----- Original Message -----
> > From: "Lokanadham Ganta" < [hidden email] >
> > To: "Erick Erickson [via Lucene]" <
> > [hidden email] >
> > Sent: Friday, November 15, 2013 6:33:20 PM
> > Subject: Re: exceeded limit of maxWarmingSearchers ERROR
> >
> > Erickson,
> >
> > Thanks for your reply, before your reply, I have googled and found the
> > following and added under
> > <updateHandler class="solr.DirectUpdateHandler2"> tag of solrconfig.xml
> > file.
> >
> >
> > <autoCommit>
> > <maxTime>30000</maxTime>
> > </autoCommit>
> >
> > <autoSoftCommit>
> > <maxTime>10000</maxTime>
> > </autoSoftCommit>
> >
> > Is the above one is fine or should I go strictly as per ypur suggestion
> > means as below:
> >
> > <autoCommit>
> > <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> > <openSearcher>false</openSearcher>
> > </autoCommit>
> >
> > <!-- softAutoCommit is like autoCommit except it causes a
> > 'soft' commit which only ensures that changes are visible
> > but does not ensure that data is synced to disk. This is
> > faster and more near-realtime friendly than a hard commit.
> > -->
> >
> > <autoSoftCommit>
> > <maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
> > </autoSoftCommit>
> >
> >
> >
> > Please confirm me.
> >
> > But how can I check how much autowarming that Iam doing, as of now I have
> > set the maxWarmingSearchers as 2, should I increase the value?
> >
> >
> > Regards,
> > Lokanadham Ganta
> >
> >
> > ----- Original Message -----
> > From: "Erick Erickson [via Lucene]" <
> > [hidden email] >
> > To: "Loka" < [hidden email] >
> > Sent: Friday, November 15, 2013 6:07:12 PM
> > Subject: Re: exceeded limit of maxWarmingSearchers ERROR
> >
> > Where did you get that syntax? I've never seen that before.
> >
> > What you want to configure is the "maxTime" in your
> > autocommit and autosoftcommit sections of solrconfig.xml,
> > as:
> >
> > <autoCommit>
> > <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> > <openSearcher>false</openSearcher>
> > </autoCommit>
> >
> > <!-- softAutoCommit is like autoCommit except it causes a
> > 'soft' commit which only ensures that changes are visible
> > but does not ensure that data is synced to disk. This is
> > faster and more near-realtime friendly than a hard commit.
> > -->
> >
> > <autoSoftCommit>
> > <maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
> > </autoSoftCommit>
> >
> > And you do NOT want to commit from your client.
> >
> > Depending on how long autowarm takes, you may still see this error,
> > so check how much autowarming you're doing, i.e. how you've
> > configured the caches in solrconfig.xml and what you
> > have for newSearcher and firstSearcher.
> >
> > I'd start with autowarm numbers of, maybe, 16 or so at most.
> >
> > Best,
> > Erick
> >
> >
> > On Fri, Nov 15, 2013 at 2:46 AM, Loka < [hidden email] > wrote:
> >
> >
> > > Hi Erickson,
> > >
> > > Thanks for your reply, basically, I used commitWithin tag as below in
> > > solrconfig.xml file
> > >
> > >
> > > <requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
> > > <lst name="defaults">
> > > <str name="update.processor">dedupe</str>
> > > </lst>
> > > <add commitWithin="10000"/>
> > > </requestHandler>
> > >
> > > <updateRequestProcessorChain name="dedupe">
> > > <processor
> > >
> class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
> > > <bool name="enabled">true</bool>
> > > <str name="signatureField">id</str>
> > > <bool name="overwriteDupes">false</bool>
> > > <str name="fields">name,features,cat</str>
> > > <str
> > >
> >
> name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
> > > </processor>
> > > <processor class="solr.LogUpdateProcessorFactory" />
> > > <processor class="solr.RunUpdateProcessorFactory" />
> > > </updateRequestProcessorChain>
> > >
> > >
> > > But this fix did not solve my problem, I mean I again got the same
> error.
> > > PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
> > > messaging-spring.xml, can you sugest me where Iam doing wrong.
> > >
> > > Regards,
> > > Lokanadham Ganta
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > ----- Original Message -----
> > > From: "Erick Erickson [via Lucene]" <
> > > [hidden email] >
> > > To: "Loka" < [hidden email] >
> > > Sent: Thursday, November 14, 2013 8:38:17 PM
> > > Subject: Re: exceeded limit of maxWarmingSearchers ERROR
> > >
> > > CommitWithin is either configured in solrconfig.xml for the
> > > <autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
> > > recommend you do use this.
> > >
> > > The other way you can do it is if you're using SolrJ, one of the
> > > forms of the server.add() method takes a number of milliseconds
> > > to force a commit.
> > >
> > > You really, really do NOT want to use ridiculously short times for this
> > > like a few milliseconds. That will cause new searchers to be
> > > warmed, and when too many of them are warming at once you
> > > get this error.
> > >
> > > Seriously, make your commitWithin or autocommit parameters
> > > as long as you can, for many reasons.
> > >
> > > Here's a bunch of background:
> > >
> > >
> >
> http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
> > >
> > > Best,
> > > Erick
> > >
> > >
> > > On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
> > >
> > >
> > > > Hi Naveen,
> > > > Iam also getting the similar problem where I do not know how to use
> the
> > > > commitWithin Tag, can you help me how to use commitWithin Tag. can
> you
> > > give
> > > > me the example
> > > >
> > > >
> > > >
> > > > --
> > > > View this message in context:
> > > >
> > >
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> > > > Sent from the Solr - User mailing list archive at Nabble.com.
> > > >
> > >
> > >
> > >
> > >
> > >
> > > If you reply to this email, your message will be added to the
> discussion
> > > below:
> > >
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
> > > To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> > > here .
> > > NAML
> > >
> > > solr-spring.xml (2K) <
> > >
> http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml >
> > > messaging-spring.xml (2K) <
> > >
> >
> http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml
> > > >
> > > schema.xml (6K) <
> > > http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml >
> > > solrconfig.xml (61K) <
> > > http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml >
> > >
> > >
> > >
> > >
> > > --
> > > View this message in context:
> > >
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
> > > Sent from the Solr - User mailing list archive at Nabble.com.
> > >
> >
> >
> >
> >
> >
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101203.html
> > To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> > here .
> > NAML
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101209.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
>
>
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101220.html
> To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> here .
> NAML
>
> solr_spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101624/0/solr_spring.xml>
> Liferay_Solr_Error_Log.txt (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101624/1/Liferay_Solr_Error_Log.txt
> >
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101624.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Loka <lo...@zensar.in>.
Hi Erickson,
Thanks for your reply.
Iam getting the following error with liferay tomcat.
2013/11/18 07:29:42 ERROR
com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:90) []
[liferay/search_writer]
org.apache.solr.common.SolrException: Not Found
Not Found
request: http://10.43.4.155:8080/apache-solr-1.4.1/liferay/update?wt=javabin&version=2.2
org.apache.solr.common.SolrException: Not Found
Not Found
request: http://10.43.4.155:8080/apache-solr-1.4.1/liferay/update?wt=javabin&version=2.2
at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343)
at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183)
at com.liferay.portal.search.solr.server.BasicAuthSolrServer.request(BasicAuthSolrServer.java:93)
at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217)
at org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:97)
at com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:83)
at com.liferay.portal.search.solr.SolrIndexWriterImpl.updateDocument(SolrIndexWriterImpl.java:133)
at com.liferay.portal.kernel.search.messaging.SearchWriterMessageListener.doReceive
(SearchWriterMessageListener.java:86)
at com.liferay.portal.kernel.search.messaging.SearchWriterMessageListener.receive
(SearchWriterMessageListener.java:33)
at com.liferay.portal.kernel.messaging.InvokerMessageListener.receive(InvokerMessageListener.java:63)
at com.liferay.portal.kernel.messaging.ParallelDestination$1.run(ParallelDestination.java:61)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)...
Can you help me why Iam getting this error.
PFA of the same error log and the solr-spring.xml files.
Regards,
Lokanadham Ganta
----- Original Message -----
From: "Erick Erickson [via Lucene]" <ml...@n3.nabble.com>
To: "Loka" <lo...@zensar.in>
Sent: Friday, November 15, 2013 7:14:26 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
That's a fine place to start. This form:
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
just allows you to define a sysvar to override the 15 second default, like
java -Dsolr.autoCommti.maxTime=30000 -jar start.jar
On Fri, Nov 15, 2013 at 8:11 AM, Loka < [hidden email] > wrote:
> Hi Erickson,
>
> I have seen the following also from google, can I use the same in
> <updateHandler class="solr.DirectUpdateHandler2">:
> <commitWithin> <softCommit>false</softCommit></commitWithin>
>
> If the above one is correct to add, can I add the below tags aslo in
> <updateHandler class="solr.DirectUpdateHandler2"> along with the above tag:
>
> <autoCommit>
> <maxTime>30000</maxTime>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>10000</maxTime>
> </autoSoftCommit>
>
>
> so finally, it will look like as:
>
> <updateHandler class="solr.DirectUpdateHandler2">
> <autoCommit>
> <maxTime>30000</maxTime>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>10000</maxTime>
> </autoSoftCommit>
> <commitWithin> <softCommit>false</softCommit></commitWithin>
>
> </updateHandler>
>
>
> Is the above one fine?
>
>
> Regards,
> Lokanadham Ganta
>
>
>
>
> ----- Original Message -----
> From: "Lokanadham Ganta" < [hidden email] >
> To: "Erick Erickson [via Lucene]" <
> [hidden email] >
> Sent: Friday, November 15, 2013 6:33:20 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> Erickson,
>
> Thanks for your reply, before your reply, I have googled and found the
> following and added under
> <updateHandler class="solr.DirectUpdateHandler2"> tag of solrconfig.xml
> file.
>
>
> <autoCommit>
> <maxTime>30000</maxTime>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>10000</maxTime>
> </autoSoftCommit>
>
> Is the above one is fine or should I go strictly as per ypur suggestion
> means as below:
>
> <autoCommit>
> <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> <openSearcher>false</openSearcher>
> </autoCommit>
>
> <!-- softAutoCommit is like autoCommit except it causes a
> 'soft' commit which only ensures that changes are visible
> but does not ensure that data is synced to disk. This is
> faster and more near-realtime friendly than a hard commit.
> -->
>
> <autoSoftCommit>
> <maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
> </autoSoftCommit>
>
>
>
> Please confirm me.
>
> But how can I check how much autowarming that Iam doing, as of now I have
> set the maxWarmingSearchers as 2, should I increase the value?
>
>
> Regards,
> Lokanadham Ganta
>
>
> ----- Original Message -----
> From: "Erick Erickson [via Lucene]" <
> [hidden email] >
> To: "Loka" < [hidden email] >
> Sent: Friday, November 15, 2013 6:07:12 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> Where did you get that syntax? I've never seen that before.
>
> What you want to configure is the "maxTime" in your
> autocommit and autosoftcommit sections of solrconfig.xml,
> as:
>
> <autoCommit>
> <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> <openSearcher>false</openSearcher>
> </autoCommit>
>
> <!-- softAutoCommit is like autoCommit except it causes a
> 'soft' commit which only ensures that changes are visible
> but does not ensure that data is synced to disk. This is
> faster and more near-realtime friendly than a hard commit.
> -->
>
> <autoSoftCommit>
> <maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
> </autoSoftCommit>
>
> And you do NOT want to commit from your client.
>
> Depending on how long autowarm takes, you may still see this error,
> so check how much autowarming you're doing, i.e. how you've
> configured the caches in solrconfig.xml and what you
> have for newSearcher and firstSearcher.
>
> I'd start with autowarm numbers of, maybe, 16 or so at most.
>
> Best,
> Erick
>
>
> On Fri, Nov 15, 2013 at 2:46 AM, Loka < [hidden email] > wrote:
>
>
> > Hi Erickson,
> >
> > Thanks for your reply, basically, I used commitWithin tag as below in
> > solrconfig.xml file
> >
> >
> > <requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
> > <lst name="defaults">
> > <str name="update.processor">dedupe</str>
> > </lst>
> > <add commitWithin="10000"/>
> > </requestHandler>
> >
> > <updateRequestProcessorChain name="dedupe">
> > <processor
> > class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
> > <bool name="enabled">true</bool>
> > <str name="signatureField">id</str>
> > <bool name="overwriteDupes">false</bool>
> > <str name="fields">name,features,cat</str>
> > <str
> >
> name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
> > </processor>
> > <processor class="solr.LogUpdateProcessorFactory" />
> > <processor class="solr.RunUpdateProcessorFactory" />
> > </updateRequestProcessorChain>
> >
> >
> > But this fix did not solve my problem, I mean I again got the same error.
> > PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
> > messaging-spring.xml, can you sugest me where Iam doing wrong.
> >
> > Regards,
> > Lokanadham Ganta
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > ----- Original Message -----
> > From: "Erick Erickson [via Lucene]" <
> > [hidden email] >
> > To: "Loka" < [hidden email] >
> > Sent: Thursday, November 14, 2013 8:38:17 PM
> > Subject: Re: exceeded limit of maxWarmingSearchers ERROR
> >
> > CommitWithin is either configured in solrconfig.xml for the
> > <autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
> > recommend you do use this.
> >
> > The other way you can do it is if you're using SolrJ, one of the
> > forms of the server.add() method takes a number of milliseconds
> > to force a commit.
> >
> > You really, really do NOT want to use ridiculously short times for this
> > like a few milliseconds. That will cause new searchers to be
> > warmed, and when too many of them are warming at once you
> > get this error.
> >
> > Seriously, make your commitWithin or autocommit parameters
> > as long as you can, for many reasons.
> >
> > Here's a bunch of background:
> >
> >
> http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
> >
> > Best,
> > Erick
> >
> >
> > On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
> >
> >
> > > Hi Naveen,
> > > Iam also getting the similar problem where I do not know how to use the
> > > commitWithin Tag, can you help me how to use commitWithin Tag. can you
> > give
> > > me the example
> > >
> > >
> > >
> > > --
> > > View this message in context:
> > >
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> > > Sent from the Solr - User mailing list archive at Nabble.com.
> > >
> >
> >
> >
> >
> >
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
> > To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> > here .
> > NAML
> >
> > solr-spring.xml (2K) <
> > http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml >
> > messaging-spring.xml (2K) <
> >
> http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml
> > >
> > schema.xml (6K) <
> > http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml >
> > solrconfig.xml (61K) <
> > http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml >
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
>
>
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101203.html
> To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> here .
> NAML
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101209.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101220.html
To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click here .
NAML
solr_spring.xml (2K) <http://lucene.472066.n3.nabble.com/attachment/4101624/0/solr_spring.xml>
Liferay_Solr_Error_Log.txt (2K) <http://lucene.472066.n3.nabble.com/attachment/4101624/1/Liferay_Solr_Error_Log.txt>
--
View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101624.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Erick Erickson <er...@gmail.com>.
That's a fine place to start. This form:
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
just allows you to define a sysvar to override the 15 second default, like
java -Dsolr.autoCommti.maxTime=30000 -jar start.jar
On Fri, Nov 15, 2013 at 8:11 AM, Loka <lo...@zensar.in> wrote:
> Hi Erickson,
>
> I have seen the following also from google, can I use the same in
> <updateHandler class="solr.DirectUpdateHandler2">:
> <commitWithin> <softCommit>false</softCommit></commitWithin>
>
> If the above one is correct to add, can I add the below tags aslo in
> <updateHandler class="solr.DirectUpdateHandler2"> along with the above tag:
>
> <autoCommit>
> <maxTime>30000</maxTime>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>10000</maxTime>
> </autoSoftCommit>
>
>
> so finally, it will look like as:
>
> <updateHandler class="solr.DirectUpdateHandler2">
> <autoCommit>
> <maxTime>30000</maxTime>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>10000</maxTime>
> </autoSoftCommit>
> <commitWithin> <softCommit>false</softCommit></commitWithin>
>
> </updateHandler>
>
>
> Is the above one fine?
>
>
> Regards,
> Lokanadham Ganta
>
>
>
>
> ----- Original Message -----
> From: "Lokanadham Ganta" <lo...@zensar.in>
> To: "Erick Erickson [via Lucene]" <
> ml-node+s472066n4101203h31@n3.nabble.com>
> Sent: Friday, November 15, 2013 6:33:20 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> Erickson,
>
> Thanks for your reply, before your reply, I have googled and found the
> following and added under
> <updateHandler class="solr.DirectUpdateHandler2"> tag of solrconfig.xml
> file.
>
>
> <autoCommit>
> <maxTime>30000</maxTime>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>10000</maxTime>
> </autoSoftCommit>
>
> Is the above one is fine or should I go strictly as per ypur suggestion
> means as below:
>
> <autoCommit>
> <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> <openSearcher>false</openSearcher>
> </autoCommit>
>
> <!-- softAutoCommit is like autoCommit except it causes a
> 'soft' commit which only ensures that changes are visible
> but does not ensure that data is synced to disk. This is
> faster and more near-realtime friendly than a hard commit.
> -->
>
> <autoSoftCommit>
> <maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
> </autoSoftCommit>
>
>
>
> Please confirm me.
>
> But how can I check how much autowarming that Iam doing, as of now I have
> set the maxWarmingSearchers as 2, should I increase the value?
>
>
> Regards,
> Lokanadham Ganta
>
>
> ----- Original Message -----
> From: "Erick Erickson [via Lucene]" <
> ml-node+s472066n4101203h31@n3.nabble.com>
> To: "Loka" <lo...@zensar.in>
> Sent: Friday, November 15, 2013 6:07:12 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> Where did you get that syntax? I've never seen that before.
>
> What you want to configure is the "maxTime" in your
> autocommit and autosoftcommit sections of solrconfig.xml,
> as:
>
> <autoCommit>
> <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> <openSearcher>false</openSearcher>
> </autoCommit>
>
> <!-- softAutoCommit is like autoCommit except it causes a
> 'soft' commit which only ensures that changes are visible
> but does not ensure that data is synced to disk. This is
> faster and more near-realtime friendly than a hard commit.
> -->
>
> <autoSoftCommit>
> <maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
> </autoSoftCommit>
>
> And you do NOT want to commit from your client.
>
> Depending on how long autowarm takes, you may still see this error,
> so check how much autowarming you're doing, i.e. how you've
> configured the caches in solrconfig.xml and what you
> have for newSearcher and firstSearcher.
>
> I'd start with autowarm numbers of, maybe, 16 or so at most.
>
> Best,
> Erick
>
>
> On Fri, Nov 15, 2013 at 2:46 AM, Loka < [hidden email] > wrote:
>
>
> > Hi Erickson,
> >
> > Thanks for your reply, basically, I used commitWithin tag as below in
> > solrconfig.xml file
> >
> >
> > <requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
> > <lst name="defaults">
> > <str name="update.processor">dedupe</str>
> > </lst>
> > <add commitWithin="10000"/>
> > </requestHandler>
> >
> > <updateRequestProcessorChain name="dedupe">
> > <processor
> > class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
> > <bool name="enabled">true</bool>
> > <str name="signatureField">id</str>
> > <bool name="overwriteDupes">false</bool>
> > <str name="fields">name,features,cat</str>
> > <str
> >
> name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
> > </processor>
> > <processor class="solr.LogUpdateProcessorFactory" />
> > <processor class="solr.RunUpdateProcessorFactory" />
> > </updateRequestProcessorChain>
> >
> >
> > But this fix did not solve my problem, I mean I again got the same error.
> > PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
> > messaging-spring.xml, can you sugest me where Iam doing wrong.
> >
> > Regards,
> > Lokanadham Ganta
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > ----- Original Message -----
> > From: "Erick Erickson [via Lucene]" <
> > [hidden email] >
> > To: "Loka" < [hidden email] >
> > Sent: Thursday, November 14, 2013 8:38:17 PM
> > Subject: Re: exceeded limit of maxWarmingSearchers ERROR
> >
> > CommitWithin is either configured in solrconfig.xml for the
> > <autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
> > recommend you do use this.
> >
> > The other way you can do it is if you're using SolrJ, one of the
> > forms of the server.add() method takes a number of milliseconds
> > to force a commit.
> >
> > You really, really do NOT want to use ridiculously short times for this
> > like a few milliseconds. That will cause new searchers to be
> > warmed, and when too many of them are warming at once you
> > get this error.
> >
> > Seriously, make your commitWithin or autocommit parameters
> > as long as you can, for many reasons.
> >
> > Here's a bunch of background:
> >
> >
> http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
> >
> > Best,
> > Erick
> >
> >
> > On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
> >
> >
> > > Hi Naveen,
> > > Iam also getting the similar problem where I do not know how to use the
> > > commitWithin Tag, can you help me how to use commitWithin Tag. can you
> > give
> > > me the example
> > >
> > >
> > >
> > > --
> > > View this message in context:
> > >
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> > > Sent from the Solr - User mailing list archive at Nabble.com.
> > >
> >
> >
> >
> >
> >
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
> > To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> > here .
> > NAML
> >
> > solr-spring.xml (2K) <
> > http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml>
> > messaging-spring.xml (2K) <
> >
> http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml
> > >
> > schema.xml (6K) <
> > http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml >
> > solrconfig.xml (61K) <
> > http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml >
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
>
>
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101203.html
> To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> here .
> NAML
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101209.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Loka <lo...@zensar.in>.
Hi Erickson,
I have seen the following also from google, can I use the same in <updateHandler class="solr.DirectUpdateHandler2">:
<commitWithin> <softCommit>false</softCommit></commitWithin>
If the above one is correct to add, can I add the below tags aslo in <updateHandler class="solr.DirectUpdateHandler2"> along with the above tag:
<autoCommit>
<maxTime>30000</maxTime>
</autoCommit>
<autoSoftCommit>
<maxTime>10000</maxTime>
</autoSoftCommit>
so finally, it will look like as:
<updateHandler class="solr.DirectUpdateHandler2">
<autoCommit>
<maxTime>30000</maxTime>
</autoCommit>
<autoSoftCommit>
<maxTime>10000</maxTime>
</autoSoftCommit>
<commitWithin> <softCommit>false</softCommit></commitWithin>
</updateHandler>
Is the above one fine?
Regards,
Lokanadham Ganta
----- Original Message -----
From: "Lokanadham Ganta" <lo...@zensar.in>
To: "Erick Erickson [via Lucene]" <ml...@n3.nabble.com>
Sent: Friday, November 15, 2013 6:33:20 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Erickson,
Thanks for your reply, before your reply, I have googled and found the following and added under
<updateHandler class="solr.DirectUpdateHandler2"> tag of solrconfig.xml file.
<autoCommit>
<maxTime>30000</maxTime>
</autoCommit>
<autoSoftCommit>
<maxTime>10000</maxTime>
</autoSoftCommit>
Is the above one is fine or should I go strictly as per ypur suggestion means as below:
<autoCommit>
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
<openSearcher>false</openSearcher>
</autoCommit>
<!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
-->
<autoSoftCommit>
<maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
</autoSoftCommit>
Please confirm me.
But how can I check how much autowarming that Iam doing, as of now I have set the maxWarmingSearchers as 2, should I increase the value?
Regards,
Lokanadham Ganta
----- Original Message -----
From: "Erick Erickson [via Lucene]" <ml...@n3.nabble.com>
To: "Loka" <lo...@zensar.in>
Sent: Friday, November 15, 2013 6:07:12 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Where did you get that syntax? I've never seen that before.
What you want to configure is the "maxTime" in your
autocommit and autosoftcommit sections of solrconfig.xml,
as:
<autoCommit>
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
<openSearcher>false</openSearcher>
</autoCommit>
<!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
-->
<autoSoftCommit>
<maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
</autoSoftCommit>
And you do NOT want to commit from your client.
Depending on how long autowarm takes, you may still see this error,
so check how much autowarming you're doing, i.e. how you've
configured the caches in solrconfig.xml and what you
have for newSearcher and firstSearcher.
I'd start with autowarm numbers of, maybe, 16 or so at most.
Best,
Erick
On Fri, Nov 15, 2013 at 2:46 AM, Loka < [hidden email] > wrote:
> Hi Erickson,
>
> Thanks for your reply, basically, I used commitWithin tag as below in
> solrconfig.xml file
>
>
> <requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
> <lst name="defaults">
> <str name="update.processor">dedupe</str>
> </lst>
> <add commitWithin="10000"/>
> </requestHandler>
>
> <updateRequestProcessorChain name="dedupe">
> <processor
> class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
> <bool name="enabled">true</bool>
> <str name="signatureField">id</str>
> <bool name="overwriteDupes">false</bool>
> <str name="fields">name,features,cat</str>
> <str
> name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
> </processor>
> <processor class="solr.LogUpdateProcessorFactory" />
> <processor class="solr.RunUpdateProcessorFactory" />
> </updateRequestProcessorChain>
>
>
> But this fix did not solve my problem, I mean I again got the same error.
> PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
> messaging-spring.xml, can you sugest me where Iam doing wrong.
>
> Regards,
> Lokanadham Ganta
>
>
>
>
>
>
>
>
>
>
> ----- Original Message -----
> From: "Erick Erickson [via Lucene]" <
> [hidden email] >
> To: "Loka" < [hidden email] >
> Sent: Thursday, November 14, 2013 8:38:17 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> CommitWithin is either configured in solrconfig.xml for the
> <autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
> recommend you do use this.
>
> The other way you can do it is if you're using SolrJ, one of the
> forms of the server.add() method takes a number of milliseconds
> to force a commit.
>
> You really, really do NOT want to use ridiculously short times for this
> like a few milliseconds. That will cause new searchers to be
> warmed, and when too many of them are warming at once you
> get this error.
>
> Seriously, make your commitWithin or autocommit parameters
> as long as you can, for many reasons.
>
> Here's a bunch of background:
>
> http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
>
> Best,
> Erick
>
>
> On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
>
>
> > Hi Naveen,
> > Iam also getting the similar problem where I do not know how to use the
> > commitWithin Tag, can you help me how to use commitWithin Tag. can you
> give
> > me the example
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
>
>
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
> To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> here .
> NAML
>
> solr-spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml >
> messaging-spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml
> >
> schema.xml (6K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml >
> solrconfig.xml (61K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml >
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101203.html
To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click here .
NAML
--
View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101209.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Erick Erickson <er...@gmail.com>.
Where did you get that syntax? I've never seen that before.
What you want to configure is the "maxTime" in your
autocommit and autosoftcommit sections of solrconfig.xml,
as:
<autoCommit>
<maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
<openSearcher>false</openSearcher>
</autoCommit>
<!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
-->
<autoSoftCommit>
<maxTime>${solr.autoSoftCommit.maxTime:10000}</maxTime>
</autoSoftCommit>
And you do NOT want to commit from your client.
Depending on how long autowarm takes, you may still see this error,
so check how much autowarming you're doing, i.e. how you've
configured the caches in solrconfig.xml and what you
have for newSearcher and firstSearcher.
I'd start with autowarm numbers of, maybe, 16 or so at most.
Best,
Erick
On Fri, Nov 15, 2013 at 2:46 AM, Loka <lo...@zensar.in> wrote:
> Hi Erickson,
>
> Thanks for your reply, basically, I used commitWithin tag as below in
> solrconfig.xml file
>
>
> <requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
> <lst name="defaults">
> <str name="update.processor">dedupe</str>
> </lst>
> <add commitWithin="10000"/>
> </requestHandler>
>
> <updateRequestProcessorChain name="dedupe">
> <processor
> class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
> <bool name="enabled">true</bool>
> <str name="signatureField">id</str>
> <bool name="overwriteDupes">false</bool>
> <str name="fields">name,features,cat</str>
> <str
> name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
> </processor>
> <processor class="solr.LogUpdateProcessorFactory" />
> <processor class="solr.RunUpdateProcessorFactory" />
> </updateRequestProcessorChain>
>
>
> But this fix did not solve my problem, I mean I again got the same error.
> PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
> messaging-spring.xml, can you sugest me where Iam doing wrong.
>
> Regards,
> Lokanadham Ganta
>
>
>
>
>
>
>
>
>
>
> ----- Original Message -----
> From: "Erick Erickson [via Lucene]" <
> ml-node+s472066n4100924h82@n3.nabble.com>
> To: "Loka" <lo...@zensar.in>
> Sent: Thursday, November 14, 2013 8:38:17 PM
> Subject: Re: exceeded limit of maxWarmingSearchers ERROR
>
> CommitWithin is either configured in solrconfig.xml for the
> <autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
> recommend you do use this.
>
> The other way you can do it is if you're using SolrJ, one of the
> forms of the server.add() method takes a number of milliseconds
> to force a commit.
>
> You really, really do NOT want to use ridiculously short times for this
> like a few milliseconds. That will cause new searchers to be
> warmed, and when too many of them are warming at once you
> get this error.
>
> Seriously, make your commitWithin or autocommit parameters
> as long as you can, for many reasons.
>
> Here's a bunch of background:
>
> http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
>
> Best,
> Erick
>
>
> On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
>
>
> > Hi Naveen,
> > Iam also getting the similar problem where I do not know how to use the
> > commitWithin Tag, can you help me how to use commitWithin Tag. can you
> give
> > me the example
> >
> >
> >
> > --
> > View this message in context:
> >
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
> >
>
>
>
>
>
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
> To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click
> here .
> NAML
>
> solr-spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml>
> messaging-spring.xml (2K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml
> >
> schema.xml (6K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml>
> solrconfig.xml (61K) <
> http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml>
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Loka <lo...@zensar.in>.
Hi Erickson,
Thanks for your reply, basically, I used commitWithin tag as below in solrconfig.xml file
<requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
<lst name="defaults">
<str name="update.processor">dedupe</str>
</lst>
<add commitWithin="10000"/>
</requestHandler>
<updateRequestProcessorChain name="dedupe">
<processor class="org.apache.solr.update.processor.SignatureUpdateProcessorFactory">
<bool name="enabled">true</bool>
<str name="signatureField">id</str>
<bool name="overwriteDupes">false</bool>
<str name="fields">name,features,cat</str>
<str name="signatureClass">org.apache.solr.update.processor.Lookup3Signature</str>
</processor>
<processor class="solr.LogUpdateProcessorFactory" />
<processor class="solr.RunUpdateProcessorFactory" />
</updateRequestProcessorChain>
But this fix did not solve my problem, I mean I again got the same error.
PFA of schema.xml and solrconfig.xml file, solr-spring.xml, messaging-spring.xml, can you sugest me where Iam doing wrong.
Regards,
Lokanadham Ganta
----- Original Message -----
From: "Erick Erickson [via Lucene]" <ml...@n3.nabble.com>
To: "Loka" <lo...@zensar.in>
Sent: Thursday, November 14, 2013 8:38:17 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
CommitWithin is either configured in solrconfig.xml for the
<autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
recommend you do use this.
The other way you can do it is if you're using SolrJ, one of the
forms of the server.add() method takes a number of milliseconds
to force a commit.
You really, really do NOT want to use ridiculously short times for this
like a few milliseconds. That will cause new searchers to be
warmed, and when too many of them are warming at once you
get this error.
Seriously, make your commitWithin or autocommit parameters
as long as you can, for many reasons.
Here's a bunch of background:
http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
Best,
Erick
On Thu, Nov 14, 2013 at 5:13 AM, Loka < [hidden email] > wrote:
> Hi Naveen,
> Iam also getting the similar problem where I do not know how to use the
> commitWithin Tag, can you help me how to use commitWithin Tag. can you give
> me the example
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html
To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click here .
NAML
solr-spring.xml (2K) <http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml>
messaging-spring.xml (2K) <http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml>
schema.xml (6K) <http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml>
solrconfig.xml (61K) <http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml>
--
View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: exceeded limit of maxWarmingSearchers ERROR
Posted by Erick Erickson <er...@gmail.com>.
CommitWithin is either configured in solrconfig.xml for the
<autoCommit> or <autoSoftCommit> tags as the maxTime tag. I
recommend you do use this.
The other way you can do it is if you're using SolrJ, one of the
forms of the server.add() method takes a number of milliseconds
to force a commit.
You really, really do NOT want to use ridiculously short times for this
like a few milliseconds. That will cause new searchers to be
warmed, and when too many of them are warming at once you
get this error.
Seriously, make your commitWithin or autocommit parameters
as long as you can, for many reasons.
Here's a bunch of background:
http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
Best,
Erick
On Thu, Nov 14, 2013 at 5:13 AM, Loka <lo...@zensar.in> wrote:
> Hi Naveen,
> Iam also getting the similar problem where I do not know how to use the
> commitWithin Tag, can you help me how to use commitWithin Tag. can you give
> me the example
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>