You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by Rallavagu <ra...@gmail.com> on 2016/09/09 16:03:32 UTC

ConcurrentUpdateSolrClient threads

All,

Running Solr 5.4.1 with embedded Jetty with frequent updates coming in 
and softCommit is set to 10 min. What I am noticing is occasional "slow" 
updates (takes 8 sec to 15 sec sometimes) and about the same time slow 
QTimes. Upon investigating, it appears that 
"ConcurrentUpdateSolrClient:blockUntilFinished:429" is waiting on thread 
to be free. Looking at https://issues.apache.org/jira/browse/SOLR-8500 
it appears that it presents with an option to increase the number of 
threads that might help with managing more updates without having to 
wait (though need to update Solr to 5.5). I could not figure out the 
default number of threads for ConcurrentUpdateSolrClient class. Before I 
can try increasing number of threads, wondering if there are any 
"gotchas" increasing the number of threads and what is the reasonable 
number of the threads if so?


org.apache.solr.update.SolrCmdDistributor:finish:90 (method time = 0 ms, 
total time = 7489 ms)
  org.apache.solr.update.SolrCmdDistributor:blockAndDoRetries:232 
(method time = 0 ms, total time = 7489 ms)
   org.apache.solr.update.StreamingSolrClients:blockUntilFinished:107 
(method time = 0 ms, total time = 7489 ms)
 
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient:blockUntilFinished:429 
(method time = 0 ms, total time = 7489 ms)
     java.lang.Object:wait (method time = 7489 ms, total time = 7489 ms)


Thanks in advance

Re: ConcurrentUpdateSolrClient threads

Posted by TerjeAndersen <te...@gmail.com>.

Hi. I'm wondering the same. Some "updateBean" takes a very long time, up to
130 000 ms. Typically it takes around 100 ms. I'm using 2 threads and a
queue size of 30. Haven't figured out what the default thread size is? 0?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: ConcurrentUpdateSolrClient threads

Posted by Rallavagu <ra...@gmail.com>.

Any takers?

On 9/9/16 9:03 AM, Rallavagu wrote:
> All,
>
> Running Solr 5.4.1 with embedded Jetty with frequent updates coming in
> and softCommit is set to 10 min. What I am noticing is occasional "slow"
> updates (takes 8 sec to 15 sec sometimes) and about the same time slow
> QTimes. Upon investigating, it appears that
> "ConcurrentUpdateSolrClient:blockUntilFinished:429" is waiting on thread
> to be free. Looking at https://issues.apache.org/jira/browse/SOLR-8500
> it appears that it presents with an option to increase the number of
> threads that might help with managing more updates without having to
> wait (though need to update Solr to 5.5). I could not figure out the
> default number of threads for ConcurrentUpdateSolrClient class. Before I
> can try increasing number of threads, wondering if there are any
> "gotchas" increasing the number of threads and what is the reasonable
> number of the threads if so?
>
>
> org.apache.solr.update.SolrCmdDistributor:finish:90 (method time = 0 ms,
> total time = 7489 ms)
>  org.apache.solr.update.SolrCmdDistributor:blockAndDoRetries:232 (method
> time = 0 ms, total time = 7489 ms)
>   org.apache.solr.update.StreamingSolrClients:blockUntilFinished:107
> (method time = 0 ms, total time = 7489 ms)
>
> org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient:blockUntilFinished:429
> (method time = 0 ms, total time = 7489 ms)
>     java.lang.Object:wait (method time = 7489 ms, total time = 7489 ms)
>
>
> Thanks in advance