You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by sivaprasad <si...@echidnainc.com> on 2014/01/06 09:18:33 UTC
Slowness of Solr search during the replication
Hi,
I have configured Solr salve replication for every 1hr. During this time I
am seeing my search is unresponsive. Any other architectural changes do we
need to do to overcome this?
I am giving some cache details which I have in my solrconfig.xml.
<filterCache class="solr.FastLRUCache"
size="512"
initialSize="512" cleanupThread="true"
autowarmCount="0"/>
<queryResultCache class="solr.LRUCache"
size="512"
initialSize="512"
autowarmCount="0"/>
<documentCache class="solr.LRUCache"
size="512"
initialSize="512"
autowarmCount="0"/>
<fieldValueCache class="solr.FastLRUCache"
size="512" cleanupThread="true"
autowarmCount="128"
showItems="32" />
<useFilterForSortedQuery>true</useFilterForSortedQuery>
<useColdSearcher>false</useColdSearcher>
<maxWarmingSearchers>2</maxWarmingSearchers>
Any suggestions are appreciable.
Regards,
Siva <http://smarttechie.org/>
--
View this message in context: http://lucene.472066.n3.nabble.com/Slowness-of-Solr-search-during-the-replication-tp4109712.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Slowness of Solr search during the replication
Posted by Toke Eskildsen <te...@statsbiblioteket.dk>.
On Mon, 2014-01-06 at 09:18 +0100, sivaprasad wrote:
> I have configured Solr salve replication for every 1hr. During this time I
> am seeing my search is unresponsive.
Unresponsive as in waiting for the updated searcher to be ready or as in
very slow while the replication is ongoing?
- Toke Eskildsen
Re: Slowness of Solr search during the replication
Posted by Mikhail Khludnev <mk...@griddynamics.com>.
Hello Siva,
Do you have an idea what make them freeze?
Ideally you might be able to take a thread-dump at the moment of freeze, if
you can.
Also, check SolrIndexSearcher debug logs for autowarming timing.
What about specifying few heaviest query in newSearcher listener
https://cwiki.apache.org/confluence/display/solr/Query+Settings+in+SolrConfig#QuerySettingsinSolrConfig-Query-RelatedListeners?
+1 for bumping auto-warming on slaves.
On Mon, Jan 6, 2014 at 4:34 PM, sivaprasad <si...@echidnainc.com>wrote:
> Do we need to set the autowarmCount on Slave or master? As per the Solr
> WIKI,
> I found the below information.
>
> Solr4.0 autowarmCount can now be specified as a percentage (ie: "90%")
> which
> will be evaluated relative to the number of items in the existing cache.
> This can be an advantageous setting in an instance of Solr where you don't
> expect any search traffic (ie a master),
> but you want some caches so that if it does take on traffic it won't be
> too
> overloaded. Once the traffic dies down, subsequent commits will gradually
> decrease the number of items being warmed.
>
> Regards,
> Siva
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Slowness-of-Solr-search-during-the-replication-tp4109712p4109739.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics
<http://www.griddynamics.com>
<mk...@griddynamics.com>
Re: Slowness of Solr search during the replication
Posted by sivaprasad <si...@echidnainc.com>.
Do we need to set the autowarmCount on Slave or master? As per the Solr WIKI,
I found the below information.
Solr4.0 autowarmCount can now be specified as a percentage (ie: "90%") which
will be evaluated relative to the number of items in the existing cache.
This can be an advantageous setting in an instance of Solr where you don't
expect any search traffic (ie a master),
but you want some caches so that if it does take on traffic it won't be too
overloaded. Once the traffic dies down, subsequent commits will gradually
decrease the number of items being warmed.
Regards,
Siva
--
View this message in context: http://lucene.472066.n3.nabble.com/Slowness-of-Solr-search-during-the-replication-tp4109712p4109739.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Slowness of Solr search during the replication
Posted by Erick Erickson <er...@gmail.com>.
The first thing I'd try would be to up the autowarm counts. Don't go
overboard here, I'd suggest, say, 16 of so to start but it depends on your
query mix.
If that doesn't help, you need to add some more details. Some example
queries would be a place to start.
Best
Erick
On Jan 6, 2014 4:19 AM, "sivaprasad" <si...@echidnainc.com> wrote:
> Hi,
>
> I have configured Solr salve replication for every 1hr. During this time I
> am seeing my search is unresponsive. Any other architectural changes do we
> need to do to overcome this?
>
> I am giving some cache details which I have in my solrconfig.xml.
>
> <filterCache class="solr.FastLRUCache"
> size="512"
> initialSize="512" cleanupThread="true"
> autowarmCount="0"/>
>
>
>
> <queryResultCache class="solr.LRUCache"
> size="512"
> initialSize="512"
> autowarmCount="0"/>
>
>
>
> <documentCache class="solr.LRUCache"
> size="512"
> initialSize="512"
> autowarmCount="0"/>
>
> <fieldValueCache class="solr.FastLRUCache"
> size="512" cleanupThread="true"
> autowarmCount="128"
> showItems="32" />
>
> <useFilterForSortedQuery>true</useFilterForSortedQuery>
> <useColdSearcher>false</useColdSearcher>
> <maxWarmingSearchers>2</maxWarmingSearchers>
>
> Any suggestions are appreciable.
>
> Regards,
> Siva <http://smarttechie.org/>
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Slowness-of-Solr-search-during-the-replication-tp4109712.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>