You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by William Bell <bi...@gmail.com> on 2013/05/23 05:14:54 UTC

Approach to apply full index from master to slaves?

We have a 3GB index. We index on the master and then replicate to the
slaves.

But the issue is that after the slaves switch over - we get deadlocking, #
of threads increase to 500, and most times the SOLR instance just plain
locks up.

We tried adding a bunch of warming queries, but we still have a major
performance hit and same issues.

Are there any other tweaks and recommendations? Are others experiencing
this?

-- 
Bill Bell
billnbell@gmail.com
cell 720-256-8076

Re: Approach to apply full index from master to slaves?

Posted by Erick Erickson <er...@gmail.com>.
What's your max warming searcher value?

About warming queries, that may be _adding_ to your problem.
I'd first try removing many of them, especially if you have
your cache autowarm settings very high, try 16 or so.

Autowarming is all about pre-loading the caches etc, but you
reach diminishing returns pretty quickly.

And what are all the threads doing?

Best
Erick

On Wed, May 22, 2013 at 11:14 PM, William Bell <bi...@gmail.com> wrote:
> We have a 3GB index. We index on the master and then replicate to the
> slaves.
>
> But the issue is that after the slaves switch over - we get deadlocking, #
> of threads increase to 500, and most times the SOLR instance just plain
> locks up.
>
> We tried adding a bunch of warming queries, but we still have a major
> performance hit and same issues.
>
> Are there any other tweaks and recommendations? Are others experiencing
> this?
>
> --
> Bill Bell
> billnbell@gmail.com
> cell 720-256-8076