Having replica will slow down Solr?

[Zheng Lin Edwin Yeo <ed...@gmail.com>]

Hi,

I would like to find out, will having a replica slow down the search for
Solr?

Currently, I'm having 1 shard and a replicationFactor of 2 using Solr
5.3.0. I'm running SolrCloud, with 3 external ZooKeeper using ZooKeeper
3.4.6, and my index size is 183GB.

I have been getting QTime of more than 3000ms for my basic search function,
even without adding other things like faceting or highlighting.

Regards,
Edwin

Re: Having replica will slow down Solr?

[Binoy Dalal <bi...@gmail.com>]

1) If your stored fields are very large, it will lead to high response
times since solr will have to decompress the field and then return the
whole thing. I had faced such an issue with one of my implementations where
we had stored fields around 100KB of text per document and the response
times were through the roof. To get around this, we simply highlighted the
stored field being returned and returned the highlights. That got us to
sub-100ms response times. See if this is something you can do.
2) Your subsequent searches will be quicker since your caches are warmed up
and some of your queries then return from the cache itself. For the initial
stages, you should warm up your cache before a new searcher opens by using
either the autowarming feature or explicitly using warming queries to
populate the cache. This should give you some information:
https://wiki.apache.org/solr/SolrCaching

On Thu, Dec 31, 2015 at 8:59 AM Zheng Lin Edwin Yeo <ed...@gmail.com>
wrote:

> Hi DavidPhilip,
>
> What are your memory configs: xms and xmx values, available ram size?
> > I'm using Solr 5.3.0, so I've only set the -Xmx value at 14g. My
> available RAM size is 64GB
>
> Were you also indexing at the time when the search response was so slow? In
> the sense, were you committing often with openSearcher=true, in any case?
> > I wasn't doing any indexing at that time the search response was so slow.
>
> What is the QTime for consequent searches? Are the caches enabled?
> > The QTime for consequent searches are quite fast, usually less than
> 500ms. The caches are enabled.
>
> Regards,
> Edwin
>
>
> On 30 December 2015 at 16:40, davidphilip cherian <
> davidphilipcherian@gmail.com> wrote:
>
> > Few questions:
> >
> > What are your memory configs: xms and xmx values, available ram size?
> >
> > Were you also indexing at the time when the search response was so slow?
> In
> > the sense, were you committing often with openSearcher=true, in any case?
> >
> > What is the QTime for consequent searches? Are the caches enabled?
> >
> >
> >
> >
> >
> >
> > On Wed, Dec 30, 2015 at 1:50 PM, Binoy Dalal <bi...@gmail.com>
> > wrote:
> >
> > > If I understand the cloud setup correctly having a replica will serve
> for
> > > redundancy and won't slow your searches down.
> > > In your case for the slow response times, are you returning any large
> > > stored fields?
> > >
> > > On Wed, 30 Dec 2015, 13:26 Zheng Lin Edwin Yeo <ed...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I would like to find out, will having a replica slow down the search
> > for
> > > > Solr?
> > > >
> > > > Currently, I'm having 1 shard and a replicationFactor of 2 using Solr
> > > > 5.3.0. I'm running SolrCloud, with 3 external ZooKeeper using
> ZooKeeper
> > > > 3.4.6, and my index size is 183GB.
> > > >
> > > > I have been getting QTime of more than 3000ms for my basic search
> > > function,
> > > > even without adding other things like faceting or highlighting.
> > > >
> > > > Regards,
> > > > Edwin
> > > >
> > > --
> > > Regards,
> > > Binoy Dalal
> > >
> >
>
-- 
Regards,
Binoy Dalal

Re: Having replica will slow down Solr?

[Zheng Lin Edwin Yeo <ed...@gmail.com>]

Hi DavidPhilip,

What are your memory configs: xms and xmx values, available ram size?
> I'm using Solr 5.3.0, so I've only set the -Xmx value at 14g. My
available RAM size is 64GB

Were you also indexing at the time when the search response was so slow? In
the sense, were you committing often with openSearcher=true, in any case?
> I wasn't doing any indexing at that time the search response was so slow.

What is the QTime for consequent searches? Are the caches enabled?
> The QTime for consequent searches are quite fast, usually less than
500ms. The caches are enabled.

Regards,
Edwin


On 30 December 2015 at 16:40, davidphilip cherian <
davidphilipcherian@gmail.com> wrote:

> Few questions:
>
> What are your memory configs: xms and xmx values, available ram size?
>
> Were you also indexing at the time when the search response was so slow? In
> the sense, were you committing often with openSearcher=true, in any case?
>
> What is the QTime for consequent searches? Are the caches enabled?
>
>
>
>
>
>
> On Wed, Dec 30, 2015 at 1:50 PM, Binoy Dalal <bi...@gmail.com>
> wrote:
>
> > If I understand the cloud setup correctly having a replica will serve for
> > redundancy and won't slow your searches down.
> > In your case for the slow response times, are you returning any large
> > stored fields?
> >
> > On Wed, 30 Dec 2015, 13:26 Zheng Lin Edwin Yeo <ed...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I would like to find out, will having a replica slow down the search
> for
> > > Solr?
> > >
> > > Currently, I'm having 1 shard and a replicationFactor of 2 using Solr
> > > 5.3.0. I'm running SolrCloud, with 3 external ZooKeeper using ZooKeeper
> > > 3.4.6, and my index size is 183GB.
> > >
> > > I have been getting QTime of more than 3000ms for my basic search
> > function,
> > > even without adding other things like faceting or highlighting.
> > >
> > > Regards,
> > > Edwin
> > >
> > --
> > Regards,
> > Binoy Dalal
> >
>

Re: Having replica will slow down Solr?

[davidphilip cherian <da...@gmail.com>]

Few questions:

What are your memory configs: xms and xmx values, available ram size?

Were you also indexing at the time when the search response was so slow? In
the sense, were you committing often with openSearcher=true, in any case?

What is the QTime for consequent searches? Are the caches enabled?






On Wed, Dec 30, 2015 at 1:50 PM, Binoy Dalal <bi...@gmail.com> wrote:

> If I understand the cloud setup correctly having a replica will serve for
> redundancy and won't slow your searches down.
> In your case for the slow response times, are you returning any large
> stored fields?
>
> On Wed, 30 Dec 2015, 13:26 Zheng Lin Edwin Yeo <ed...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I would like to find out, will having a replica slow down the search for
> > Solr?
> >
> > Currently, I'm having 1 shard and a replicationFactor of 2 using Solr
> > 5.3.0. I'm running SolrCloud, with 3 external ZooKeeper using ZooKeeper
> > 3.4.6, and my index size is 183GB.
> >
> > I have been getting QTime of more than 3000ms for my basic search
> function,
> > even without adding other things like faceting or highlighting.
> >
> > Regards,
> > Edwin
> >
> --
> Regards,
> Binoy Dalal
>

Re: Having replica will slow down Solr?

[Zheng Lin Edwin Yeo <ed...@gmail.com>]

Hi Binoy,

The only large stored field I have is content, which is indexed from the
content of the rich text documents.

Regards,
Edwin


On 30 December 2015 at 16:20, Binoy Dalal <bi...@gmail.com> wrote:

> If I understand the cloud setup correctly having a replica will serve for
> redundancy and won't slow your searches down.
> In your case for the slow response times, are you returning any large
> stored fields?
>
> On Wed, 30 Dec 2015, 13:26 Zheng Lin Edwin Yeo <ed...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I would like to find out, will having a replica slow down the search for
> > Solr?
> >
> > Currently, I'm having 1 shard and a replicationFactor of 2 using Solr
> > 5.3.0. I'm running SolrCloud, with 3 external ZooKeeper using ZooKeeper
> > 3.4.6, and my index size is 183GB.
> >
> > I have been getting QTime of more than 3000ms for my basic search
> function,
> > even without adding other things like faceting or highlighting.
> >
> > Regards,
> > Edwin
> >
> --
> Regards,
> Binoy Dalal
>

Re: Having replica will slow down Solr?

[Binoy Dalal <bi...@gmail.com>]

If I understand the cloud setup correctly having a replica will serve for
redundancy and won't slow your searches down.
In your case for the slow response times, are you returning any large
stored fields?

On Wed, 30 Dec 2015, 13:26 Zheng Lin Edwin Yeo <ed...@gmail.com> wrote:

> Hi,
>
> I would like to find out, will having a replica slow down the search for
> Solr?
>
> Currently, I'm having 1 shard and a replicationFactor of 2 using Solr
> 5.3.0. I'm running SolrCloud, with 3 external ZooKeeper using ZooKeeper
> 3.4.6, and my index size is 183GB.
>
> I have been getting QTime of more than 3000ms for my basic search function,
> even without adding other things like faceting or highlighting.
>
> Regards,
> Edwin
>
-- 
Regards,
Binoy Dalal