You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Aman Tandon <am...@gmail.com> on 2015/05/28 05:44:52 UTC
SolrCloud: Creating more shard at runtime will lower down the load?
Hi,
I have a question regarding the solr cloud. The load on our search server
are increasing day by day as our no of visitors are keep on increasing.
So I have a scenario, I want to slice the data at the Runtime, by creating
the more shards of the data.
*i)* Does it affect the current queries
*ii)* Does it lower down the load on our search servers?
With Regards
Aman Tandon
Re: SolrCloud: Creating more shard at runtime will lower down the load?
Posted by Aman Tandon <am...@gmail.com>.
Thank you Alessandro.
With Regards
Aman Tandon
On Thu, May 28, 2015 at 3:57 PM, Alessandro Benedetti <
benedetti.alex85@gmail.com> wrote:
> Hi Aman,
> this feature can be interesting for you :
>
> > Shard Splitting
> >
> > When you create a collection in SolrCloud, you decide on the initial
> > number shards to be used. But it can be difficult to know in advance the
> > number of shards that you need, particularly when organizational
> > requirements can change at a moment's notice, and the cost of finding out
> > later that you chose wrong can be high, involving creating new cores and
> > re-indexing all of your data.
> >
> > The ability to split shards is in the Collections API. It currently
> allows
> > splitting a shard into two pieces. The existing shard is left as-is, so
> the
> > split action effectively makes two copies of the data as new shards. You
> > can delete the old shard at a later time when you're ready.
> >
> > More details on how to use shard splitting is in the section on the
> Collections
> > API <https://cwiki.apache.org/confluence/display/solr/Collections+API>.
> >
>
> To answer to your questions :
>
> 1) If your shard is properly splitter, and you use Solr Cloud to distribute
> the requests and load balancing, the users will not see anything
> 2) Of course it is but you must be careful, because maybe you want to add
> replicas if the amount of load is your concern.
>
> Usually sharing is because an increasing amount of content to process and
> search.
> Adding replication is because an increasing demand of queries and high load
> for the servers.
>
> Let me know more details if you like !
>
> Cheers
>
> 2015-05-28 4:44 GMT+01:00 Aman Tandon <am...@gmail.com>:
>
> > Hi,
> >
> > I have a question regarding the solr cloud. The load on our search server
> > are increasing day by day as our no of visitors are keep on increasing.
> >
> > So I have a scenario, I want to slice the data at the Runtime, by
> creating
> > the more shards of the data.
> >
> > *i)* Does it affect the current queries
> > *ii)* Does it lower down the load on our search servers?
> >
> > With Regards
> > Aman Tandon
> >
>
>
>
> --
> --------------------------
>
> Benedetti Alessandro
> Visiting card : http://about.me/alessandro_benedetti
>
> "Tyger, tyger burning bright
> In the forests of the night,
> What immortal hand or eye
> Could frame thy fearful symmetry?"
>
> William Blake - Songs of Experience -1794 England
>
Re: SolrCloud: Creating more shard at runtime will lower down the load?
Posted by Alessandro Benedetti <be...@gmail.com>.
Hi Aman,
this feature can be interesting for you :
> Shard Splitting
>
> When you create a collection in SolrCloud, you decide on the initial
> number shards to be used. But it can be difficult to know in advance the
> number of shards that you need, particularly when organizational
> requirements can change at a moment's notice, and the cost of finding out
> later that you chose wrong can be high, involving creating new cores and
> re-indexing all of your data.
>
> The ability to split shards is in the Collections API. It currently allows
> splitting a shard into two pieces. The existing shard is left as-is, so the
> split action effectively makes two copies of the data as new shards. You
> can delete the old shard at a later time when you're ready.
>
> More details on how to use shard splitting is in the section on the Collections
> API <https://cwiki.apache.org/confluence/display/solr/Collections+API>.
>
To answer to your questions :
1) If your shard is properly splitter, and you use Solr Cloud to distribute
the requests and load balancing, the users will not see anything
2) Of course it is but you must be careful, because maybe you want to add
replicas if the amount of load is your concern.
Usually sharing is because an increasing amount of content to process and
search.
Adding replication is because an increasing demand of queries and high load
for the servers.
Let me know more details if you like !
Cheers
2015-05-28 4:44 GMT+01:00 Aman Tandon <am...@gmail.com>:
> Hi,
>
> I have a question regarding the solr cloud. The load on our search server
> are increasing day by day as our no of visitors are keep on increasing.
>
> So I have a scenario, I want to slice the data at the Runtime, by creating
> the more shards of the data.
>
> *i)* Does it affect the current queries
> *ii)* Does it lower down the load on our search servers?
>
> With Regards
> Aman Tandon
>
--
--------------------------
Benedetti Alessandro
Visiting card : http://about.me/alessandro_benedetti
"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"
William Blake - Songs of Experience -1794 England