You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Greenhorn Techie <gr...@gmail.com> on 2018/08/13 15:37:56 UTC
Calculating maxShardsPerNode
Hi,
Our cluster is a 20 node with numShards expected to be set to 10 and
replication expected to be 4. Wondering what is the best value to
set maxShardsPerNode to? Should I consider only numShards while calculating
the value i.e. because I have only 10 shards, should I set maxShardsPerNode
to 1or at number of physical replicas i.e. numShards * replicationFactor.
So should I set maxShardsPerNode to 2 because the total physical replicas
are 40 (numShards * replicationFactor) while the number of nodes are only
20?
Please let me know your thoughts.
Thanks
Re: Calculating maxShardsPerNode
Posted by Greenhorn Techie <gr...@gmail.com>.
Thanks Erick!
On 13 August 2018 at 17:05:57, Erick Erickson (erickerickson@gmail.com)
wrote:
I wouldn't spend a lot of time worrying about this, just set it to a
big number ;).
Solr won't create that many replicas (and the name is a bit confusing)
unless you ask it to. It'll also distribute the replicas across nodes
rather than putting them all together, and in the worst case you can
place them individually yourself.
This is more a safety valve to keep from doing ridiculous things, like
telling Solr to create 1,000 replicas on 2 hosts or something.
Best,
Erick
On Mon, Aug 13, 2018 at 8:37 AM, Greenhorn Techie
<gr...@gmail.com> wrote:
> Hi,
>
> Our cluster is a 20 node with numShards expected to be set to 10 and
> replication expected to be 4. Wondering what is the best value to
> set maxShardsPerNode to? Should I consider only numShards while
calculating
> the value i.e. because I have only 10 shards, should I set
maxShardsPerNode
> to 1or at number of physical replicas i.e. numShards * replicationFactor.
> So should I set maxShardsPerNode to 2 because the total physical replicas
> are 40 (numShards * replicationFactor) while the number of nodes are only
> 20?
>
> Please let me know your thoughts.
>
> Thanks
Re: Calculating maxShardsPerNode
Posted by Erick Erickson <er...@gmail.com>.
I wouldn't spend a lot of time worrying about this, just set it to a
big number ;).
Solr won't create that many replicas (and the name is a bit confusing)
unless you ask it to. It'll also distribute the replicas across nodes
rather than putting them all together, and in the worst case you can
place them individually yourself.
This is more a safety valve to keep from doing ridiculous things, like
telling Solr to create 1,000 replicas on 2 hosts or something.
Best,
Erick
On Mon, Aug 13, 2018 at 8:37 AM, Greenhorn Techie
<gr...@gmail.com> wrote:
> Hi,
>
> Our cluster is a 20 node with numShards expected to be set to 10 and
> replication expected to be 4. Wondering what is the best value to
> set maxShardsPerNode to? Should I consider only numShards while calculating
> the value i.e. because I have only 10 shards, should I set maxShardsPerNode
> to 1or at number of physical replicas i.e. numShards * replicationFactor.
> So should I set maxShardsPerNode to 2 because the total physical replicas
> are 40 (numShards * replicationFactor) while the number of nodes are only
> 20?
>
> Please let me know your thoughts.
>
> Thanks