You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Rishi Easwaran <ri...@aol.com> on 2013/05/14 20:58:22 UTC
SOLR Cloud Collection Management quesiotn.
Hi,
I am beginning to work on SOLR cloud implementation.
I created a collection using the collections API
http://myhost:port/solr/admin/collections?action=CREATE&name=testCloud1&numShards=6&replicationFactor=2&collection.configName=myconf&maxShardsPerNode=1
My cluster now has 6 shards and 2 replicas (1 leader & 1 replica) for
each shard.
Now I want to add extra replicas to each shard in my cluster without
out changing the replicationFactor used to create the collection.
Any ideas on how to go about doing that.
Thanks,
Rishi.
Re: SOLR Cloud Collection Management quesiotn.
Posted by Mark Miller <ma...@gmail.com>.
You cannot currently adjust the number of replicas with the collections api - you have to use the core admin api. Which means you determine the replica placement based on what server you hit with the core admin api.
http://wiki.apache.org/solr/SolrCloud#Creating_cores_via_CoreAdmin
Create 2 more nodes via that api, and either don't pass the shard and it will be assigned to the shard with the fewest current replicas, or you can explicitly tell it what shard to join.
- Mark
On May 15, 2013, at 9:57 AM, Rishi Easwaran <ri...@aol.com> wrote:
> Hi Anshum,
>
> What if you have more nodes than shards*replicationFactor.
> In the example below, originally I created the collection to use 6 shards* 2 replicationFactor = 12 nodes total.
> Now I added 6 more nodes, 18 nodes total. I just want to add 1 extra replica per shard.
> How will it get evenly distributed, what is the determining criteria.
>
> Thanks,
>
> Rishi.
>
>
>
> -----Original Message-----
> From: Anshum Gupta <an...@anshumgupta.net>
> To: solr-user <so...@lucene.apache.org>
> Sent: Tue, May 14, 2013 9:42 pm
> Subject: Re: SOLR Cloud Collection Management quesiotn.
>
>
> Hi Rishi,
>
> If you have your cluster up and running, just add the nodes and they will
> get evenly assigned to the shards. As of now, the replication factor is not
> persisted.
>
>
> On Wed, May 15, 2013 at 1:07 AM, Rishi Easwaran <ri...@aol.com>wrote:
>
>> Ok looks like...I have to go to every node, add a replica
> individually,
>> create the cores and add them to the collection.
>>
>> ex:
>> http://newNode1:port/solr/**admin/cores?action=CREATE&**
> name=testCloud1_shard1_**replica3&collection=**testCloud1&shard=shard1&**
> collection.configName=myconf
>>
>> http://newNode2:port/solr/**admin/cores?action=CREATE&**
> name=testCloud1_shard2_**replica3&collection=**testCloud1&shard=shard2&**
> collection.configName=myconf
>>
>>
>> Is there an easier way to do this.
>> Any ideas.
>>
>> Thanks,
>>
>> Rishi.
>>
>>
>> -----Original Message-----
>> From: Rishi Easwaran <ri...@aol.com>
>> To: solr-user <so...@lucene.apache.org>
>> Sent: Tue, May 14, 2013 2:58 pm
>> Subject: SOLR Cloud Collection Management quesiotn.
>>
>>
>> Hi,
>>
>> I am beginning to work on SOLR cloud implementation.
>> I created a collection using the collections API
>>
>> http://myhost:port/solr/admin/**collections?action=CREATE&**
>> name=testCloud1&numShards=6&**replicationFactor=2&**
>> collection.configName=myconf&**maxShardsPerNode=1
>>
>> My cluster now has 6 shards and 2 replicas (1 leader & 1 replica) for
>> each shard.
>> Now I want to add extra replicas to each shard in my cluster without
>> out changing the replicationFactor used to create the collection.
>> Any ideas on how to go about doing that.
>>
>> Thanks,
>>
>> Rishi.
>>
>>
>>
>>
>>
>
>
>
> --
>
> Anshum Gupta
> http://www.anshumgupta.net
>
>
Re: SOLR Cloud Collection Management quesiotn.
Posted by Rishi Easwaran <ri...@aol.com>.
Hi Anshum,
What if you have more nodes than shards*replicationFactor.
In the example below, originally I created the collection to use 6
shards* 2 replicationFactor = 12 nodes total.
Now I added 6 more nodes, 18 nodes total. I just want to add 1 extra
replica per shard.
How will it get evenly distributed, what is the determining criteria.
Thanks,
Rishi.
-----Original Message-----
From: Anshum Gupta <an...@anshumgupta.net>
To: solr-user <so...@lucene.apache.org>
Sent: Tue, May 14, 2013 9:42 pm
Subject: Re: SOLR Cloud Collection Management quesiotn.
Hi Rishi,
If you have your cluster up and running, just add the nodes and they
will
get evenly assigned to the shards. As of now, the replication factor is
not
persisted.
On Wed, May 15, 2013 at 1:07 AM, Rishi Easwaran
<ri...@aol.com>wrote:
> Ok looks like...I have to go to every node, add a replica
individually,
> create the cores and add them to the collection.
>
> ex:
> http://newNode1:port/solr/**admin/cores?action=CREATE&**
>
name=testCloud1_shard1_**replica3&collection=**testCloud1&shard=shard1&**
collection.configName=myconf
>
> http://newNode2:port/solr/**admin/cores?action=CREATE&**
>
name=testCloud1_shard2_**replica3&collection=**testCloud1&shard=shard2&**
collection.configName=myconf
>
>
> Is there an easier way to do this.
> Any ideas.
>
> Thanks,
>
> Rishi.
>
>
> -----Original Message-----
> From: Rishi Easwaran <ri...@aol.com>
> To: solr-user <so...@lucene.apache.org>
> Sent: Tue, May 14, 2013 2:58 pm
> Subject: SOLR Cloud Collection Management quesiotn.
>
>
> Hi,
>
> I am beginning to work on SOLR cloud implementation.
> I created a collection using the collections API
>
> http://myhost:port/solr/admin/**collections?action=CREATE&**
> name=testCloud1&numShards=6&**replicationFactor=2&**
> collection.configName=myconf&**maxShardsPerNode=1
>
> My cluster now has 6 shards and 2 replicas (1 leader & 1 replica) for
> each shard.
> Now I want to add extra replicas to each shard in my cluster without
> out changing the replicationFactor used to create the collection.
> Any ideas on how to go about doing that.
>
> Thanks,
>
> Rishi.
>
>
>
>
>
--
Anshum Gupta
http://www.anshumgupta.net
Re: SOLR Cloud Collection Management quesiotn.
Posted by Anshum Gupta <an...@anshumgupta.net>.
Hi Rishi,
If you have your cluster up and running, just add the nodes and they will
get evenly assigned to the shards. As of now, the replication factor is not
persisted.
On Wed, May 15, 2013 at 1:07 AM, Rishi Easwaran <ri...@aol.com>wrote:
> Ok looks like...I have to go to every node, add a replica individually,
> create the cores and add them to the collection.
>
> ex:
> http://newNode1:port/solr/**admin/cores?action=CREATE&**
> name=testCloud1_shard1_**replica3&collection=**testCloud1&shard=shard1&**collection.configName=myconf
>
> http://newNode2:port/solr/**admin/cores?action=CREATE&**
> name=testCloud1_shard2_**replica3&collection=**testCloud1&shard=shard2&**collection.configName=myconf
>
>
> Is there an easier way to do this.
> Any ideas.
>
> Thanks,
>
> Rishi.
>
>
> -----Original Message-----
> From: Rishi Easwaran <ri...@aol.com>
> To: solr-user <so...@lucene.apache.org>
> Sent: Tue, May 14, 2013 2:58 pm
> Subject: SOLR Cloud Collection Management quesiotn.
>
>
> Hi,
>
> I am beginning to work on SOLR cloud implementation.
> I created a collection using the collections API
>
> http://myhost:port/solr/admin/**collections?action=CREATE&**
> name=testCloud1&numShards=6&**replicationFactor=2&**
> collection.configName=myconf&**maxShardsPerNode=1
>
> My cluster now has 6 shards and 2 replicas (1 leader & 1 replica) for
> each shard.
> Now I want to add extra replicas to each shard in my cluster without
> out changing the replicationFactor used to create the collection.
> Any ideas on how to go about doing that.
>
> Thanks,
>
> Rishi.
>
>
>
>
>
--
Anshum Gupta
http://www.anshumgupta.net
Re: SOLR Cloud Collection Management quesiotn.
Posted by Rishi Easwaran <ri...@aol.com>.
Ok looks like...I have to go to every node, add a replica individually,
create the cores and add them to the collection.
ex:
http://newNode1:port/solr/admin/cores?action=CREATE&name=testCloud1_shard1_replica3&collection=testCloud1&shard=shard1&collection.configName=myconf
http://newNode2:port/solr/admin/cores?action=CREATE&name=testCloud1_shard2_replica3&collection=testCloud1&shard=shard2&collection.configName=myconf
Is there an easier way to do this.
Any ideas.
Thanks,
Rishi.
-----Original Message-----
From: Rishi Easwaran <ri...@aol.com>
To: solr-user <so...@lucene.apache.org>
Sent: Tue, May 14, 2013 2:58 pm
Subject: SOLR Cloud Collection Management quesiotn.
Hi,
I am beginning to work on SOLR cloud implementation.
I created a collection using the collections API
http://myhost:port/solr/admin/collections?action=CREATE&name=testCloud1&numShards=6&replicationFactor=2&collection.configName=myconf&maxShardsPerNode=1
My cluster now has 6 shards and 2 replicas (1 leader & 1 replica) for
each shard.
Now I want to add extra replicas to each shard in my cluster without
out changing the replicationFactor used to create the collection.
Any ideas on how to go about doing that.
Thanks,
Rishi.