You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Markus Jelsma <ma...@openindex.io> on 2016/04/12 13:49:27 UTC
Shard ranges seem incorrect
Hi - i've just created a 3 shard 3 replica collection on Solr 6.0.0 and we noticed something odd, the hashing ranges don't make sense (full state.json below):
shard1 Range: 80000000-d554ffff
shard2 Range: d5550000-2aa9ffff
shard3 Range: 2aaa0000-7fffffff
We've also noticed ranges not going from 0 to ffffffff for a 5.5 create single shard collection. Another collection created on an older (unknown) release has correct shard ranges. Any idea what's going on?
Thanks,
Markus
{"logs":{
"replicationFactor":"3",
"router":{"name":"compositeId"},
"maxShardsPerNode":"9",
"autoAddReplicas":"false",
"shards":{
"shard1":{
"range":"80000000-d554ffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"logs_shard1_replica3",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active"},
"core_node4":{
"core":"logs_shard1_replica1",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active",
"leader":"true"},
"core_node8":{
"core":"logs_shard1_replica2",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active"}}},
"shard2":{
"range":"d5550000-2aa9ffff",
"state":"active",
"replicas":{
"core_node1":{
"core":"logs_shard2_replica1",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active",
"leader":"true"},
"core_node2":{
"core":"logs_shard2_replica2",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active"},
"core_node9":{
"core":"logs_shard2_replica3",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active"}}},
"shard3":{
"range":"2aaa0000-7fffffff",
"state":"active",
"replicas":{
"core_node5":{
"core":"logs_shard3_replica1",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active",
"leader":"true"},
"core_node6":{
"core":"logs_shard3_replica2",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active"},
"core_node7":{
"core":"logs_shard3_replica3",
"base_url":"http://127.0.1.1:8983/solr",
"node_name":"127.0.1.1:8983_solr",
"state":"active"}}}}}}
RE: Shard ranges seem incorrect
Posted by Chris Hostetter <ho...@fucit.org>.
: Hi - bumping this issue. Any thoughts to share?
Shawn's response to your email seemed spot on acurate to me -- is there
something about his answer that doesn't match up with what you're seeing?
can you clarify/elaborate your concerns?
http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201604.mbox/%3C570D0A03.5010500@elyograg.org%3E
:
: -----Original message-----
: > From:Markus Jelsma <ma...@openindex.io>
: > Sent: Tuesday 12th April 2016 13:49
: > To: solr-user <so...@lucene.apache.org>
: > Subject: Shard ranges seem incorrect
: >
: > Hi - i've just created a 3 shard 3 replica collection on Solr 6.0.0 and we noticed something odd, the hashing ranges don't make sense (full state.json below):
: > shard1 Range: 80000000-d554ffff
: > shard2 Range: d5550000-2aa9ffff
: > shard3 Range: 2aaa0000-7fffffff
: >
: > We've also noticed ranges not going from 0 to ffffffff for a 5.5 create single shard collection. Another collection created on an older (unknown) release has correct shard ranges. Any idea what's going on?
: > Thanks,
: > Markus
: >
: > {"logs":{
: > "replicationFactor":"3",
: > "router":{"name":"compositeId"},
: > "maxShardsPerNode":"9",
: > "autoAddReplicas":"false",
: > "shards":{
: > "shard1":{
: > "range":"80000000-d554ffff",
: > "state":"active",
: > "replicas":{
: > "core_node3":{
: > "core":"logs_shard1_replica3",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active"},
: > "core_node4":{
: > "core":"logs_shard1_replica1",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active",
: > "leader":"true"},
: > "core_node8":{
: > "core":"logs_shard1_replica2",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active"}}},
: > "shard2":{
: > "range":"d5550000-2aa9ffff",
: > "state":"active",
: > "replicas":{
: > "core_node1":{
: > "core":"logs_shard2_replica1",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active",
: > "leader":"true"},
: > "core_node2":{
: > "core":"logs_shard2_replica2",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active"},
: > "core_node9":{
: > "core":"logs_shard2_replica3",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active"}}},
: > "shard3":{
: > "range":"2aaa0000-7fffffff",
: > "state":"active",
: > "replicas":{
: > "core_node5":{
: > "core":"logs_shard3_replica1",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active",
: > "leader":"true"},
: > "core_node6":{
: > "core":"logs_shard3_replica2",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active"},
: > "core_node7":{
: > "core":"logs_shard3_replica3",
: > "base_url":"http://127.0.1.1:8983/solr",
: > "node_name":"127.0.1.1:8983_solr",
: > "state":"active"}}}}}}
: >
: >
: >
: >
: >
:
-Hoss
http://www.lucidworks.com/
RE: Shard ranges seem incorrect
Posted by Markus Jelsma <ma...@openindex.io>.
Hi - bumping this issue. Any thoughts to share?
Thanks,
M
-----Original message-----
> From:Markus Jelsma <ma...@openindex.io>
> Sent: Tuesday 12th April 2016 13:49
> To: solr-user <so...@lucene.apache.org>
> Subject: Shard ranges seem incorrect
>
> Hi - i've just created a 3 shard 3 replica collection on Solr 6.0.0 and we noticed something odd, the hashing ranges don't make sense (full state.json below):
> shard1 Range: 80000000-d554ffff
> shard2 Range: d5550000-2aa9ffff
> shard3 Range: 2aaa0000-7fffffff
>
> We've also noticed ranges not going from 0 to ffffffff for a 5.5 create single shard collection. Another collection created on an older (unknown) release has correct shard ranges. Any idea what's going on?
> Thanks,
> Markus
>
> {"logs":{
> "replicationFactor":"3",
> "router":{"name":"compositeId"},
> "maxShardsPerNode":"9",
> "autoAddReplicas":"false",
> "shards":{
> "shard1":{
> "range":"80000000-d554ffff",
> "state":"active",
> "replicas":{
> "core_node3":{
> "core":"logs_shard1_replica3",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active"},
> "core_node4":{
> "core":"logs_shard1_replica1",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active",
> "leader":"true"},
> "core_node8":{
> "core":"logs_shard1_replica2",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active"}}},
> "shard2":{
> "range":"d5550000-2aa9ffff",
> "state":"active",
> "replicas":{
> "core_node1":{
> "core":"logs_shard2_replica1",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active",
> "leader":"true"},
> "core_node2":{
> "core":"logs_shard2_replica2",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active"},
> "core_node9":{
> "core":"logs_shard2_replica3",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active"}}},
> "shard3":{
> "range":"2aaa0000-7fffffff",
> "state":"active",
> "replicas":{
> "core_node5":{
> "core":"logs_shard3_replica1",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active",
> "leader":"true"},
> "core_node6":{
> "core":"logs_shard3_replica2",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active"},
> "core_node7":{
> "core":"logs_shard3_replica3",
> "base_url":"http://127.0.1.1:8983/solr",
> "node_name":"127.0.1.1:8983_solr",
> "state":"active"}}}}}}
>
>
>
>
>
Re: Shard ranges seem incorrect
Posted by Shawn Heisey <ap...@elyograg.org>.
On 4/12/2016 5:49 AM, Markus Jelsma wrote:
> Hi - i've just created a 3 shard 3 replica collection on Solr 6.0.0 and we noticed something odd, the hashing ranges don't make sense (full state.json below):
> shard1 Range: 80000000-d554ffff
> shard2 Range: d5550000-2aa9ffff
> shard3 Range: 2aaa0000-7fffffff
>
> We've also noticed ranges not going from 0 to ffffffff for a 5.5 create single shard collection. Anothercollection created on an older (unknown) release has correct shard ranges. Any idea what's going on?
The hex value 80000000 in a Java integer is equivalent to -2147483648
(Integer.MIN_VALUE) -- numeric types in Java are signed. The hex value
7fffffff is 2147483647 (Integer.MAX_VALUE).
Thus the hash range goes from 80000000 to 7fffffff, with zero in the
middle. This is not a new development in 6.0.0 -- it's been this way
for the entire life of SolrCloud (since 4.0-ALPHA).
Thanks,
Shawn