You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Hari Sekhon (JIRA)" <ji...@apache.org> on 2015/04/15 14:50:58 UTC

[jira] [Created] (SOLR-7400) Collection creation fails when over-provisioning maxShardsPerNode > 1

Hari Sekhon created SOLR-7400:
---------------------------------

             Summary: Collection creation fails when over-provisioning maxShardsPerNode > 1
                 Key: SOLR-7400
                 URL: https://issues.apache.org/jira/browse/SOLR-7400
             Project: Solr
          Issue Type: Bug
          Components: SolrCloud
    Affects Versions: 4.10.3
         Environment: HDP 2.2 / HDP Search
            Reporter: Hari Sekhon


When trying to overprovision shards I've encountered an issue before where the additional shards are trying to use the same dataDir resulting in failure to obtain locks for those additional shard replicas:
{code}curl 'http://host:8983/solr/admin/collections?action=CREATE&name=test&numShards=6&maxShardsPerNode=6&replicationFactor=2&wt=json&indent=true'
{
  "responseHeader":{
    "status":0,
    "QTime":3925},
  "failure":{
    "":"org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'test_shard1_replica2': Unable to create core [test_shard1_replica2] Caused by: Lock obtain timed out: NativeFSLock@/data1/solr/test/index/write.lock",
    "":"org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'test_shard6_replica1': Unable to create core [test_shard6_replica1] Caused by: Lock obtain timed out: NativeFSLock@/data1/solr/test/index/write.lock",
    "":"org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'test_shard5_replica2': Unable to create core [test_shard5_replica2] Caused by: Lock obtain timed out: NativeFSLock@/data1/solr/test/index/write.lock",
    "":"org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'test_shard2_replica1': Unable to create core [test_shard2_replica1] Caused by: Lock obtain timed out: NativeFSLock@/data1/solr/test/index/write.lock",
    "":"org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'test_shard3_replica2': Unable to create core [test_shard3_replica2] Caused by: Lock obtain timed out: NativeFSLock@/data1/solr/test/index/write.lock",
    "":"org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'test_shard4_replica1': Unable to create core [test_shard4_replica1] Caused by: Lock obtain timed out: NativeFSLock@/data1/solr/test/index/write.lock"},
 "success":{
    "":{
      "responseHeader":{
        "status":0,
        "QTime":3225},
      "core":"test_shard5_replica1"},
    "":{
      "responseHeader":{
        "status":0,
        "QTime":3234},
      "core":"test_shard6_replica2"},
    "":{
      "responseHeader":{
        "status":0,
        "QTime":3248},
      "core":"test_shard1_replica1"},
    "":{
      "responseHeader":{
        "status":0,
        "QTime":3433},
      "core":"test_shard4_replica2"},
    "":{
      "responseHeader":{
        "status":0,
        "QTime":3620},
      "core":"test_shard3_replica1"},
    "":{
      "responseHeader":{
        "status":0,
        "QTime":3800},
      "core":"test_shard2_replica2"}}}
{code}
It's not clear given this how you could have more than one shard per node to pre-provision for anticipated node growth.

Hari Sekhon
http://www.linkedin.com/in/harisekhon



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org