You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Noble Paul (JIRA)" <ji...@apache.org> on 2013/10/23 19:15:43 UTC

[jira] [Created] (SOLR-5381) Split Clusterstate and scale

Noble Paul created SOLR-5381:
--------------------------------

             Summary: Split Clusterstate and scale 
                 Key: SOLR-5381
                 URL: https://issues.apache.org/jira/browse/SOLR-5381
             Project: Solr
          Issue Type: Improvement
          Components: SolrCloud
            Reporter: Noble Paul
            Assignee: Noble Paul


clusterstate.json is a single point of contention for all components in SolrCloud. It would be hard to scale SolrCloud beyond a few thousand nodes because there are too many updates and too many nodes need to be notified of the changes. As the no:of nodes go up the size of clusterstate.json keeps going up and it will soon exceed the limit impossed by ZK.

The first step is to store the shards information in separate nodes and each node can just listen to the shard node it belongs to. We may also need to split each collection into its own node and the clusterstate.json just holding the names of the collections .

This is an umbrella issue



--
This message was sent by Atlassian JIRA
(v6.1#6144)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org