You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Shawn Heisey (JIRA)" <ji...@apache.org> on 2017/01/21 00:33:27 UTC
[jira] [Comment Edited] (SOLR-7191) Improve stability and startup
performance of SolrCloud with thousands of collections
[ https://issues.apache.org/jira/browse/SOLR-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832668#comment-15832668 ]
Shawn Heisey edited comment on SOLR-7191 at 1/21/17 12:32 AM:
--------------------------------------------------------------
With hard nproc at 61440, soft nproc at 40960, and maxThreads for each jetty at 20000, I am still not able to create enough threads to start both Solr instances with just under 1900 collections in the cloud. The user in question is running a few other things on the system, but the number of threads involved there is less than 300. This is definitely not an improvement over 5.x.
was (Author: elyograg):
With hard nproc at 61440, soft nproc at 40960, and maxThreads for each jetty at 20000, I am still not able to create enough threads to start both Solr instances with just under 1900 collections in the cloud. The user in question is running a few other things on the system, but the number of threads involved there is less than 300.
> Improve stability and startup performance of SolrCloud with thousands of collections
> ------------------------------------------------------------------------------------
>
> Key: SOLR-7191
> URL: https://issues.apache.org/jira/browse/SOLR-7191
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Affects Versions: 5.0
> Reporter: Shawn Heisey
> Assignee: Noble Paul
> Labels: performance, scalability
> Fix For: 6.3
>
> Attachments: lots-of-zkstatereader-updates-branch_5x.log, SOLR-7191.patch, SOLR-7191.patch, SOLR-7191.patch, SOLR-7191.patch, SOLR-7191.patch, SOLR-7191.patch, SOLR-7191.patch
>
>
> A user on the mailing list with thousands of collections (5000 on 4.10.3, 4000 on 5.0) is having severe problems with getting Solr to restart.
> I tried as hard as I could to duplicate the user setup, but I ran into many problems myself even before I was able to get 4000 collections created on a 5.0 example cloud setup. Restarting Solr takes a very long time, and it is not very stable once it's up and running.
> This kind of setup is very much pushing the envelope on SolrCloud performance and scalability. It doesn't help that I'm running both Solr nodes on one machine (I started with 'bin/solr -e cloud') and that ZK is embedded.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org