You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Steve Rowe (JIRA)" <ji...@apache.org> on 2018/04/20 04:51:00 UTC
[jira] [Comment Edited] (SOLR-4793) Solr Cloud can't upload large
config files ( > 1MB) to Zookeeper
[ https://issues.apache.org/jira/browse/SOLR-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16445295#comment-16445295 ]
Steve Rowe edited comment on SOLR-4793 at 4/20/18 4:50 AM:
-----------------------------------------------------------
I've attached a patch that adds {{jute.maxbuffer}} documentation to the ref guide page on setting up an external ZooKeeper cluster that [~ctargett] improved over on SOLR-12163.
I've included a links to the new section:
# from the large model section on the LTR page, as an alternative to SOLR-11250's {{DefaultWrapperModel}}; inspired by the patch on SOLR-11049 - cc [~cpoerschke];
# from the OpenNLP NER mention on the URP page (LUCENE-2899); and
# from the OpenNLP NER URP javadocs.
Feedback is welcome.
was (Author: steve_rowe):
I've attached a patch that adds {{jute.maxbuffer}} documentation to the ref guide page on setting up an external ZooKeeper cluster that [~ctargett] improved over on SOLR-12163.
I've included a links to the new section:
# from the large model section on the LTR page, as an alternative to SOLR-11250's {{DefaultWrapperModel}}; inspired by the patch on SOLR-11049 - cc [~cpoerschke];
# from the OpenNLP NER mention on the URP page; and
# from the OpenNLP NER URP javadocs.
Feedback is welcome.
> Solr Cloud can't upload large config files ( > 1MB) to Zookeeper
> -----------------------------------------------------------------
>
> Key: SOLR-4793
> URL: https://issues.apache.org/jira/browse/SOLR-4793
> Project: Solr
> Issue Type: Improvement
> Reporter: Son Nguyen
> Priority: Major
> Attachments: SOLR-4793.patch
>
>
> Zookeeper set znode size limit to 1MB by default. So we can't start Solr Cloud with some large config files, like synonyms.txt.
> Jan Høydahl has a good idea:
> "SolrCloud is designed with an assumption that you should be able to upload your whole disk-based conf folder into ZK, and that you should be able to add an empty Solr node to a cluster and it would download all config from ZK. So immediately a splitting strategy automatically handled by ZkSolresourceLoader for large files could be one way forward, i.e. store synonyms.txt as e.g. __001_synonyms.txt __002_synonyms.txt...."
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org