[jira] [Resolved] (SOLR-4793) Solr Cloud can't upload large config files ( > 1MB) to Zookeeper

["Steve Rowe (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SOLR-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Rowe resolved SOLR-4793.
------------------------------
       Resolution: Workaround
         Assignee: Steve Rowe
    Fix Version/s: master (8.0)
                   7.4

Resolving this issue for now with status "Workaround" as a result of the added documentation.

I'll open an issue to remove this documentation once the blob store is a viable alternative to ZK storage of large configuration files everywhere.

> Solr Cloud can't upload large config files ( > 1MB)  to Zookeeper
> -----------------------------------------------------------------
>
>                 Key: SOLR-4793
>                 URL: https://issues.apache.org/jira/browse/SOLR-4793
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Son Nguyen
>            Assignee: Steve Rowe
>            Priority: Major
>             Fix For: 7.4, master (8.0)
>
>         Attachments: SOLR-4793.patch
>
>
> Zookeeper set znode size limit to 1MB by default. So we can't start Solr Cloud with some large config files, like synonyms.txt.
> Jan Høydahl has a good idea:
> "SolrCloud is designed with an assumption that you should be able to upload your whole disk-based conf folder into ZK, and that you should be able to add an empty Solr node to a cluster and it would download all config from ZK. So immediately a splitting strategy automatically handled by ZkSolresourceLoader for large files could be one way forward, i.e. store synonyms.txt as e.g. __001_synonyms.txt __002_synonyms.txt...."



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org