You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/03/01 00:53:00 UTC
[jira] [Commented] (SOLR-16608) Enable ability to compress state.json in Zookeeper
[ https://issues.apache.org/jira/browse/SOLR-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694793#comment-17694793 ]
ASF subversion and git services commented on SOLR-16608:
--------------------------------------------------------
Commit 32e6df225476f8523e1e5e9c3bff9406c2625336 in solr's branch refs/heads/main from Justin Sweeney
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=32e6df22547 ]
SOLR-16608: Fixing replacement of line ending in test to be OS agnostic (#1409)
> Enable ability to compress state.json in Zookeeper
> --------------------------------------------------
>
> Key: SOLR-16608
> URL: https://issues.apache.org/jira/browse/SOLR-16608
> Project: Solr
> Issue Type: Improvement
> Reporter: Justin Sweeney
> Assignee: Justin Sweeney
> Priority: Major
> Fix For: 9.2
>
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> As noted in the Solr documentation, Zookeeper is intended to hold small files, by default < 1MB: [https://solr.apache.org/guide/7_4/setting-up-an-external-zookeeper-ensemble.html#increasing-the-file-size-limit.]
> When creating collections with very large number of replicas, it is possible to exceeded that size in the state.json that is created, which then requires Solr operators to reconfigure Zookeeper to increase that limit and also has performance implications.
> I am proposing that we provide the ability to compress state.json using standard ZLib compression. This will be based on a configuration parameter in solr.xml which will provide a minimum size of state.json over which to use compression. This will give Solr operators a better mechanism to handle state.json for very large collections.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org