You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "Noble Paul (Jira)" <ji...@apache.org> on 2022/12/14 04:09:00 UTC
[jira] [Comment Edited] (SOLR-16448) State.json serialized with indent size 2, this takes lots of extra bytes for large collection
[ https://issues.apache.org/jira/browse/SOLR-16448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646911#comment-17646911 ]
Noble Paul edited comment on SOLR-16448 at 12/14/22 4:08 AM:
-------------------------------------------------------------
{quote} he costs for building and running that cluster must be quite high{quote}
Our largest collection has ~2+ MB state.json. We are planning to double the size soon
{quote} Does ZK handle the binary gzip data OK? {quote}
it does . zipping has helped us a lot
gzip is good enough
was (Author: noble.paul):
{quote} he costs for building and running that cluster must be quite high{quote}
Our largest collection has 2-3 MB state.json
{quote} Does ZK handle the binary gzip data OK? {quote}
it does . zipping has helped us a lot
gzip is good enough
> State.json serialized with indent size 2, this takes lots of extra bytes for large collection
> ----------------------------------------------------------------------------------------------
>
> Key: SOLR-16448
> URL: https://issues.apache.org/jira/browse/SOLR-16448
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: SolrCloud
> Affects Versions: 9.1
> Reporter: Hitesh Khamesra
> Assignee: Noble Paul
> Priority: Major
>
> For large collection (#shards > 2000), state.json file size becomes more than 1 mb. Solr serialized that with indent size 2. By reducing indent size to 0, we can reduce size by more than 20%. That will be very efficient.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org