You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "Kevin Risden (Jira)" <ji...@apache.org> on 2022/12/13 18:05:00 UTC
[jira] [Commented] (SOLR-16448) State.json serialized with indent size 2, this takes lots of extra bytes for large collection
[ https://issues.apache.org/jira/browse/SOLR-16448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646763#comment-17646763 ]
Kevin Risden commented on SOLR-16448:
-------------------------------------
So just some tangential thoughts related to this:
* I agree we don't need the indent in zookeeper - we could format on pulling from zookeeper or in admin UI as needed.
* I think it opens a bigger question of why do we store this in JSON in Zookeeper? Does it need to be JSON? JSON seems overly verbose potentially
* Assuming we care about the 1MB barrier due to ZK default limits on size of a znode - compression makes more sense?
> State.json serialized with indent size 2, this takes lots of extra bytes for large collection
> ----------------------------------------------------------------------------------------------
>
> Key: SOLR-16448
> URL: https://issues.apache.org/jira/browse/SOLR-16448
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: SolrCloud
> Affects Versions: 9.1
> Reporter: Hitesh Khamesra
> Assignee: Noble Paul
> Priority: Major
>
> For large collection (#shards > 2000), state.json file size becomes more than 1 mb. Solr serialized that with indent size 2. By reducing indent size to 0, we can reduce size by more than 20%. That will be very efficient.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org