You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@helix.apache.org by "kishore gopalakrishna (JIRA)" <ji...@apache.org> on 2015/03/09 00:36:38 UTC

[jira] [Created] (HELIX-573) Add support to compress/uncompress data on ZK

kishore gopalakrishna created HELIX-573:
-------------------------------------------

             Summary: Add support to compress/uncompress data on ZK
                 Key: HELIX-573
                 URL: https://issues.apache.org/jira/browse/HELIX-573
             Project: Apache Helix
          Issue Type: Improvement
            Reporter: kishore gopalakrishna


Currently we have bucketing as one of the options when the number of partitions are large. We have couple of bugs with the handling of bucketized resources (one of them is fatal). 

One of the reasons to split the znode is because we use JSON to store the data in ZNode. While JSON is good for debugging, its space inefficient.

A better option before going to bucketing is to support compression of Ideal state, current state and External View. This also gives good performance.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)