[jira] [Commented] (HBASE-18396) Encode ZNode names to reduce ZooKeeper jute buffer length requirements and thus reduce memory usage

["Mike Drob (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-18396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16090440#comment-16090440 ] 

Mike Drob commented on HBASE-18396:
-----------------------------------

The problem here is usually that you have some set of children growing without an unreasonable bound, right? Encoding names to reduce path lengths doesn't fix the problem, it just kicks it further down the road.

> Encode ZNode names to reduce ZooKeeper jute buffer length requirements and thus reduce memory usage
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-18396
>                 URL: https://issues.apache.org/jira/browse/HBASE-18396
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 3.0.0
>            Reporter: Karan Mehta
>
> In our production environment, we hit the error {{ZooKeeper connectionLoss due to jute.maxbuffer len of 1M getting exceeded}}. Usually 1 MB is a lot, but in case of multi requests, it can exceed the maximum buffer length that is allocated.
> This JIRA is a discussion for encoding various znode names. IMO, this will reduce the path lengths, thus reducing the size of buffer required as well as network packet size and also pack more requests in a single multi. As with encoding, this will introduce overhead, but we need to determine how feasible this idea is.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)