You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Bryan Beaudreault (Jira)" <ji...@apache.org> on 2022/07/19 21:07:00 UTC

[jira] (HBASE-27225) Add BucketAllocator bucket size statistic logging

    [ https://issues.apache.org/jira/browse/HBASE-27225 ]


    Bryan Beaudreault deleted comment on HBASE-27225:
    -------------------------------------------

was (Author: bbeaudreault):
I'm thinking we might just want to use MutableSizeHistogram. In addition to fixing all of the above, it would also give us access to the histogram buckets. So we could easily show number of rows greater than various different thresholds.

> Add BucketAllocator bucket size statistic logging
> -------------------------------------------------
>
>                 Key: HBASE-27225
>                 URL: https://issues.apache.org/jira/browse/HBASE-27225
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Bryan Beaudreault
>            Priority: Major
>
> BucketCache places blocks into configurably sized buckets based on the block size. The default sizes aim to provide broad coverage for common block sizes, but should probably be tuned for certain use-cases. However, we provide no way for operators to gain insight into the distribution of buckets.
> There already exists a BucketAllocator#logStatistics method, but it is not called anywhere. I suggest that we hook that up in BucketCache#logStats (which is called periodically by a stats thread). We can go from there.
> Looking at the IndexStatistics used in that method, it looks like a good start. One thing I'd like to add is a count of freeBuckets and completelyFreeBuckets per index. I think this will be useful for indicating how much more wiggle room we have for redistributing buckets among the various block sizes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)