You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Bryan Beaudreault (Jira)" <ji...@apache.org> on 2022/07/19 14:30:00 UTC

[jira] [Created] (HBASE-27225) Add BucketAllocator bucket size statistic logging

Bryan Beaudreault created HBASE-27225:
-----------------------------------------

             Summary: Add BucketAllocator bucket size statistic logging
                 Key: HBASE-27225
                 URL: https://issues.apache.org/jira/browse/HBASE-27225
             Project: HBase
          Issue Type: Improvement
            Reporter: Bryan Beaudreault


BucketCache places blocks into configurably sized buckets based on the block size. The default sizes aim to provide broad coverage for common block sizes, but should probably be tuned for certain use-cases. However, we provide no way for operators to gain insight into the distribution of buckets.

There already exists a BucketAllocator#logStatistics method, but it is not called anywhere. I suggest that we hook that up in BucketCache#logStats (which is called periodically by a stats thread). We can go from there.

Looking at the IndexStatistics used in that method, it looks like a good start. One thing I'd like to add is a count of freeBuckets and completelyFreeBuckets per index. I think this will be useful for indicating how much more wiggle room we have for redistributing buckets among the various block sizes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)