[jira] [Updated] (HBASE-4089) blockCache contents report

["stack (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-4089:
-------------------------

    Attachment: bc_basic.png
                bc_config.png
                bc_stats.png
                bc_l1.png
                bc_slabs.png
                bc_l2_buckets.png

Some pictures of what I have so far.

I've added a section to the RS UI called Block Cache.

You tab over 'basic info', 'configuration', 'stats', 'l1 stats', and 'l2 stats'.  If no l2, says 'no l2 deployed'.  If DoubleBlockCache or CombinedBlockCache, shows these as implementations and then detail on the LruBlockCache L1 and the SlabCache or BucketCache L2s.  Shows Slabs and their stats if SlabCache.  Shows buckets and their stats if it is deployed.

Should be general enough to entertain other deploy types.

TODO: expose these details to monitoring tools; though expensive to calculate I can imagine folks wanting to study them over periods of investigation or setup.  Could add json view here or probably better, make real metrics of them (might be too much).

TODO: Finish up the blocks by files page; good for geting rough view on what files are hot and how hot.  The info is there, just need to add a template.


> blockCache contents report
> --------------------------
>
>                 Key: HBASE-4089
>                 URL: https://issues.apache.org/jira/browse/HBASE-4089
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Doug Meil
>            Assignee: Doug Meil
>         Attachments: 4089.wip.txt, bc_basic.png, bc_config.png, bc_l1.png, bc_l2_buckets.png, bc_slabs.png, bc_stats.png, hbase_4089_blockcachereport.pdf, java_blockcache_checkpoint_2011_08_11.patch
>
>
> Summarized block-cache report for a RegionServer would be helpful.  For example ...
> table1
>   cf1   100 blocks, totalBytes=yyyyy, averageTimeInCache=XXXX hours
>   cf2   200 blocks, totalBytes=zzzzz, averageTimeInCache=XXXX hours
> table2
>   cf1  75 blocks, totalBytes=yyyyy, averageTimeInCache=XXXX hours
>   cf2 150 blocks, totalBytes=zzzzz, averageTimeInCache=XXXX hours
> ... Etc.
> The current metrics list blockCacheSize and blockCacheFree, but there is no way to know what's in there.  Any single block isn't really important, but the patterns of what CF/Table they came from, how big are they, and how long (on average) they've been in the cache, are important.
> No such interface exists in HRegionInterface.  But I think it would be helpful from an operational perspective.
> Updated (7-29):  Removing suggestion for UI.  I would be happy just to get this report on a configured interval dumped to a log file.



--
This message was sent by Atlassian JIRA
(v6.2#6252)