You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2014/07/19 02:37:38 UTC

[jira] [Resolved] (HBASE-3319) Add File Count Threshold to HBCK

     [ https://issues.apache.org/jira/browse/HBASE-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell resolved HBASE-3319.
-----------------------------------

    Resolution: Not a Problem

> Add File Count Threshold to HBCK
> --------------------------------
>
>                 Key: HBASE-3319
>                 URL: https://issues.apache.org/jira/browse/HBASE-3319
>             Project: HBase
>          Issue Type: Improvement
>          Components: util
>            Reporter: Nicolas Spiegelberg
>            Priority: Minor
>
> A useful check to add to HBCK is a way to estimate the max # of files that a cluster should have and raise a warning/error if the file count goes above that threshold.   We ran into an issue this week where our ".oldlogs" folder filled up to 100k files because 'hbase.master.logcleaner.maxdeletedlogs" was set too low.  We found this because of faulty region count metric in the HTTP server that actually showed the file count.  Adding an HBCK check would provide an extra layer of detection to find leaks from new features or conservatively configured cleanup thresholds.



--
This message was sent by Atlassian JIRA
(v6.2#6252)