[jira] [Commented] (HBASE-18083) Make large/small file clean thread number configurable in HFileCleaner

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-18083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16552483#comment-16552483 ] 

Hudson commented on HBASE-18083:
--------------------------------

Results for branch branch-1
	[build #389 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/389/]: (x) *{color:red}-1 overall{color}*
----
details (if available):

(x) {color:red}-1 general checks{color}
-- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/389//General_Nightly_Build_Report/]


(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7 report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/389//JDK7_Nightly_Build_Report/]


(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- Something went wrong running this stage, please [check relevant console output|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/389//console].




(x) {color:red}-1 source release artifact{color}
-- See build output for details.


> Make large/small file clean thread number configurable in HFileCleaner
> ----------------------------------------------------------------------
>
>                 Key: HBASE-18083
>                 URL: https://issues.apache.org/jira/browse/HBASE-18083
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Yu Li
>            Assignee: Yu Li
>            Priority: Major
>             Fix For: 2.0.0
>
>         Attachments: HBASE-18083.patch, HBASE-18083.v2.patch, HBASE-18083.v3.patch
>
>
> Currently we have only one thread for both large and small file cleaning, but when write pressure is huge we might need more cleaner threads, so we need to make the thread number configurable.
> We observed more than 1.8PB data in archive directory online due to business access rate change, and this proposal is one of the necessary changes required.
> Default value of the configurations would still be left to 1 to keep low pressure to NN for normal case.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)