[jira] [Commented] (HBASE-26320) Separate Log Cleaner DirScanPool to prevent the OLDWALs from filling up the disk when archive is large

["Hudson (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-26320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17639772#comment-17639772 ] 

Hudson commented on HBASE-26320:
--------------------------------

Results for branch branch-2.4
	[build #466 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/466/]: (/) *{color:green}+1 overall{color}*
----
details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/466/General_20Nightly_20Build_20Report/]


(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/466/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]


(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/466/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]


(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.4/466/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Separate Log Cleaner DirScanPool to prevent the OLDWALs from filling up the disk when archive is large
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-26320
>                 URL: https://issues.apache.org/jira/browse/HBASE-26320
>             Project: HBase
>          Issue Type: Improvement
>          Components: Operability
>    Affects Versions: 1.7.1, 2.4.6
>            Reporter: Zach York
>            Assignee: Zach York
>            Priority: Major
>             Fix For: 2.5.0, 3.0.0-alpha-3, 2.4.16
>
>
> We currently share the DirScanPool (threadpool for scanning for files to delete in the OldLogs and archive directories) between the LogCleaner and HFileCleaner. This means that if the archive directory is large/has lots of files/directories, the threads can get stuck scanning through the archive directory, starving the LogCleaner. This is especially apparent on S3 where list can be slower than on HDFS.
> This JIRA creates separate DirScanPools for the LogCleaner and HFileCleaner



--
This message was sent by Atlassian Jira
(v8.20.10#820010)