You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2018/12/14 00:38:06 UTC
[jira] [Commented] (HBASE-17854) Use StealJobQueue in HFileCleaner
after HBASE-17215
[ https://issues.apache.org/jira/browse/HBASE-17854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720781#comment-16720781 ]
Hudson commented on HBASE-17854:
--------------------------------
SUCCESS: Integrated in Jenkins build HBase-1.3-IT #509 (See [https://builds.apache.org/job/HBase-1.3-IT/509/])
HBASE-20558 Port HBASE-17854 (Use StealJobQueue in HFileCleaner after (apurtell: rev 976f07e87cbeb35b80a7ca8eea46f973e932bf83)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/util/StealJobQueue.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileCleaner.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileCleaner.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestStealJobQueue.java
> Use StealJobQueue in HFileCleaner after HBASE-17215
> ---------------------------------------------------
>
> Key: HBASE-17854
> URL: https://issues.apache.org/jira/browse/HBASE-17854
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 2.0.0
> Reporter: Yu Li
> Assignee: Yu Li
> Priority: Major
> Fix For: 2.0.0
>
> Attachments: HBASE-17854.patch, HBASE-17854.v2.patch, HBASE-17854.v3.patch, HBASE-17854.v4.patch, HBASE-17854.v5.patch, HBASE-17854.v5.patch
>
>
> In HBASE-17215 we use specific threads for deleting large/small (archived) hfiles, and will improve it from below aspects in this JIRA:
> 1. Using {{StealJobQueue}} to allow large file deletion thread to steal jobs from small queue, based on the experience that in real world there'll be much more small hfiles
> 2. {{StealJobQueue}} is a kind of {{PriorityQueue}}, so we could also delete from the larger file in the queues.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)