You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "longping_jie (Jira)" <ji...@apache.org> on 2023/11/29 06:38:00 UTC
[jira] [Created] (HBASE-28227) Tables to which Stripe Compaction policy is applied cannot be forced to trigger Major Compaction.
longping_jie created HBASE-28227:
------------------------------------
Summary: Tables to which Stripe Compaction policy is applied cannot be forced to trigger Major Compaction.
Key: HBASE-28227
URL: https://issues.apache.org/jira/browse/HBASE-28227
Project: HBase
Issue Type: Bug
Components: regionserver
Affects Versions: 2.2.6
Reporter: longping_jie
There is a table and the Stripe Compaction strategy is applied. Each region has an average value of 40G and is divided into 8 Stripes. Each Stripe is 5G. The business deletes a large amount of data. Manually triggering major compaction on the entire table and a single region does not work and cannot be selected.
After reading the source code, the merging strategy applied under each Stripe is ExploringCompactionPolicy. This strategy has a key point. It filters the Store file list of a single Stripe. In the candidate file list, as long as there is a file that is too large in size and meets the condition, fileSize > (totalFileSize - fileSize) * (hbase.hstore.compaction.ratio default value 1.2), files will not be filtered out to participate in major compaction.
It is necessary to support a forced merging mechanism. For scenarios where a large amount of data is deleted, or where bulkload exists, you can explicitly pass in a parameter such as foreMajor when manually triggering the major, and then perform forced Major Compaction in Stripe units to support the data. Clean up.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)