You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Xiaolin Ha (Jira)" <ji...@apache.org> on 2021/11/16 13:54:00 UTC

[jira] [Updated] (HBASE-26249) Ameliorate compaction made by bulk-loading files

     [ https://issues.apache.org/jira/browse/HBASE-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiaolin Ha updated HBASE-26249:
-------------------------------
    Summary: Ameliorate compaction made by bulk-loading files  (was: Avoid repeatedly trigger same store compactions after bulk load files)

> Ameliorate compaction made by bulk-loading files
> ------------------------------------------------
>
>                 Key: HBASE-26249
>                 URL: https://issues.apache.org/jira/browse/HBASE-26249
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Xiaolin Ha
>            Assignee: Xiaolin Ha
>            Priority: Major
>
> HBASE-25213 introduced to trigger compact after bulkload, but if a store needs compaction, each file loaded to this store will add a compaction runner of this store to the compaction queue. Then repeatedly compute for needCompaction and selectFiles for this store, and the compaction of the store may be continuous.
> We can mark the queued compaction runners for the stores, and avoid repeatedly adding same store compactions to the queue after bulk load files. This method can reduce the pressure during the period just after bulk loading and spread the pressure to other times by the periodic CompactionChecker.
> For the need of splitting mentioned before, after the completion of compaction, it will trigger split of the region if it needs. So we do not need to trigger split after bulk loading.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)