You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Wellington Chevreuil (Jira)" <ji...@apache.org> on 2021/07/28 18:37:00 UTC

[jira] [Updated] (HBASE-25392) Direct insert compacted HFiles into data directory.

     [ https://issues.apache.org/jira/browse/HBASE-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wellington Chevreuil updated HBASE-25392:
-----------------------------------------
    Release Note: 
Introduces the DirectStoreCompactor, an extension of DefaultCompactor, which writes compactions result files straight into the store directory, rather than the temp dir approach implemented by DefaultCompactor.

In commitCompaction, it does not perform any renames. Should always be used together with PersistedStoreEngine proposed in HBASE-25395 and DirectStoreFlusher proposed in HBASE-25391, as it's up for StoreEngine implementations keep tracking of valid store files.

To enable this, the following properties must be set in RS configuration:

<property>
<name>hbase.storefile.tracking.persist.enabled</name><value>true</value>
</property>
<property>
<name>hbase.hstore.engine.class</name>
<value>org.apache.hadoop.hbase.regionserver.PersistedStoreEngine</value>
</property>
<property>
<name>hbase.regionserver.store.flush.context.class</name><value>org.apache.hadoop.hbase.regionserver.DirectStoreFlushContext</value>
</property>
<property>
<name>hbase.hstore.defaultengine.storeflusher.class</name><value>org.apache.hadoop.hbase.regionserver.DirectStoreFlusher</value></property>
<property>
<name>hbase.hstore.defaultengine.compactor.class</name>
<value>org.apache.hadoop.hbase.regionserver.compactions.DirectStoreCompactor</value>
</property>

> Direct insert compacted HFiles into data directory.
> ---------------------------------------------------
>
>                 Key: HBASE-25392
>                 URL: https://issues.apache.org/jira/browse/HBASE-25392
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Tak-Lon (Stephen) Wu
>            Assignee: Wellington Chevreuil
>            Priority: Major
>
> {color:#000000}when performing compaction, write directly to the data directory {color}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)