You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Mengqing Peng (Jira)" <ji...@apache.org> on 2020/08/17 11:33:00 UTC

[jira] [Updated] (HBASE-24289) Heterogeneous Storage for Date Tiered Compaction

     [ https://issues.apache.org/jira/browse/HBASE-24289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mengqing Peng updated HBASE-24289:
----------------------------------
    Release Note: 
Enhance DateTieredCompaction to support HDFS storage policy within one class family. 
Enable HDTCP as follow configurations:  hbase.hstore.compaction.date.tiered.storage.policy.enable=true
hbase.hstore.compaction.date.tiered.hot.window.age.millis=3600000
hbase.hstore.compaction.date.tiered.hot.window.storage.policy=ALL_SSD
hbase.hstore.compaction.date.tiered.warm.window.age.millis=20600000
hbase.hstore.compaction.date.tiered.warm.window.storage.policy=ONE_SSD
hbase.hstore.compaction.date.tiered.cold.window.storage.policy=HOT

Disable HDTCP as follow:
hbase.hstore.compaction.date.tiered.storage.policy.enable=false

  was:
Enhance DateTieredCompaction to support HDFS storage policy within one class family. 
Set configuration hbase.hstore.compaction.date.tiered.storage.policy.enable to enable or disable this feature.


> Heterogeneous Storage for Date Tiered Compaction
> ------------------------------------------------
>
>                 Key: HBASE-24289
>                 URL: https://issues.apache.org/jira/browse/HBASE-24289
>             Project: HBase
>          Issue Type: New Feature
>          Components: Compaction
>            Reporter: Mengqing Peng
>            Assignee: Mengqing Peng
>            Priority: Major
>             Fix For: 3.0.0-alpha-1, 2.4.0
>
>
> Support DateTiredCompaction(HBASE-15181) for cold and hot data separation, support different storage policies for different time periods of data to get better performance, for example, we can configure the data of last 1 month in SSD, and 1 month ago data was in HDD.
> design doc: 
> https://docs.google.com/document/d/1fk_EWLNnxniwt3gDjUS_apQ3cPzn90AmvDT1wkirvKE/edit?usp=sharing



--
This message was sent by Atlassian Jira
(v8.3.4#803005)