You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Sean Busbey (JIRA)" <ji...@apache.org> on 2018/06/06 19:13:00 UTC

[jira] [Created] (HBASE-20691) Storage policy should allow deferring to HDFS

Sean Busbey created HBASE-20691:
-----------------------------------

             Summary: Storage policy should allow deferring to HDFS
                 Key: HBASE-20691
                 URL: https://issues.apache.org/jira/browse/HBASE-20691
             Project: HBase
          Issue Type: Bug
          Components: wal
    Affects Versions: 2.0.0, 1.5.0
            Reporter: Sean Busbey
             Fix For: 2.1.0, 1.5.0


In HBase 1.1 - 1.4 we can defer storage policy decisions to HDFS by using "NONE" as storage type in hbase configs.

As described on this the [dev@hbase thread "WAL storage policies and interactions with Hadoop admin tools."|https://lists.apache.org/thread.html/d220726fab4bb4c9e117ecc8f44246402dd97bfc986a57eb22311117@%3Cdev.hbase.apache.org%3E] we no longer have that option in 2.0.0 and 1.5.0 (as the branch is now). Additionally, we can't set the policy to HOT in the event that HDFS has changed the policy for a parent directory of our WALs.

We should put back that ability. Presuming this is done by re-adopting the "NONE" placeholder variable, we need to ensure that value doesn't get passed to HDFS APIs. Since it isn't a valid storage policy attempting to use it will cause a bunch of logging churn (which will be a regression of the problem HBASE-18118 sought to fix).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)