[jira] [Updated] (HBASE-17437) Support specifying a WAL directory outside of the root directory

["Zach York (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zach York updated HBASE-17437:
------------------------------
    Release Note: 
This patch adds support for specifying a WAL directory outside of the HBase root directory.

Multiple configuration variables were added to accomplish this:
hbase.wal.dir: used to configure where the root WAL directory is located. Could be on a different FileSystem than the root directory. WAL directory can not be set to a subdirectory of the root directory. The default value of this is the root directory if unset.

hbase.rootdir.perms: Configures FileSystem permissions to set on the root directory. This is '700' by default.

hbase.wal.dir.perms: Configures FileSystem permissions to set on the WAL directory FileSystem. This is '700' by default.

> Support specifying a WAL directory outside of the root directory
> ----------------------------------------------------------------
>
>                 Key: HBASE-17437
>                 URL: https://issues.apache.org/jira/browse/HBASE-17437
>             Project: HBase
>          Issue Type: Improvement
>          Components: Filesystem Integration, wal
>    Affects Versions: 1.2.4
>            Reporter: Yishan Yang
>            Assignee: Zach York
>              Labels: patch
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: hbase-17437-branch-1.2.patch, HBASE-17437.master.001.patch, HBASE-17437.master.002.patch, HBASE-17437.master.003.patch, HBASE-17437.master.004.patch, HBASE-17437.master.005.patch, HBASE-17437.master.006.patch, HBASE-17437.master.007.patch, HBASE-17437.master.008.patch, HBASE-17437.master.009.patch, HBASE-17437.master.010.patch, HBASE-17437.master.011.patch, HBASE-17437.master.012.patch, hbase-17437-master.patch
>
>
> Currently, the WAL and the StoreFiles need to be on the same FileSystem. Some FileSystems (such as Amazon S3) don’t support append or consistent writes. These two properties are imperative for the WAL in order to avoid loss of writes. However, StoreFiles don’t necessarily need the same consistency guarantees (since writes are cached locally and if writes fail, they can always be replayed from the WAL).
>  
> This JIRA aims to allow users to configure a log directory (for WALs) that is outside of the root directory or even in a different FileSystem. The default value will still put the log directory under the root directory.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)