[jira] [Commented] (HBASE-12848) Utilize Flash storage for WAL

["Anoop Sam John (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614983#comment-14614983 ] 

Anoop Sam John commented on HBASE-12848:
----------------------------------------

We will be doing the archiving of the WAL files later.  Ideally no need to keep the archived WALs in flash storage. That will be wastage of the resource. The archive op is done by file rename.  Had some discussion with [~tedyu] and [~jingcheng.du@intel.com]. HDFS wont move the file content across different block volumes on rename.  The Mover tool only can do this which has to be invoked explicitly.   We have to solve this some way?  Later on if we try to place some HFiles also (depending on some stats) to SSDs, this might become more critical.

> Utilize Flash storage for WAL
> -----------------------------
>
>                 Key: HBASE-12848
>                 URL: https://issues.apache.org/jira/browse/HBASE-12848
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>             Fix For: 2.0.0, 1.1.0
>
>         Attachments: 12848-v1.patch, 12848-v2.patch, 12848-v3.patch, 12848-v4.patch, 12848-v4.patch
>
>
> One way to improve data ingestion rate is to make use of Flash storage.
> HDFS is doing the heavy lifting - see HDFS-7228.
> We assume an environment where:
> 1. Some servers have a mix of flash, e.g. 2 flash drives and 4 traditional drives.
> 2. Some servers have all traditional storage.
> 3. RegionServers are deployed on both profiles within one HBase cluster.
> This JIRA allows WAL to be managed on flash in a mixed-profile environment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)