[jira] [Comment Edited] (HBASE-14417) Incremental backup and bulk loading

["Ted Yu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449854#comment-15449854 ] 

Ted Yu edited comment on HBASE-14417 at 8/31/16 2:55 PM:
---------------------------------------------------------

In backup package, a new class would be added which extends WALActionsListener.Base
It overrides postAppend() where we look for Cell with qualifier of WALEdit.BULK_LOAD.
If found, BulkLoadDescriptor is extracted and StoreDescriptor's can be retrieved.
The store file list would be persisted to hbase:backup table.


was (Author: yuzhihong@gmail.com):
In principal, the above is in line with my earlier comments.

> Incremental backup and bulk loading
> -----------------------------------
>
>                 Key: HBASE-14417
>                 URL: https://issues.apache.org/jira/browse/HBASE-14417
>             Project: HBase
>          Issue Type: New Feature
>    Affects Versions: 2.0.0
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>            Priority: Critical
>              Labels: backup
>             Fix For: 2.0.0
>
>
> Currently, incremental backup is based on WAL files. Bulk data loading bypasses WALs for obvious reasons, breaking incremental backups. The only way to continue backups after bulk loading is to create new full backup of a table. This may not be feasible for customers who do bulk loading regularly (say, every day).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)