You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Billy Pearson (JIRA)" <ji...@apache.org> on 2008/07/08 08:36:38 UTC

[jira] Commented: (HBASE-728) Supporting for HLog appends

    [ https://issues.apache.org/jira/browse/HBASE-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611469#action_12611469 ] 

Billy Pearson commented on HBASE-728:
-------------------------------------

The Major item needing appends in HBase is HLog so we can handle crashed regional servers with out data loss. Currently we could lose up to 30K updates if a server fails.

I was thanking we should maybe thank of something like mysql does with innodb database
innodb_flush_log_at_trx_commit

Options:
1 = HLog buffer is flushed to disk with each update.
2 = HLog buffer is flushed to disk once per second or every x secs.
3 = HLog buffer is flushed to disk when reached x size.

Clearly option 1 would be slower per update as we would have to append to the file with each change but that would allow us an option to have zero data loss and options 2-3 would give users option to chose how much data lose would be acceptable for a performance increase.

> Supporting for HLog appends
> ---------------------------
>
>                 Key: HBASE-728
>                 URL: https://issues.apache.org/jira/browse/HBASE-728
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>    Affects Versions: 0.3.0
>            Reporter: Billy Pearson
>            Priority: Trivial
>
> I thank we should open a ticket to track what needs changed to support appends when the coding is done on HADOOP-1700.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.