You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "chunhui shen (Updated) (JIRA)" <ji...@apache.org> on 2011/11/27 08:02:39 UTC

[jira] [Updated] (HBASE-4878) Master crash when spliting hlog may cause data loss

     [ https://issues.apache.org/jira/browse/HBASE-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

chunhui shen updated HBASE-4878:
--------------------------------

    Attachment: hbase-4878.diff
    
> Master crash when spliting hlog may cause data loss
> ---------------------------------------------------
>
>                 Key: HBASE-4878
>                 URL: https://issues.apache.org/jira/browse/HBASE-4878
>             Project: HBase
>          Issue Type: Bug
>            Reporter: chunhui shen
>         Attachments: hbase-4878.diff
>
>
> Let's see the code of HlogSplitter#splitLog(final FileStatus[] logfiles)
> {code}
> private List<Path> splitLog(final FileStatus[] logfiles) throws IOException {
>  try {
>   for (FileStatus log : logfiles) {
>   parseHLog(in, logPath, entryBuffers, fs, conf, skipErrors);
>  }
>  archiveLogs(srcDir, corruptedLogs, processedLogs, oldLogDir, fs, conf);
>  } finally {
>       status.setStatus("Finishing writing output logs and closing down.");
>       splits = outputSink.finishWritingAndClose();
>     }
> }
> {code}
> If master is killed, after finishing archiveLogs(srcDir, corruptedLogs, processedLogs, oldLogDir, fs, conf), 
> but before finishing splits = outputSink.finishWritingAndClose();
> Log date would loss!

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira