You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Guanghao Zhang (Jira)" <ji...@apache.org> on 2020/01/03 09:09:00 UTC

[jira] [Created] (HBASE-23633) Find a way to handle the corrupt recovered hfiles

Guanghao Zhang created HBASE-23633:
--------------------------------------

             Summary: Find a way to handle the corrupt recovered hfiles
                 Key: HBASE-23633
                 URL: https://issues.apache.org/jira/browse/HBASE-23633
             Project: HBase
          Issue Type: Umbrella
            Reporter: Guanghao Zhang


Copy the comment from PR review.

 

If the file is a corrupt HFile, an exception will be thrown here, which will cause the region to fail to open.
Maybe we can add a new parameter to control whether to skip the exception, similar to recover edits which has a parameter "hbase.hregion.edits.replay.skip.errors";

 

Regions that can't be opened because of detached References or corrupt hfiles are a fact-of-life. We need work on this issue. This will be a new variant on the problem -- i.e. bad recovered hfiles.

On adding a config to ignore bad files and just open, thats a bit dangerous as per @infraio .... as it could mean silent data loss.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)