You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Anoop Sam John (Jira)" <ji...@apache.org> on 2019/09/20 15:58:00 UTC
[jira] [Assigned] (HBASE-22890) Verify the files when RegionServer
is starting and BucketCache is in file mode
[ https://issues.apache.org/jira/browse/HBASE-22890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anoop Sam John reassigned HBASE-22890:
--------------------------------------
Assignee: zbq.dean
> Verify the files when RegionServer is starting and BucketCache is in file mode
> ------------------------------------------------------------------------------
>
> Key: HBASE-22890
> URL: https://issues.apache.org/jira/browse/HBASE-22890
> Project: HBase
> Issue Type: Improvement
> Components: BucketCache
> Affects Versions: 1.4.6, 1.4.10, 1.3.5
> Reporter: zbq.dean
> Assignee: zbq.dean
> Priority: Major
> Fix For: 1.5.0, 1.4.11
>
> Attachments: HBASE-22890.branch-1.0001.patch
>
>
> We use FileIOEngine in BucketCache and have configured <hbase.bucketcache.persistent.path>. If the RegionServer is stopped, and the cache data file or the backingMap persistence file is deleted or changed before the RegionServer is restarted. When restart RegionServer, the backingMap and cache data are Inconsistent, and get or scan command will get IOException like follows:
> bucket.BucketCache: Failed reading block 18951416e2ca4e8bbc11523f4f5ea576_1125745279 from bucket cache
> java.io.IOException: Invalid HFile block magic: \x00\x00\x00\x00\x00\x00\x00\x00
> at org.apache.hadoop.hbase.io.hfile.BlockType.parse(BlockType.java:154)
> at org.apache.hadoop.hbase.io.hfile.BlockType.read(BlockType.java:167)
> at org.apache.hadoop.hbase.io.hfile.HFileBlock.<init>(HFileBlock.java:347)
> at org.apache.hadoop.hbase.io.hfile.HFileBlock$1.deserialize(HFileBlock.java:247)
> at org.apache.hadoop.hbase.io.hfile.HFileBlock$1.deserialize(HFileBlock.java:226)
> at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:514)
> ......
--
This message was sent by Atlassian Jira
(v8.3.4#803005)