You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Mike Drob (JIRA)" <ji...@apache.org> on 2018/06/20 18:35:00 UTC
[jira] [Commented] (HBASE-20761) FSReaderImpl#readBlockDataInternal
can fail to switch to HDFS checksums in some edge cases
[ https://issues.apache.org/jira/browse/HBASE-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16518458#comment-16518458 ]
Mike Drob commented on HBASE-20761:
-----------------------------------
Was SCR enabled?
> FSReaderImpl#readBlockDataInternal can fail to switch to HDFS checksums in some edge cases
> ------------------------------------------------------------------------------------------
>
> Key: HBASE-20761
> URL: https://issues.apache.org/jira/browse/HBASE-20761
> Project: HBase
> Issue Type: Bug
> Components: HFile
> Reporter: Esteban Gutierrez
> Assignee: Esteban Gutierrez
> Priority: Major
>
> One of our users reported this problem on HBase 1.2 before and after HBASE-11625:
> {code}
> Caused by: java.io.IOException: On-disk size without header provided is 131131, but block header contains 0. Block offset: 2073954793, data starts with: \x00\x00\x00\x00\x00\x00\x00\x0\
> 0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00
> at org.apache.hadoop.hbase.io.hfile.HFileBlock.validateOnDiskSizeWithoutHeader(HFileBlock.java:526)
> at org.apache.hadoop.hbase.io.hfile.HFileBlock.access$700(HFileBlock.java:92)
> at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockDataInternal(HFileBlock.java:1699)
> at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockData(HFileBlock.java:1542)
> at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:445)
> at org.apache.hadoop.hbase.util.CompoundBloomFilter.contains(CompoundBloomFilter.java:100)
> {code}
> The problems occurs when we do a read a block without HDFS checksums enabled and due some data corruption we end with an empty headerBuf while trying to read the block before the HDFS checksum failover code. This will cause further attempts to read the block to fail since we will still retry the corrupt replica instead of reporting the corrupt replica and trying a different one.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)