You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Apekshit Sharma (JIRA)" <ji...@apache.org> on 2015/05/22 00:42:18 UTC
[jira] [Updated] (HBASE-12789)
TestCacheOnWrite#testStoreFileCacheOnWrite sometimes fails with HFileBlock
cached assertion failure
[ https://issues.apache.org/jira/browse/HBASE-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apekshit Sharma updated HBASE-12789:
------------------------------------
Description:
Since cacheOnWrite is INDEX_BLOCKS, ENCODED_DATA or DATA blocks should not be cached (shouldBeCached: false) but are still being cached (isCached: true).
I have also seen this happening when cacheOnWrite is BLOOM_BLOCKS.
>From https://builds.apache.org/job/HBase-TRUNK/5980/testReport/junit/org.apache.hadoop.hbase.io.hfile/TestCacheOnWrite/testStoreFileCacheOnWrite_106_/ :
{code}
java.lang.AssertionError: shouldBeCached: false
isCached: true
Test description: [cacheOnWrite=INDEX_BLOCKS, compress=GZ, encoderType=BLOCK_ENCODING_EVERYWHERE, cacheCompressedData=false]
block: HFileBlock [ fileOffset=12046 headerSize()=33 blockType=ENCODED_DATA onDiskSizeWithoutHeader=1325 uncompressedSizeWithoutHeader=1591 prevBlockOffset=10457 isUseHBaseChecksum()=true checksumType=NULL bytesPerChecksum=512 onDiskDataSizeWithHeader=1346 getOnDiskSizeWithHeader()=1358 totalChecksumBytes()=12 isUnpacked()=true buf=[ java.nio.HeapByteBuffer[pos=0 lim=1636 cap=1669] ] dataBeginsWith=\x00\x02\x00\x00\x08N.\x1D\x00\x00 aaaaaaaaaaaaaaaaaaaaa fileContext=HFileContext [ usesHBaseChecksum=true checksumType=NULL bytesPerChecksum=512 blocksize=65536 encoding=NONE includesMvcc=true includesTags=true compressAlgo=NONE compressTags=false cryptoContext=[ cipher=NONE keyHash=NONE ] ] ]
encodingInCache: PREFIX
blockCacheKey: bfdf56eb18464371a17ed05500e189d6_12046
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.readStoreFile(TestCacheOnWrite.java:285)
at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWriteInternals(TestCacheOnWrite.java:244)
at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWrite(TestCacheOnWrite.java:239)
{code}
was:
>From https://builds.apache.org/job/HBase-TRUNK/5980/testReport/junit/org.apache.hadoop.hbase.io.hfile/TestCacheOnWrite/testStoreFileCacheOnWrite_106_/ :
{code}
java.lang.AssertionError: shouldBeCached: false
isCached: true
Test description: [cacheOnWrite=INDEX_BLOCKS, compress=GZ, encoderType=BLOCK_ENCODING_EVERYWHERE, cacheCompressedData=false]
block: HFileBlock [ fileOffset=12046 headerSize()=33 blockType=ENCODED_DATA onDiskSizeWithoutHeader=1325 uncompressedSizeWithoutHeader=1591 prevBlockOffset=10457 isUseHBaseChecksum()=true checksumType=NULL bytesPerChecksum=512 onDiskDataSizeWithHeader=1346 getOnDiskSizeWithHeader()=1358 totalChecksumBytes()=12 isUnpacked()=true buf=[ java.nio.HeapByteBuffer[pos=0 lim=1636 cap=1669] ] dataBeginsWith=\x00\x02\x00\x00\x08N.\x1D\x00\x00 aaaaaaaaaaaaaaaaaaaaa fileContext=HFileContext [ usesHBaseChecksum=true checksumType=NULL bytesPerChecksum=512 blocksize=65536 encoding=NONE includesMvcc=true includesTags=true compressAlgo=NONE compressTags=false cryptoContext=[ cipher=NONE keyHash=NONE ] ] ]
encodingInCache: PREFIX
blockCacheKey: bfdf56eb18464371a17ed05500e189d6_12046
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.readStoreFile(TestCacheOnWrite.java:285)
at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWriteInternals(TestCacheOnWrite.java:244)
at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWrite(TestCacheOnWrite.java:239)
{code}
> TestCacheOnWrite#testStoreFileCacheOnWrite sometimes fails with HFileBlock cached assertion failure
> ---------------------------------------------------------------------------------------------------
>
> Key: HBASE-12789
> URL: https://issues.apache.org/jira/browse/HBASE-12789
> Project: HBase
> Issue Type: Test
> Reporter: Ted Yu
> Priority: Minor
>
> Since cacheOnWrite is INDEX_BLOCKS, ENCODED_DATA or DATA blocks should not be cached (shouldBeCached: false) but are still being cached (isCached: true).
> I have also seen this happening when cacheOnWrite is BLOOM_BLOCKS.
> From https://builds.apache.org/job/HBase-TRUNK/5980/testReport/junit/org.apache.hadoop.hbase.io.hfile/TestCacheOnWrite/testStoreFileCacheOnWrite_106_/ :
> {code}
> java.lang.AssertionError: shouldBeCached: false
> isCached: true
> Test description: [cacheOnWrite=INDEX_BLOCKS, compress=GZ, encoderType=BLOCK_ENCODING_EVERYWHERE, cacheCompressedData=false]
> block: HFileBlock [ fileOffset=12046 headerSize()=33 blockType=ENCODED_DATA onDiskSizeWithoutHeader=1325 uncompressedSizeWithoutHeader=1591 prevBlockOffset=10457 isUseHBaseChecksum()=true checksumType=NULL bytesPerChecksum=512 onDiskDataSizeWithHeader=1346 getOnDiskSizeWithHeader()=1358 totalChecksumBytes()=12 isUnpacked()=true buf=[ java.nio.HeapByteBuffer[pos=0 lim=1636 cap=1669] ] dataBeginsWith=\x00\x02\x00\x00\x08N.\x1D\x00\x00 aaaaaaaaaaaaaaaaaaaaa fileContext=HFileContext [ usesHBaseChecksum=true checksumType=NULL bytesPerChecksum=512 blocksize=65536 encoding=NONE includesMvcc=true includesTags=true compressAlgo=NONE compressTags=false cryptoContext=[ cipher=NONE keyHash=NONE ] ] ]
> encodingInCache: PREFIX
> blockCacheKey: bfdf56eb18464371a17ed05500e189d6_12046
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.readStoreFile(TestCacheOnWrite.java:285)
> at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWriteInternals(TestCacheOnWrite.java:244)
> at org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testStoreFileCacheOnWrite(TestCacheOnWrite.java:239)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)