Re: HBase with RawLocalFileSystem

[Manish Sethi <ma...@in.ibm.com>]

Just to add to the following, if it helps in understanding the problem 
better...

The build works fine with default 'LocalFileSystem'. Further, the scans 
seems to work fine when the region is scanned in a coprocessor. It throws 
the exception shown in the following email only when scanned at client 
side.

Thanks,
Manish



From:   Manish Sethi/India/IBM@IBMIN
To:     user@hbase.apache.org, 
Date:   10/12/2011 01:24 AM
Subject:        HBase with RawLocalFileSystem



Hi, 

I'm trying to run HBase 0.92 build #177 from Jenkins Server with 
RawLocalFileSystem in order to avoid checksum. I have added a property 
(fs.file.impl) in hbase-site.xml for this.
Writes go fine with this. However, during scans, occasionally, it passes 
through but most of the time it fails with following exception.

Please let me know, if I an missing something here.

Thanks,
Manish

java.io.IOException: Could not seek StoreFileScanner[HFileScanner for 
reader reader=<hfilepath>, ...]
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseek(StoreFileScanner.java:131)
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekExactly(StoreFileScanner.java:219)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap$SeekType$2.seek(KeyValueHeap.java:64)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap.generalizedSeek(KeyValueHeap.java:277)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap.seekExactly(KeyValueHeap.java:257)
        at 
org.apache.hadoop.hbase.regionserver.StoreScanner.reseek(StoreScanner.java:421)
        at 
org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:285)
        at 
org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:138)
        at 
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:2936)
        at 
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2892)
        at 
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2909)
        at 
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2121)
        at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at 
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at 
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1325)
Caused by: java.io.IOException: Invalid HFile block magic:  assessm
        at 
org.apache.hadoop.hbase.io.hfile.BlockType.parse(BlockType.java:110)
        at 
org.apache.hadoop.hbase.io.hfile.BlockType.read(BlockType.java:121)
        at 
org.apache.hadoop.hbase.io.hfile.HFileBlock.<init>(HFileBlock.java:167)
        at 
org.apache.hadoop.hbase.io.hfile.HFileBlock.<init>(HFileBlock.java:76)
        at 
org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderV2.readBlockData(HFileBlock.java:1324)
        at 
org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:269)
        at 
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.readNextDataBlock(HFileReaderV2.java:454)
        at 
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:418)
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseekAtOrAfter(StoreFileScanner.java:200)
        at 
org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseek(StoreFileScanner.java:124)
        ... 16 more