You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Vidhyashankar Venkataraman <vi...@yahoo-inc.com> on 2010/08/25 01:39:58 UTC

Crashes when scanning meta..

I was trying to scan the META table of a hbase instance.. And it is unable to..

On further inspection, the region server that hosts the meta tableis filled with exceptions like the following in its logs:

2010-08-24 23:30:58,412 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
java.lang.IllegalArgumentException: offset (808465075) + length (8) exceed the capacity of the array: 8221
        at org.apache.hadoop.hbase.util.Bytes.explainWrongLengthOrOffset(Bytes.java:502)
        at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:480)
        at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:465)
        at org.apache.hadoop.hbase.KeyValue.getTimestamp(KeyValue.java:885)        at org.apache.hadoop.hbase.KeyValue.getTimestamp(KeyValue.java:876)
        at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:150)
        at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:239)
        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:114)
        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:2408)
        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2368)
        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2381)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1860)
        at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:576)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:919)
2010-08-24 23:31:31,469 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: LRU Stats: total=39.56 MB, free=2.3 GB, max=2.34 GB, blocks=2433, accesses=382764, hits=377757, hitRatio=98.69%%, evictions=0, evicted=0, evictedPerRun=NaN
2010-08-24 23:31:52,989 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
java.lang.IllegalArgumentException
        at java.nio.Buffer.position(Buffer.java:218)
        at org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.next(HFile.java:1231)
        at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:87)
        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:82)
        at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:279)
        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:114)
        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:2408)
        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2368)
        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2381)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1860)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1831)
        at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:576)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:919)


Can you guys let me know if this is a known bug? The offset seems dubiously high..

Re: Crashes when scanning meta..

Posted by Jean-Daniel Cryans <jd...@apache.org>.
.META. has a special comparator, if you specify a start row for
example you need to write it like "tablename,," because this is what
the comparator expects.

J-D

On Tue, Aug 24, 2010 at 4:39 PM, Vidhyashankar Venkataraman
<vi...@yahoo-inc.com> wrote:
> I was trying to scan the META table of a hbase instance.. And it is unable to..
>
> On further inspection, the region server that hosts the meta tableis filled with exceptions like the following in its logs:
>
> 2010-08-24 23:30:58,412 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
> java.lang.IllegalArgumentException: offset (808465075) + length (8) exceed the capacity of the array: 8221
>        at org.apache.hadoop.hbase.util.Bytes.explainWrongLengthOrOffset(Bytes.java:502)
>        at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:480)
>        at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:465)
>        at org.apache.hadoop.hbase.KeyValue.getTimestamp(KeyValue.java:885)        at org.apache.hadoop.hbase.KeyValue.getTimestamp(KeyValue.java:876)
>        at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:150)
>        at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:239)
>        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:114)
>        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:2408)
>        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2368)
>        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2381)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1860)
>        at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:576)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:919)
> 2010-08-24 23:31:31,469 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: LRU Stats: total=39.56 MB, free=2.3 GB, max=2.34 GB, blocks=2433, accesses=382764, hits=377757, hitRatio=98.69%%, evictions=0, evicted=0, evictedPerRun=NaN
> 2010-08-24 23:31:52,989 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
> java.lang.IllegalArgumentException
>        at java.nio.Buffer.position(Buffer.java:218)
>        at org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.next(HFile.java:1231)
>        at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:87)
>        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:82)
>        at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:279)
>        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:114)
>        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:2408)
>        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2368)
>        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2381)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1860)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1831)
>        at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:576)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:919)
>
>
> Can you guys let me know if this is a known bug? The offset seems dubiously high..
>

Re: Crashes when scanning meta..

Posted by Ted Yu <yu...@gmail.com>.
What version are you using ?

On Tue, Aug 24, 2010 at 4:39 PM, Vidhyashankar Venkataraman <
vidhyash@yahoo-inc.com> wrote:

> I was trying to scan the META table of a hbase instance.. And it is unable
> to..
>
> On further inspection, the region server that hosts the meta tableis filled
> with exceptions like the following in its logs:
>
> 2010-08-24 23:30:58,412 ERROR
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> java.lang.IllegalArgumentException: offset (808465075) + length (8) exceed
> the capacity of the array: 8221
>        at
> org.apache.hadoop.hbase.util.Bytes.explainWrongLengthOrOffset(Bytes.java:502)
>        at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:480)
>        at org.apache.hadoop.hbase.util.Bytes.toLong(Bytes.java:465)
>        at org.apache.hadoop.hbase.KeyValue.getTimestamp(KeyValue.java:885)
>        at org.apache.hadoop.hbase.KeyValue.getTimestamp(KeyValue.java:876)
>        at
> org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:150)
>        at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:239)
>        at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:114)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:2408)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2368)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2381)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1860)
>        at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:576)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:919)
> 2010-08-24 23:31:31,469 DEBUG
> org.apache.hadoop.hbase.io.hfile.LruBlockCache: LRU Stats: total=39.56 MB,
> free=2.3 GB, max=2.34 GB, blocks=2433, accesses=382764, hits=377757,
> hitRatio=98.69%%, evictions=0, evicted=0, evictedPerRun=NaN
> 2010-08-24 23:31:52,989 ERROR
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> java.lang.IllegalArgumentException
>        at java.nio.Buffer.position(Buffer.java:218)
>        at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.next(HFile.java:1231)
>        at
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:87)
>        at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:82)
>        at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:279)
>        at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:114)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.nextInternal(HRegion.java:2408)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2368)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.next(HRegion.java:2381)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1860)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1831)
>        at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:576)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:919)
>
>
> Can you guys let me know if this is a known bug? The offset seems dubiously
> high..
>