You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jay Whittaker <ja...@stealthintelligence.co.uk> on 2012/08/16 18:34:49 UTC

Region Lease time outs

Hey,

We are trying to run map reduce jobs against our Hbase cluster and we get a lot of lease exceptions I have increased the rpc timeouts and region timeouts to 10 mins. Not too sure why we are still getting these errors though.


org.apache.hadoop.hbase.regionserver.LeaseException: org.apache.hadoop.hbase.regionserver.LeaseException: lease '4843012751508326142' does not exist

        at org.apache.hadoop.hbase.regionserver.Leases.removeLease(Leases.java:231)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2366)
        at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1376)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
        at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:119)
        at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:39)
        at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:163)
        at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:274)
        at org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:173)
        at org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:135)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532)
        at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)

Re: Region Lease time outs

Posted by Jay Whittaker <ja...@stealthintelligence.co.uk>.
We are using Hbase 0.94.0 and hadoop 1.0.3

Thanks





On 16/08/2012 17:41, "Andrew Purtell" <ap...@apache.org> wrote:

>Jay,
>
>On Thu, Aug 16, 2012 at 9:34 AM, Jay Whittaker
><ja...@stealthintelligence.co.uk> wrote:
>> We are trying to run map reduce jobs against our Hbase cluster and we
>>get a lot of lease exceptions I have increased the rpc timeouts and
>>region timeouts to 10 mins. Not too sure why we are still getting these
>>errors though.
>>
>> org.apache.hadoop.hbase.regionserver.LeaseException:
>>org.apache.hadoop.hbase.regionserver.LeaseException: lease
>>'4843012751508326142' does not exist
>
>What version of HBase?
>
>Best regards,
>
>   - Andy
>
>Problems worthy of attack prove their worth by hitting back. - Piet
>Hein (via Tom White)

Re: Region Lease time outs

Posted by Andrew Purtell <ap...@apache.org>.
Jay,

On Thu, Aug 16, 2012 at 9:34 AM, Jay Whittaker
<ja...@stealthintelligence.co.uk> wrote:
> We are trying to run map reduce jobs against our Hbase cluster and we get a lot of lease exceptions I have increased the rpc timeouts and region timeouts to 10 mins. Not too sure why we are still getting these errors though.
>
> org.apache.hadoop.hbase.regionserver.LeaseException: org.apache.hadoop.hbase.regionserver.LeaseException: lease '4843012751508326142' does not exist

What version of HBase?

Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)