You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Talat Uyarer <ta...@uyarer.com> on 2015/03/25 09:47:11 UTC

Hbase PrefixFilter Problem

Hi all,

I try to use Prefix Filter on hbase shell. It throws an exception. I
do not understand its reason. Could you help me ?

scan 'table1',{FILTER => "PrefixFilter('Row1')", LIMIT => 1}

ROW
COLUMN+CELL
ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
request=scanner_id: 154160 number_of_rows: 100 close_scanner: false
next_call_seq: 0
at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3198)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29925)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:116)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:96)
at java.lang.Thread.run(Thread.java:745)

Thanks
-- 
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304

Re: Hbase PrefixFilter Problem

Posted by Mateusz Kaczynski <ma...@arachnys.com>.
We've had jobs dying because of this, a quick workaround was in our case to
decrease hbase.client.scanner.caching (to 100) and increase
hbase.rpc.timeout and hbase.client.scanner.timeout.period
(to 450000 and 300000).

On 25 March 2015 at 14:36, Talat Uyarer <ta...@uyarer.com> wrote:

> Hi,
>
> I use HBase 0.98.6-cdh5.3.2.
>
> Only one regionserver has some warn logs. like this:
>
> 2:31:29.312 PMWARNorg.apache.hadoop.ipc.RpcServer
>
> RpcServer.respondercallId: 1456110 service: ClientService methodName:
> Scan size: 24 connection: 192.168.0.10:47064: output error
>
> 2:31:29.313 PMWARNorg.apache.hadoop.ipc.RpcServer
>
> B.defaultRpcServer.handler=24,queue=0,port=60020: caught a
> ClosedChannelException, this means that the server was processing a
> request but the client went away. The error message was: null
>
> Talat
>
> 2015-03-25 15:52 GMT+02:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> > Also, which HBase version is it?
> >
> > 2015-03-25 9:47 GMT-04:00 ramkrishna vasudevan <
> > ramkrishna.s.vasudevan@gmail.com>:
> >
> >> Can you see if there is any exception in the Regionserver logs?
> >>
> >> On Wed, Mar 25, 2015 at 2:17 PM, Talat Uyarer <ta...@uyarer.com> wrote:
> >>
> >> > Hi all,
> >> >
> >> > I try to use Prefix Filter on hbase shell. It throws an exception. I
> >> > do not understand its reason. Could you help me ?
> >> >
> >> > scan 'table1',{FILTER => "PrefixFilter('Row1')", LIMIT => 1}
> >> >
> >> > ROW
> >> > COLUMN+CELL
> >> > ERROR:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> >> > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> >> > request=scanner_id: 154160 number_of_rows: 100 close_scanner: false
> >> > next_call_seq: 0
> >> > at
> >> >
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3198)
> >> > at
> >> >
> >>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29925)
> >> > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
> >> > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
> >> > at
> >> >
> >>
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:116)
> >> > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:96)
> >> > at java.lang.Thread.run(Thread.java:745)
> >> >
> >> > Thanks
> >> > --
> >> > Talat UYARER
> >> > Websitesi: http://talat.uyarer.com
> >> > Twitter: http://twitter.com/talatuyarer
> >> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >> >
> >>
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>



-- 
*Mateusz Kaczynski*
*Senior Developer*
*mateusz@arachnys.com <ma...@arachnys.com>*
+44 7518970588

Arachnys
Powering due diligence in emerging markets

Read our blog here <http://blog.arachnys.com/>
Follow us on twitter @arachnys
Explore our data here <http://compass.arachnys.com/>

Re: Hbase PrefixFilter Problem

Posted by Talat Uyarer <ta...@uyarer.com>.
Hi,

I use HBase 0.98.6-cdh5.3.2.

Only one regionserver has some warn logs. like this:

2:31:29.312 PMWARNorg.apache.hadoop.ipc.RpcServer

RpcServer.respondercallId: 1456110 service: ClientService methodName:
Scan size: 24 connection: 192.168.0.10:47064: output error

2:31:29.313 PMWARNorg.apache.hadoop.ipc.RpcServer

B.defaultRpcServer.handler=24,queue=0,port=60020: caught a
ClosedChannelException, this means that the server was processing a
request but the client went away. The error message was: null

Talat

2015-03-25 15:52 GMT+02:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Also, which HBase version is it?
>
> 2015-03-25 9:47 GMT-04:00 ramkrishna vasudevan <
> ramkrishna.s.vasudevan@gmail.com>:
>
>> Can you see if there is any exception in the Regionserver logs?
>>
>> On Wed, Mar 25, 2015 at 2:17 PM, Talat Uyarer <ta...@uyarer.com> wrote:
>>
>> > Hi all,
>> >
>> > I try to use Prefix Filter on hbase shell. It throws an exception. I
>> > do not understand its reason. Could you help me ?
>> >
>> > scan 'table1',{FILTER => "PrefixFilter('Row1')", LIMIT => 1}
>> >
>> > ROW
>> > COLUMN+CELL
>> > ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
>> > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
>> > request=scanner_id: 154160 number_of_rows: 100 close_scanner: false
>> > next_call_seq: 0
>> > at
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3198)
>> > at
>> >
>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29925)
>> > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
>> > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
>> > at
>> >
>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:116)
>> > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:96)
>> > at java.lang.Thread.run(Thread.java:745)
>> >
>> > Thanks
>> > --
>> > Talat UYARER
>> > Websitesi: http://talat.uyarer.com
>> > Twitter: http://twitter.com/talatuyarer
>> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>> >
>>



-- 
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304

Re: Hbase PrefixFilter Problem

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Also, which HBase version is it?

2015-03-25 9:47 GMT-04:00 ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com>:

> Can you see if there is any exception in the Regionserver logs?
>
> On Wed, Mar 25, 2015 at 2:17 PM, Talat Uyarer <ta...@uyarer.com> wrote:
>
> > Hi all,
> >
> > I try to use Prefix Filter on hbase shell. It throws an exception. I
> > do not understand its reason. Could you help me ?
> >
> > scan 'table1',{FILTER => "PrefixFilter('Row1')", LIMIT => 1}
> >
> > ROW
> > COLUMN+CELL
> > ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> > request=scanner_id: 154160 number_of_rows: 100 close_scanner: false
> > next_call_seq: 0
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3198)
> > at
> >
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29925)
> > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
> > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
> > at
> >
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:116)
> > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:96)
> > at java.lang.Thread.run(Thread.java:745)
> >
> > Thanks
> > --
> > Talat UYARER
> > Websitesi: http://talat.uyarer.com
> > Twitter: http://twitter.com/talatuyarer
> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >
>

Re: Hbase PrefixFilter Problem

Posted by ramkrishna vasudevan <ra...@gmail.com>.
Can you see if there is any exception in the Regionserver logs?

On Wed, Mar 25, 2015 at 2:17 PM, Talat Uyarer <ta...@uyarer.com> wrote:

> Hi all,
>
> I try to use Prefix Filter on hbase shell. It throws an exception. I
> do not understand its reason. Could you help me ?
>
> scan 'table1',{FILTER => "PrefixFilter('Row1')", LIMIT => 1}
>
> ROW
> COLUMN+CELL
> ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 154160 number_of_rows: 100 close_scanner: false
> next_call_seq: 0
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3198)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29925)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:116)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:96)
> at java.lang.Thread.run(Thread.java:745)
>
> Thanks
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>

Re: Hbase PrefixFilter Problem

Posted by lars hofhansl <la...@apache.org>.
Do you have a lot of data? This means the scanner took too long on the server and the client essentially timed out.

PrefixFilter does not actually skip ahead to the first row in question. You always have to also set the scanner's startRow to the first row you care about (i.e. the prefix).In your case also set the startRow to 'Row1'.
-- Lars

      From: Talat Uyarer <ta...@uyarer.com>
 To: HBase User <us...@hbase.apache.org> 
 Sent: Wednesday, March 25, 2015 1:47 AM
 Subject: Hbase PrefixFilter Problem
   
Hi all,

I try to use Prefix Filter on hbase shell. It throws an exception. I
do not understand its reason. Could you help me ?

scan 'table1',{FILTER => "PrefixFilter('Row1')", LIMIT => 1}

ROW
COLUMN+CELL
ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
request=scanner_id: 154160 number_of_rows: 100 close_scanner: false
next_call_seq: 0
at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3198)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29925)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:116)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:96)
at java.lang.Thread.run(Thread.java:745)

Thanks
-- 
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304