You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "Skovronik, Amir" <as...@akamai.com> on 2013/01/13 15:04:58 UTC
exception during coprocessor run
Hi
I am using version 0.94.3, while running an end point coprocessor I get the following exception sometimes when running scan on an internal scanner:
2013-01-13 15:09:14,742 ERROR HRegionServer -
org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call execCoprocessor([B@105f3de6, execute(RTR, {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1, client version=0, methodsFingerPrint=0), rpc version=1, client version=29, methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms, since caller disconnected
at org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
at com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
at org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
Please advise
Thanks
Re: exception during coprocessor run
Posted by Andrew Purtell <ap...@apache.org>.
It's the default timeout for client RPC, hbase.rpc.timeout.
On Sunday, January 13, 2013, Asaf Mesika wrote:
> Where is the 60 sec timeout defined?
>
> Sent from my iPhone
>
> On 13 בינו 2013, at 22:28, Himanshu Vashishtha <hvashish@cs.ualberta.ca<javascript:;>
> >
> wrote:
>
> How much time your CP calls take? more than 60sec?
>
> On Sun, Jan 13, 2013 at 11:42 AM, Andrew Purtell <apurtell@apache.org<javascript:;>
> >
> wrote:
>
> This means your client disconnected.
>
>
>
> On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <askovron@akamai.com<javascript:;>
> >wrote:
>
>
> Hi
>
>
> I am using version 0.94.3, while running an end point coprocessor I get
>
> the following exception sometimes when running scan on an internal scanner:
>
>
>
> 2013-01-13 15:09:14,742 ERROR HRegionServer -
>
>
> org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
>
> execCoprocessor([B@105f3de6, execute(RTR,
>
>
> {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
>
> Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
>
> client version=0, methodsFingerPrint=0), rpc version=1, client version=29,
>
> methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms, since
>
> caller disconnected
>
>
> at
>
>
> org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
>
>
> at
>
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
>
>
> at
>
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
>
>
> at
>
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
>
>
> at
>
>
> com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
>
>
> at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
>
>
> at
>
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
>
> at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
>
>
> at
>
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
>
>
> at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
>
>
> at
>
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
>
> at
>
>
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>
>
> at
>
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
>
>
>
> Please advise
>
>
> Thanks
>
>
>
>
>
> --
>
> Best regards,
>
>
> - Andy
>
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>
> (via Tom White)
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: exception during coprocessor run
Posted by Asaf Mesika <as...@gmail.com>.
Where is the 60 sec timeout defined?
Sent from my iPhone
On 13 בינו 2013, at 22:28, Himanshu Vashishtha <hv...@cs.ualberta.ca>
wrote:
How much time your CP calls take? more than 60sec?
On Sun, Jan 13, 2013 at 11:42 AM, Andrew Purtell <ap...@apache.org>
wrote:
This means your client disconnected.
On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <as...@akamai.com>wrote:
Hi
I am using version 0.94.3, while running an end point coprocessor I get
the following exception sometimes when running scan on an internal scanner:
2013-01-13 15:09:14,742 ERROR HRegionServer -
org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
execCoprocessor([B@105f3de6, execute(RTR,
{"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
client version=0, methodsFingerPrint=0), rpc version=1, client version=29,
methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms, since
caller disconnected
at
org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
at
com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
Please advise
Thanks
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: exception during coprocessor run
Posted by "Skovronik, Amir" <as...@akamai.com>.
No more like 3 sec
On 1/13/13 10:28 PM, "Himanshu Vashishtha" <hv...@cs.ualberta.ca> wrote:
>How much time your CP calls take? more than 60sec?
>
>On Sun, Jan 13, 2013 at 11:42 AM, Andrew Purtell <ap...@apache.org>
>wrote:
>> This means your client disconnected.
>>
>>
>> On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir
>><as...@akamai.com>wrote:
>>
>>> Hi
>>>
>>> I am using version 0.94.3, while running an end point coprocessor I get
>>> the following exception sometimes when running scan on an internal
>>>scanner:
>>>
>>>
>>> 2013-01-13 15:09:14,742 ERROR HRegionServer -
>>>
>>> org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
>>> execCoprocessor([B@105f3de6, execute(RTR,
>>>
>>>{"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\
>>>x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\x
>>>B3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\
>>>\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\
>>>x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":
>>>0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Fi
>>>eld
>>> Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
>>> client version=0, methodsFingerPrint=0), rpc version=1, client
>>>version=29,
>>> methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms,
>>>since
>>> caller disconnected
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisco
>>>nnected(HBaseServer.java:436)
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInter
>>>nal(HRegion.java:3489)
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HReg
>>>ion.java:3447)
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HReg
>>>ion.java:3464)
>>>
>>> at
>>>
>>>com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocess
>>>orImpl.java:124)
>>>
>>> at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
>>>
>>> at
>>>
>>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
>>>Impl.java:25)
>>>
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>> at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegi
>>>onServer.java:3551)
>>>
>>> at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
>>>
>>> at
>>>
>>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
>>>Impl.java:25)
>>>
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEng
>>>ine.java:364)
>>>
>>> at
>>>
>>>org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:142
>>>6)
>>>
>>>
>>> Please advise
>>>
>>> Thanks
>>>
>>
>>
>>
>> --
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
Re: exception during coprocessor run
Posted by Himanshu Vashishtha <hv...@cs.ualberta.ca>.
How much time your CP calls take? more than 60sec?
On Sun, Jan 13, 2013 at 11:42 AM, Andrew Purtell <ap...@apache.org> wrote:
> This means your client disconnected.
>
>
> On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <as...@akamai.com>wrote:
>
>> Hi
>>
>> I am using version 0.94.3, while running an end point coprocessor I get
>> the following exception sometimes when running scan on an internal scanner:
>>
>>
>> 2013-01-13 15:09:14,742 ERROR HRegionServer -
>>
>> org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
>> execCoprocessor([B@105f3de6, execute(RTR,
>> {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
>> Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
>> client version=0, methodsFingerPrint=0), rpc version=1, client version=29,
>> methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms, since
>> caller disconnected
>>
>> at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
>>
>> at
>> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
>>
>> at
>> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
>>
>> at
>> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
>>
>> at
>> com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
>>
>> at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
>>
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>> at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
>>
>> at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
>>
>> at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
>>
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>
>> at
>> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>>
>> at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
>>
>>
>> Please advise
>>
>> Thanks
>>
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
Re: exception during coprocessor run
Posted by Andrew Purtell <ap...@apache.org>.
This means your client disconnected.
On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <as...@akamai.com>wrote:
> Hi
>
> I am using version 0.94.3, while running an end point coprocessor I get
> the following exception sometimes when running scan on an internal scanner:
>
>
> 2013-01-13 15:09:14,742 ERROR HRegionServer -
>
> org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
> execCoprocessor([B@105f3de6, execute(RTR,
> {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
> Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
> client version=0, methodsFingerPrint=0), rpc version=1, client version=29,
> methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms, since
> caller disconnected
>
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
>
> at
> com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
>
> at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
>
> at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
>
>
> Please advise
>
> Thanks
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: exception during coprocessor run
Posted by "Skovronik, Amir" <as...@akamai.com>.
Hi
I am running on mini cluster, so there should not be any connection
problems since every thing is on one machine
On 1/13/13 6:08 PM, "Anoop John" <an...@gmail.com> wrote:
>HBase throw this Exception when the connection btw the client process and
>the RS process (connection through which the op request came) is broken.
>Any issues with your client app or nw? The operation will be getting
>retried from client right?
>
>-Anoop-
>
>On Sun, Jan 13, 2013 at 8:24 PM, Ted Yu <yu...@gmail.com> wrote:
>
>> Here is related code:
>> public void throwExceptionIfCallerDisconnected() throws
>> CallerDisconnectedException {
>> if (!connection.channel.isOpen()) {
>>
>> Have you checked data node log on 172.29.40.178
>> <http://172.29.40.178:50769>around 15:09:14,742 to see what was
>> happening ?
>>
>> Cheers
>>
>> On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <askovron@akamai.com
>> >wrote:
>>
>> > Hi
>> >
>> > I am using version 0.94.3, while running an end point coprocessor I
>>get
>> > the following exception sometimes when running scan on an internal
>> scanner:
>> >
>> >
>> > 2013-01-13 15:09:14,742 ERROR HRegionServer -
>> >
>> > org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
>> > execCoprocessor([B@105f3de6, execute(RTR,
>> >
>>
>>{"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x
>>03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3
>>b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9
>>F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f
>>\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"ca
>>cheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
>> > Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
>> > client version=0, methodsFingerPrint=0), rpc version=1, client
>> version=29,
>> > methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms,
>> since
>> > caller disconnected
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDiscon
>>nected(HBaseServer.java:436)
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextIntern
>>al(HRegion.java:3489)
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegi
>>on.java:3447)
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegi
>>on.java:3464)
>> >
>> > at
>> >
>>
>>com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocesso
>>rImpl.java:124)
>> >
>> > at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
>> >
>> > at
>> >
>>
>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI
>>mpl.java:25)
>> >
>> > at java.lang.reflect.Method.invoke(Method.java:597)
>> >
>> > at
>>org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegio
>>nServer.java:3551)
>> >
>> > at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
>> >
>> > at
>> >
>>
>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI
>>mpl.java:25)
>> >
>> > at java.lang.reflect.Method.invoke(Method.java:597)
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngi
>>ne.java:364)
>> >
>> > at
>> >
>>
>>org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426
>>)
>> >
>> >
>> > Please advise
>> >
>> > Thanks
>> >
>>
Re: exception during coprocessor run
Posted by Anoop John <an...@gmail.com>.
HBase throw this Exception when the connection btw the client process and
the RS process (connection through which the op request came) is broken.
Any issues with your client app or nw? The operation will be getting
retried from client right?
-Anoop-
On Sun, Jan 13, 2013 at 8:24 PM, Ted Yu <yu...@gmail.com> wrote:
> Here is related code:
> public void throwExceptionIfCallerDisconnected() throws
> CallerDisconnectedException {
> if (!connection.channel.isOpen()) {
>
> Have you checked data node log on 172.29.40.178
> <http://172.29.40.178:50769>around 15:09:14,742 to see what was
> happening ?
>
> Cheers
>
> On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <askovron@akamai.com
> >wrote:
>
> > Hi
> >
> > I am using version 0.94.3, while running an end point coprocessor I get
> > the following exception sometimes when running scan on an internal
> scanner:
> >
> >
> > 2013-01-13 15:09:14,742 ERROR HRegionServer -
> >
> > org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
> > execCoprocessor([B@105f3de6, execute(RTR,
> >
> {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
> > Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
> > client version=0, methodsFingerPrint=0), rpc version=1, client
> version=29,
> > methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms,
> since
> > caller disconnected
> >
> > at
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
> >
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
> >
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
> >
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
> >
> > at
> >
> com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
> >
> > at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
> >
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >
> > at java.lang.reflect.Method.invoke(Method.java:597)
> >
> > at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
> >
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
> >
> > at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
> >
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >
> > at java.lang.reflect.Method.invoke(Method.java:597)
> >
> > at
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> >
> > at
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
> >
> >
> > Please advise
> >
> > Thanks
> >
>
Re: exception during coprocessor run
Posted by Ted Yu <yu...@gmail.com>.
Here is related code:
public void throwExceptionIfCallerDisconnected() throws
CallerDisconnectedException {
if (!connection.channel.isOpen()) {
Have you checked data node log on 172.29.40.178
<http://172.29.40.178:50769>around 15:09:14,742 to see what was
happening ?
Cheers
On Sun, Jan 13, 2013 at 6:04 AM, Skovronik, Amir <as...@akamai.com>wrote:
> Hi
>
> I am using version 0.94.3, while running an end point coprocessor I get
> the following exception sometimes when running scan on an internal scanner:
>
>
> 2013-01-13 15:09:14,742 ERROR HRegionServer -
>
> org.apache.hadoop.hbase.ipc.CallerDisconnectedException: Aborting call
> execCoprocessor([B@105f3de6, execute(RTR,
> {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x01\\x02\\xB3b\\x11\\xC6\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","stopRow":"\\xD8\\x9F\\x03vSB\\x90\\xF8\\xA3w83\\x80\\xB9\\xA1\\xF6\\x04\\x00\\x00\\x02\\x05f\\xC4#\\x8F\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00","totalColumns":0,"cacheBlocks":true,"families":{"Data":[]},"maxVersions":1,"filter":"Field
> Conditions: \r\n","caching":-1}, 200000, false, null), rpc version=1,
> client version=0, methodsFingerPrint=0), rpc version=1, client version=29,
> methodsFingerPrint=-1368823753 from 172.29.40.178:50769 after 0 ms, since
> caller disconnected
>
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Call.throwExceptionIfCallerDisconnected(HBaseServer.java:436)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3489)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3447)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3464)
>
> at
> com.akamai.csi.yoda.hquery.HQueryCoprocessorImpl.execute(HQueryCoprocessorImpl.java:124)
>
> at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4947)
>
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3551)
>
> at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
> at java.lang.reflect.Method.invoke(Method.java:597)
>
> at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
>
>
> Please advise
>
> Thanks
>