You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by Sergey Kazarin <s_...@yahoo.com.INVALID> on 2016/05/18 00:17:35 UTC

Error: org.apache.phoenix.exception.PhoenixIOException

Hello, 
  I am trying to overcome this problem for a couple of days already an wondering if you can help me.
  I am upserting from select with group by that returns ~1mil distinct records and I am getting this error:


Error: org.apache.phoenix.exception.PhoenixIOException: org.apache.hadoop.hbase.DoNotRetryIOException: AGGS.RECENT_TRANSACTIONS,,1462843647068.f15b1d20cdc581b99755d0ba55a55943.: Could not get page at index: 88
	at org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
	at org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
	at org.apache.phoenix.coprocessor.BaseScannerRegionObserver.postScannerOpen(BaseScannerRegionObserver.java:206)
	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$52.call(RegionCoprocessorHost.java:1295)
	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1632)
	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1706)
	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperationWithResult(RegionCoprocessorHost.java:1671)
	at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.postScannerOpen(RegionCoprocessorHost.java:1290)
	at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2157)
	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
	at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
	at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
	at java.lang.Thread.run(Thread.java:745)


This error also crushes hbase regionservers. How can I control it?


Thanks,
Serge

Re: Error: org.apache.phoenix.exception.PhoenixIOException

Posted by Sergey Soldatov <se...@gmail.com>.
Sergey,
It would be great if you provide at least the version of phoenix you are
using. I can suggest that it's 4.6. There were number of fixes since that
time, so could you please try the more recent 4.7 or the current master.
The exception from the log of crashed RS may be useful as well.

Thanks,
Sergey

On Tue, May 17, 2016 at 5:17 PM, Sergey Kazarin <s_...@yahoo.com.invalid>
wrote:

> Hello,
>   I am trying to overcome this problem for a couple of days already an
> wondering if you can help me.
>   I am upserting from select with group by that returns ~1mil distinct
> records and I am getting this error:
>
>
> Error: org.apache.phoenix.exception.PhoenixIOException:
> org.apache.hadoop.hbase.DoNotRetryIOException:
> AGGS.RECENT_TRANSACTIONS,,1462843647068.f15b1d20cdc581b99755d0ba55a55943.:
> Could not get page at index: 88
>         at
> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:84)
>         at
> org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:52)
>         at
> org.apache.phoenix.coprocessor.BaseScannerRegionObserver.postScannerOpen(BaseScannerRegionObserver.java:206)
>         at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$52.call(RegionCoprocessorHost.java:1295)
>         at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1632)
>         at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1706)
>         at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperationWithResult(RegionCoprocessorHost.java:1671)
>         at
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.postScannerOpen(RegionCoprocessorHost.java:1290)
>         at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2157)
>         at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
>         at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>         at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>         at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>         at
> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>         at java.lang.Thread.run(Thread.java:745)
>
>
> This error also crushes hbase regionservers. How can I control it?
>
>
> Thanks,
> Serge
>