You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 旭鹤 <xu...@dianjia.io> on 2018/04/24 08:22:50 UTC
kylin help
当并发量上来的时候 很多请求超时没响应。三台query 机中只有某一台出现问题，但是另外两台也无法查询 请问是不是协处理器的问题，协处理 有什么需要配置的么？报错信息：kylin.log:Caused by: org.apache.hadoop.hbase.DoNotRetryIOException: org.apache.hadoop.hbase.DoNotRetryIOException: Coprocessor passed deadline! Maybe server is overloaded
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.checkDeadline(CubeVisitService.java:225)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
kylin.log- at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7931)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1969)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1951)
kylin.log- at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
kylin.log- at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
kylin.log- at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
kylin.log- at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
--
kylin.log- at org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:107)
kylin.log- at org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:56)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService$Stub.visitCube(CubeVisitProtos.java:5616)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$2.call(CubeHBaseEndpointRPC.java:237)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$2.call(CubeHBaseEndpointRPC.java:206)
kylin.log- at org.apache.hadoop.hbase.client.HTable$15.call(HTable.java:1800)
kylin.log- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
kylin.log- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
kylin.log- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
kylin.log- ... 1 more
kylin.log:Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException): org.apache.hadoop.hbase.DoNotRetryIOException: Coprocessor passed deadline! Maybe server is overloaded
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.checkDeadline(CubeVisitService.java:225)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
kylin.log- at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7931)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1969)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1951)
kylin.log- at org.apache.hadoop.hbas
Re:kylin help
Posted by Ma Gang <mg...@163.com>.
Hi,
Currently you can set the configuration: "kylin.storage.partition.max-scan-bytes", to limit the scan bytes for each region to prevent possible OOM in region server, by default it is set to 3GB, and the configuration can be set in cube level.
In our private Kylin env, we add two new configuration to limit the max return bytes and max return rows for each region to do more exact resource control, if community thinks that make sense, I can contribute the patch.
在 2018-04-24 16:22:50，"旭鹤" <xu...@dianjia.io> 写道：
当并发量上来的时候 很多请求超时没响应。三台query 机中只有某一台出现问题，但是另外两台也无法查询
请问是不是协处理器的问题，协处理 有什么需要配置的么？
报错信息：
kylin.log:Caused by: org.apache.hadoop.hbase.DoNotRetryIOException: org.apache.hadoop.hbase.DoNotRetryIOException: Coprocessor passed deadline! Maybe server is overloaded
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.checkDeadline(CubeVisitService.java:225)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
kylin.log- at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7931)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1969)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1951)
kylin.log- at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
kylin.log- at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
kylin.log- at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
kylin.log- at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
--
kylin.log- at org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:107)
kylin.log- at org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:56)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService$Stub.visitCube(CubeVisitProtos.java:5616)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$2.call(CubeHBaseEndpointRPC.java:237)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$2.call(CubeHBaseEndpointRPC.java:206)
kylin.log- at org.apache.hadoop.hbase.client.HTable$15.call(HTable.java:1800)
kylin.log- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
kylin.log- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
kylin.log- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
kylin.log- ... 1 more
kylin.log:Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException): org.apache.hadoop.hbase.DoNotRetryIOException: Coprocessor passed deadline! Maybe server is overloaded
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.checkDeadline(CubeVisitService.java:225)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
kylin.log- at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
kylin.log- at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7931)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1969)
kylin.log- at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1951)
kylin.log- at org.apache.hadoop.hbas