You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by ShaoFeng Shi <sh...@apache.org> on 2017/11/01 01:16:42 UTC
Re: Error while starting kylin 2.1
The "org.apache.hadoop.hbase.NotServingRegionException" exception indicates
HBase is unhealthy; You need check HBase cluster's status first; when HBase
is up, then restart Kylin.
2017-10-31 23:54 GMT+08:00 ketan dikshit <kd...@yahoo.com.invalid>:
> Hi Guys,
> While starting Kylin (kylin.sh start), I am getting below error stack, Any
> idea about the issue. Its a scratch deployment(no upgrade)
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:java.library.path=/opt/cloudera/parcels/CDH-5.
> 13.0-1.cdh5.13..0.p0.29/lib/hadoop/lib/native:/opt/
> cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hbase/bin/
> ../lib/native/Linux-amd64-64
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:java.io.tmpdir=/tmp
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:java.compiler=<NA>
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:os.name=Linux
> 2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:os.arch=amd64
> 2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:os.version=3.10.0-693.5.2.el7.x86_64
> 2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:user.name=root
> 2017-10-31 15:52:01,213 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:user.home=/root
> 2017-10-31 15:52:01,213 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:user.dir=/mnt/kylin/apache-kylin-2.1.0-SNAPSHOT-bin/bin
> 2017-10-31 15:52:01,214 INFO [main] zookeeper.ZooKeeper:438 : Initiating
> client connection, connectString=localhost:2181 sessionTimeout=90000
> watcher=hconnection-0x432db58d0x0, quorum=localhost:2181, baseZNode=/hbase
> 2017-10-31 15:52:01,231 INFO [main-SendThread(localhost:2181)]
> zookeeper.ClientCnxn:975 : Opening socket connection to server localhost/
> 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
> error)
> 2017-10-31 15:52:01,235 INFO [main-SendThread(localhost:2181)]
> zookeeper.ClientCnxn:852 : Socket connection established, initiating
> session, client: /127.0.0.1:40826, server: localhost/127.0.0.1:2181
> 2017-10-31 15:52:01,252 INFO [main-SendThread(localhost:2181)]
> zookeeper.ClientCnxn:1235 : Session establishment complete on server
> localhost/127.0.0.1:2181, sessionid = 0x15f731612a1001e, negotiated
> timeout = 60000
> Exception in thread "main" java.lang.IllegalArgumentException: Failed to
> find metadata store by url: kylin2.1Meta@hbase
> at org.apache.kylin.common.persistence.ResourceStore.
> createResourceStore(ResourceStore.java:89)
> at org.apache.kylin.common.persistence.ResourceStore.
> getStore(ResourceStore.java:101)
> at org.apache.kylin.rest.service.AclTableMigrationTool.
> checkIfNeedMigrate(AclTableMigrationTool.java:94)
> at org.apache.kylin.tool.AclTableMigrationCLI.main(
> AclTableMigrationCLI.java:41)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at org.apache.kylin.common.persistence.ResourceStore.
> createResourceStore(ResourceStore.java:83)
> ... 3 more
> Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException:
> Failed after attempts=1, exceptions:
> Tue Oct 31 15:52:02 UTC 2017, RpcRetryingCaller{globalStartTime=1509465122172,
> pause=100, retries=1}, org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1
> is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,
> 1509464413304
> at org.apache.hadoop.hbase.regionserver.HRegionServer.
> getRegionByEncodedName(HRegionServer.java:2966)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> getRegion(RSRpcServices..java:1055)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> scan(RSRpcServices.java:2371)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:183)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:163)
>
>
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithRetries(RpcRetryingCaller.java:157)
> at org.apache.hadoop.hbase.client.ResultBoundedCompletionService
> $QueueingFuture.run(ResultBoundedCompletionService.java:80)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1
> is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,
> 1509464413304
> at org.apache.hadoop.hbase.regionserver.HRegionServer.
> getRegionByEncodedName(HRegionServer.java:2966)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> getRegion(RSRpcServices..java:1055)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> scan(RSRpcServices.java:2371)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:183)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:163)
>
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(
> RemoteException..java:106)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(
> RemoteException.java:95)
> at org.apache.hadoop.hbase.protobuf.ProtobufUtil.
> getRemoteException(ProtobufUtil.java:332)
> at org.apache.hadoop.hbase.client.ScannerCallable.
> openScanner(ScannerCallable..java:408)
> at org.apache.hadoop.hbase.client.ScannerCallable.call(
> ScannerCallable.java:204)
> at org.apache.hadoop.hbase.client.ScannerCallable.call(
> ScannerCallable.java:65)
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithoutRetries(RpcRetryingCaller.java:210)
> at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$
> RetryingRPC.call(ScannerCallableWithReplicas.java:397)
> at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$
> RetryingRPC.call(ScannerCallableWithReplicas.java:371)
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithRetries(RpcRetryingCaller.java:136)
> ... 4 more
> Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.
> apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException:
> Region hbase:meta,,1 is not online on ip-10-100-5-58.us-west-1.
> compute.internal,60020,1509464413304
> at org.apache.hadoop.hbase.regionserver.HRegionServer.
> getRegionByEncodedName(HRegionServer.java:2966)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> getRegion(RSRpcServices..java:1055)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> scan(RSRpcServices.java:2371)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:183)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:163)
>
> at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(
> RpcClientImpl.java:1269)
> at org.apache.hadoop.hbase.ipc.AbstractRpcClient.
> callBlockingMethod(AbstractRpcClient.java:227)
> at org.apache.hadoop.hbase.ipc.AbstractRpcClient$
> BlockingRpcChannelImplementation.callBlockingMethod(
> AbstractRpcClient.java:336)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094)
> at org.apache.hadoop.hbase.client.ScannerCallable.
> openScanner(ScannerCallable..java:400)
> ... 10 more
> 2017-10-31 15:52:02,377 INFO [Thread-1] client.ConnectionManager$HConnectionImplementation:1843
> : Closing zookeeper sessionid=0x15f731612a1001e
>
> Thanks,
> Ketan
--
Best regards,
Shaofeng Shi 史少锋