You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by ketan dikshit <kd...@yahoo.com.INVALID> on 2017/10/31 15:54:35 UTC
Error while starting kylin 2.1
Hi Guys,
While starting Kylin (kylin.sh start), I am getting below error stack, Any idea about the issue. Its a scratch deployment(no upgrade)
2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client environment:java.library.path=/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13..0.p0.29/lib/hadoop/lib/native:/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hbase/bin/../lib/native/Linux-amd64-64
2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client environment:java.io.tmpdir=/tmp
2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client environment:java.compiler=<NA>
2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client environment:os.name=Linux
2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client environment:os.arch=amd64
2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client environment:os.version=3.10.0-693.5.2.el7.x86_64
2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client environment:user.name=root
2017-10-31 15:52:01,213 INFO [main] zookeeper.ZooKeeper:100 : Client environment:user.home=/root
2017-10-31 15:52:01,213 INFO [main] zookeeper.ZooKeeper:100 : Client environment:user.dir=/mnt/kylin/apache-kylin-2.1.0-SNAPSHOT-bin/bin
2017-10-31 15:52:01,214 INFO [main] zookeeper.ZooKeeper:438 : Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x432db58d0x0, quorum=localhost:2181, baseZNode=/hbase
2017-10-31 15:52:01,231 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn:975 : Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2017-10-31 15:52:01,235 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn:852 : Socket connection established, initiating session, client: /127.0.0.1:40826, server: localhost/127.0.0.1:2181
2017-10-31 15:52:01,252 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn:1235 : Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x15f731612a1001e, negotiated timeout = 60000
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin2.1Meta@hbase
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:89)
at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:101)
at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:94)
at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:83)
... 3 more
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions:
Tue Oct 31 15:52:02 UTC 2017, RpcRetryingCaller{globalStartTime=1509465122172, pause=100, retries=1}, org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,1509464413304
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2966)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices..java:1055)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2371)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:157)
at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:80)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,1509464413304
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2966)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices..java:1055)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2371)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException..java:106)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:332)
at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable..java:408)
at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:204)
at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:65)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:397)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:371)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136)
... 4 more
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,1509464413304
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2966)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices..java:1055)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2371)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)
at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1269)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094)
at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable..java:400)
... 10 more
2017-10-31 15:52:02,377 INFO [Thread-1] client.ConnectionManager$HConnectionImplementation:1843 : Closing zookeeper sessionid=0x15f731612a1001e
Thanks,
Ketan
Re: Error while starting kylin 2.1
Posted by ShaoFeng Shi <sh...@apache.org>.
The "org.apache.hadoop.hbase.NotServingRegionException" exception indicates
HBase is unhealthy; You need check HBase cluster's status first; when HBase
is up, then restart Kylin.
2017-10-31 23:54 GMT+08:00 ketan dikshit <kd...@yahoo.com.invalid>:
> Hi Guys,
> While starting Kylin (kylin.sh start), I am getting below error stack, Any
> idea about the issue. Its a scratch deployment(no upgrade)
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:java.library.path=/opt/cloudera/parcels/CDH-5.
> 13.0-1.cdh5.13..0.p0.29/lib/hadoop/lib/native:/opt/
> cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hbase/bin/
> ../lib/native/Linux-amd64-64
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:java.io.tmpdir=/tmp
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:java.compiler=<NA>
> 2017-10-31 15:52:01,209 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:os.name=Linux
> 2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:os.arch=amd64
> 2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:os.version=3.10.0-693.5.2.el7.x86_64
> 2017-10-31 15:52:01,212 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:user.name=root
> 2017-10-31 15:52:01,213 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:user.home=/root
> 2017-10-31 15:52:01,213 INFO [main] zookeeper.ZooKeeper:100 : Client
> environment:user.dir=/mnt/kylin/apache-kylin-2.1.0-SNAPSHOT-bin/bin
> 2017-10-31 15:52:01,214 INFO [main] zookeeper.ZooKeeper:438 : Initiating
> client connection, connectString=localhost:2181 sessionTimeout=90000
> watcher=hconnection-0x432db58d0x0, quorum=localhost:2181, baseZNode=/hbase
> 2017-10-31 15:52:01,231 INFO [main-SendThread(localhost:2181)]
> zookeeper.ClientCnxn:975 : Opening socket connection to server localhost/
> 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
> error)
> 2017-10-31 15:52:01,235 INFO [main-SendThread(localhost:2181)]
> zookeeper.ClientCnxn:852 : Socket connection established, initiating
> session, client: /127.0.0.1:40826, server: localhost/127.0.0.1:2181
> 2017-10-31 15:52:01,252 INFO [main-SendThread(localhost:2181)]
> zookeeper.ClientCnxn:1235 : Session establishment complete on server
> localhost/127.0.0.1:2181, sessionid = 0x15f731612a1001e, negotiated
> timeout = 60000
> Exception in thread "main" java.lang.IllegalArgumentException: Failed to
> find metadata store by url: kylin2.1Meta@hbase
> at org.apache.kylin.common.persistence.ResourceStore.
> createResourceStore(ResourceStore.java:89)
> at org.apache.kylin.common.persistence.ResourceStore.
> getStore(ResourceStore.java:101)
> at org.apache.kylin.rest.service.AclTableMigrationTool.
> checkIfNeedMigrate(AclTableMigrationTool.java:94)
> at org.apache.kylin.tool.AclTableMigrationCLI.main(
> AclTableMigrationCLI.java:41)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at org.apache.kylin.common.persistence.ResourceStore.
> createResourceStore(ResourceStore.java:83)
> ... 3 more
> Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException:
> Failed after attempts=1, exceptions:
> Tue Oct 31 15:52:02 UTC 2017, RpcRetryingCaller{globalStartTime=1509465122172,
> pause=100, retries=1}, org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1
> is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,
> 1509464413304
> at org.apache.hadoop.hbase.regionserver.HRegionServer.
> getRegionByEncodedName(HRegionServer.java:2966)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> getRegion(RSRpcServices..java:1055)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> scan(RSRpcServices.java:2371)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:183)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:163)
>
>
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithRetries(RpcRetryingCaller.java:157)
> at org.apache.hadoop.hbase.client.ResultBoundedCompletionService
> $QueueingFuture.run(ResultBoundedCompletionService.java:80)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1
> is not online on ip-10-100-5-58.us-west-1.compute.internal,60020,
> 1509464413304
> at org.apache.hadoop.hbase.regionserver.HRegionServer.
> getRegionByEncodedName(HRegionServer.java:2966)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> getRegion(RSRpcServices..java:1055)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> scan(RSRpcServices.java:2371)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:183)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:163)
>
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(
> RemoteException..java:106)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(
> RemoteException.java:95)
> at org.apache.hadoop.hbase.protobuf.ProtobufUtil.
> getRemoteException(ProtobufUtil.java:332)
> at org.apache.hadoop.hbase.client.ScannerCallable.
> openScanner(ScannerCallable..java:408)
> at org.apache.hadoop.hbase.client.ScannerCallable.call(
> ScannerCallable.java:204)
> at org.apache.hadoop.hbase.client.ScannerCallable.call(
> ScannerCallable.java:65)
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithoutRetries(RpcRetryingCaller.java:210)
> at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$
> RetryingRPC.call(ScannerCallableWithReplicas.java:397)
> at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$
> RetryingRPC.call(ScannerCallableWithReplicas.java:371)
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.
> callWithRetries(RpcRetryingCaller.java:136)
> ... 4 more
> Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.
> apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException:
> Region hbase:meta,,1 is not online on ip-10-100-5-58.us-west-1.
> compute.internal,60020,1509464413304
> at org.apache.hadoop.hbase.regionserver.HRegionServer.
> getRegionByEncodedName(HRegionServer.java:2966)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> getRegion(RSRpcServices..java:1055)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.
> scan(RSRpcServices.java:2371)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33648)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:183)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(
> RpcExecutor.java:163)
>
> at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(
> RpcClientImpl.java:1269)
> at org.apache.hadoop.hbase.ipc.AbstractRpcClient.
> callBlockingMethod(AbstractRpcClient.java:227)
> at org.apache.hadoop.hbase.ipc.AbstractRpcClient$
> BlockingRpcChannelImplementation.callBlockingMethod(
> AbstractRpcClient.java:336)
> at org.apache.hadoop.hbase.protobuf.generated.
> ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094)
> at org.apache.hadoop.hbase.client.ScannerCallable.
> openScanner(ScannerCallable..java:400)
> ... 10 more
> 2017-10-31 15:52:02,377 INFO [Thread-1] client.ConnectionManager$HConnectionImplementation:1843
> : Closing zookeeper sessionid=0x15f731612a1001e
>
> Thanks,
> Ketan
--
Best regards,
Shaofeng Shi 史少锋