You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by Venkatesh Bodapati <ve...@inndata.in> on 2015/12/09 11:05:35 UTC

HBase bolt preparation failed

i am working with storm-hbase, i got this error while running storm jar


java.lang.RuntimeException: HBase bolt preparation failed:
java.lang.reflect.InvocationTargetException
at org.apache.storm.hbase.common.HBaseClient.<init>(HBaseClient.java:49)
~[storm-hbase-0.9.5.jar:0.9.5]
at
org.apache.storm.hbase.bolt.AbstractHBaseBolt.prepare(AbstractHBaseBolt.java:67)
~[storm-hbase-0.9.5.jar:0.9.5]
at
backtype.storm.daemon.executor$fn__6647$fn__6659.invoke(executor.clj:692)
~[storm-core-0.9.5.jar:0.9.5]
at backtype.storm.util$async_loop$fn__459.invoke(util.clj:461)
~[storm-core-0.9.5.jar:0.9.5]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_91]
Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
at
org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:417)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:394)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:275)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:197)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:159)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at org.apache.storm.hbase.common.HBaseClient$1.run(HBaseClient.java:45)
~[storm-hbase-0.9.5.jar:0.9.5]
at org.apache.storm.hbase.common.HBaseClient$1.run(HBaseClient.java:42)
~[storm-hbase-0.9.5.jar:0.9.5]
at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_91]
at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_91]
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
~[hadoop-common-2.1.0-beta.jar:na]
at org.apache.storm.hbase.common.HBaseClient.<init>(HBaseClient.java:42)
~[storm-hbase-0.9.5.jar:0.9.5]
... 5 common frames omitted
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
~[na:1.7.0_91]
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
~[na:1.7.0_91]
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
~[na:1.7.0_91]
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
~[na:1.7.0_91]
at
org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:415)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
... 15 common frames omitted
Caused by: java.lang.VerifyError: class
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Result overrides
final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
at java.lang.ClassLoader.defineClass1(Native Method) ~[na:1.7.0_91]
at java.lang.ClassLoader.defineClass(ClassLoader.java:800) ~[na:1.7.0_91]
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
~[na:1.7.0_91]
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
~[na:1.7.0_91]
at java.net.URLClassLoader.access$100(URLClassLoader.java:71) ~[na:1.7.0_91]
at java.net.URLClassLoader$1.run(URLClassLoader.java:361) ~[na:1.7.0_91]
at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_91]
at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_91]
at java.net.URLClassLoader.findClass(URLClassLoader.java:354) ~[na:1.7.0_91]
at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_91]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
~[na:1.7.0_91]
at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_91]
at
org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:177)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at
org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:69)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at
org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:858)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:663)
~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
... 20 common frames omitted
19545 [Thread-11-hbase-bolt] ERROR backtype.storm.daemon.executor -


If any one got any i idea it will help for me.

           thank you

Re: HBase bolt preparation failed

Posted by Venkatesh Bodapati <ve...@inndata.in>.

thanks for replay, it's working fine now

On Wed, Dec 9, 2015 at 10:05 PM, 임정택 <ka...@gmail.com> wrote:

> Could you share your worker's classpath? Looks like HBase libraries messed
> up in classpath.
>
> Best,
> Jungtaek Lim (HeartSaVioR)
>
> 2015-12-09 19:05 GMT+09:00 Venkatesh Bodapati <
> venkatesh.bodapati@inndata.in>:
>
>> i am working with storm-hbase, i got this error while running storm jar
>>
>>
>> java.lang.RuntimeException: HBase bolt preparation failed:
>> java.lang.reflect.InvocationTargetException
>> at org.apache.storm.hbase.common.HBaseClient.<init>(HBaseClient.java:49)
>> ~[storm-hbase-0.9.5.jar:0.9.5]
>> at
>> org.apache.storm.hbase.bolt.AbstractHBaseBolt.prepare(AbstractHBaseBolt.java:67)
>> ~[storm-hbase-0.9.5.jar:0.9.5]
>> at
>> backtype.storm.daemon.executor$fn__6647$fn__6659.invoke(executor.clj:692)
>> ~[storm-core-0.9.5.jar:0.9.5]
>> at backtype.storm.util$async_loop$fn__459.invoke(util.clj:461)
>> ~[storm-core-0.9.5.jar:0.9.5]
>> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_91]
>> Caused by: java.io.IOException:
>> java.lang.reflect.InvocationTargetException
>> at
>> org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:417)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at
>> org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:394)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:275)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:197)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:159)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at org.apache.storm.hbase.common.HBaseClient$1.run(HBaseClient.java:45)
>> ~[storm-hbase-0.9.5.jar:0.9.5]
>> at org.apache.storm.hbase.common.HBaseClient$1.run(HBaseClient.java:42)
>> ~[storm-hbase-0.9.5.jar:0.9.5]
>> at java.security.AccessController.doPrivileged(Native Method)
>> ~[na:1.7.0_91]
>> at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_91]
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
>> ~[hadoop-common-2.1.0-beta.jar:na]
>> at org.apache.storm.hbase.common.HBaseClient.<init>(HBaseClient.java:42)
>> ~[storm-hbase-0.9.5.jar:0.9.5]
>> ... 5 common frames omitted
>> Caused by: java.lang.reflect.InvocationTargetException: null
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> ~[na:1.7.0_91]
>> at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> ~[na:1.7.0_91]
>> at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> ~[na:1.7.0_91]
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> ~[na:1.7.0_91]
>> at
>> org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:415)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> ... 15 common frames omitted
>> Caused by: java.lang.VerifyError: class
>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Result overrides
>> final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
>> at java.lang.ClassLoader.defineClass1(Native Method) ~[na:1.7.0_91]
>> at java.lang.ClassLoader.defineClass(ClassLoader.java:800) ~[na:1.7.0_91]
>> at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>> ~[na:1.7.0_91]
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
>> ~[na:1.7.0_91]
>> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
>> ~[na:1.7.0_91]
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:361) ~[na:1.7.0_91]
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_91]
>> at java.security.AccessController.doPrivileged(Native Method)
>> ~[na:1.7.0_91]
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>> ~[na:1.7.0_91]
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_91]
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>> ~[na:1.7.0_91]
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_91]
>> at
>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:177)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at
>> org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:69)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at
>> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:858)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:663)
>> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
>> ... 20 common frames omitted
>> 19545 [Thread-11-hbase-bolt] ERROR backtype.storm.daemon.executor -
>>
>>
>> If any one got any i idea it will help for me.
>>
>>            thank you
>>
>>
>
>
> --
> Name : 임 정택
> Blog : http://www.heartsavior.net / http://dev.heartsavior.net
> Twitter : http://twitter.com/heartsavior
> LinkedIn : http://www.linkedin.com/in/heartsavior
>

Re: HBase bolt preparation failed

Posted by 임정택 <ka...@gmail.com>.

Could you share your worker's classpath? Looks like HBase libraries messed
up in classpath.

Best,
Jungtaek Lim (HeartSaVioR)

2015-12-09 19:05 GMT+09:00 Venkatesh Bodapati <venkatesh.bodapati@inndata.in
>:

> i am working with storm-hbase, i got this error while running storm jar
>
>
> java.lang.RuntimeException: HBase bolt preparation failed:
> java.lang.reflect.InvocationTargetException
> at org.apache.storm.hbase.common.HBaseClient.<init>(HBaseClient.java:49)
> ~[storm-hbase-0.9.5.jar:0.9.5]
> at
> org.apache.storm.hbase.bolt.AbstractHBaseBolt.prepare(AbstractHBaseBolt.java:67)
> ~[storm-hbase-0.9.5.jar:0.9.5]
> at
> backtype.storm.daemon.executor$fn__6647$fn__6659.invoke(executor.clj:692)
> ~[storm-core-0.9.5.jar:0.9.5]
> at backtype.storm.util$async_loop$fn__459.invoke(util.clj:461)
> ~[storm-core-0.9.5.jar:0.9.5]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_91]
> Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
> at
> org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:417)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at
> org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:394)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:275)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:197)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:159)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at org.apache.storm.hbase.common.HBaseClient$1.run(HBaseClient.java:45)
> ~[storm-hbase-0.9.5.jar:0.9.5]
> at org.apache.storm.hbase.common.HBaseClient$1.run(HBaseClient.java:42)
> ~[storm-hbase-0.9.5.jar:0.9.5]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[na:1.7.0_91]
> at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_91]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
> ~[hadoop-common-2.1.0-beta.jar:na]
> at org.apache.storm.hbase.common.HBaseClient.<init>(HBaseClient.java:42)
> ~[storm-hbase-0.9.5.jar:0.9.5]
> ... 5 common frames omitted
> Caused by: java.lang.reflect.InvocationTargetException: null
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> ~[na:1.7.0_91]
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> ~[na:1.7.0_91]
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> ~[na:1.7.0_91]
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> ~[na:1.7.0_91]
> at
> org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:415)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> ... 15 common frames omitted
> Caused by: java.lang.VerifyError: class
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Result overrides
> final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
> at java.lang.ClassLoader.defineClass1(Native Method) ~[na:1.7.0_91]
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800) ~[na:1.7.0_91]
> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> ~[na:1.7.0_91]
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> ~[na:1.7.0_91]
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> ~[na:1.7.0_91]
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361) ~[na:1.7.0_91]
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_91]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[na:1.7.0_91]
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> ~[na:1.7.0_91]
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_91]
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> ~[na:1.7.0_91]
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_91]
> at
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:177)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at
> org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:69)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at
> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:858)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:663)
> ~[hbase-client-0.98.3-hadoop2.jar:0.98.3-hadoop2]
> ... 20 common frames omitted
> 19545 [Thread-11-hbase-bolt] ERROR backtype.storm.daemon.executor -
>
>
> If any one got any i idea it will help for me.
>
>            thank you
>
>


-- 
Name : 임 정택
Blog : http://www.heartsavior.net / http://dev.heartsavior.net
Twitter : http://twitter.com/heartsavior
LinkedIn : http://www.linkedin.com/in/heartsavior