You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bigtop.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2014/08/20 21:31:03 UTC
Start HBase build from BigTop
Hi,
I have no issues to build and start HBase from HBase code.
But when I try from BigTop, at stratup I get a class not found error:
[root@hbr101 ~]# /etc/init.d/hbase-master start
starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/http/HttpServer
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(Unknown Source)
at java.security.SecureClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.access$100(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
Failed to start HBase master daemon. Return value: 1 [FAILED]
If I export the Hadoop and HBase classpath, I'm able to pass this, but the
I face another ClassNotFound exception on the HBase side.
export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
[root@10-0-1-208 output]# /etc/init.d/hbase-master start
starting master, logging to /var/log/hbase/hbase-hbase-master-10-0-1-208.out
Started HBase master daemon (hbase-master): [ OK ]
2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase metrics
system started
2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
exiting
java.lang.RuntimeException: Failed construction of Master: class
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
at
org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
at
org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
Caused by: java.lang.NoClassDefFoundError: com/yammer/metrics/stats/Sample
at
org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
at
org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
at
org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
at
org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
at
org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
... 7 more
I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk and
has been able to start it? I checked and class is on the metric jar, and
the jar in there on the CP. so I'm wondering where this is coming from and
still investigating. If I found anything, I will open a JIRA and provide
the details...
Thanks,
JM
Re: Start HBase build from BigTop
Posted by Konstantin Boudnik <co...@apache.org>.
On Wed, Aug 20, 2014 at 05:19PM, Jean-Marc Spaggiari wrote:
> "Package specs are setting the permissions for most if not all files in the
> package. If something is missed - let's fix it in the packages."
> Sure. I will try to look at that. Will open a JIRA to track it.
>
> "Which init script are you fixing?"
> I face the issue when I call /etc/init.d/hbase-master so I will start from
> there and see where the path should be set.
>
> "My point is that HBase 0.99 and later doesn't have a master service
> anymore"
> I build with 0.98.5 so it should still be fine. I'm able to run now if I
> export HBASE_CLASSPATH and change the jars permissions...
Fair point, I think I got confused by something in the log's snippet from your
ealier email. Thanks for looking into this!
Cos
> Thanks,
>
> JM
>
>
> 2014-08-20 17:10 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
>
> > On Wed, Aug 20, 2014 at 04:56PM, Jean-Marc Spaggiari wrote:
> > > Hi Cos,
> > >
> > > I think build is fine because I'm able to start HBase from the command
> > line
> > > directly.
> > >
> > > I found one thing.
> > >
> > > -rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar
> > >
> > > Some jars don't have the correct rights. That's one of the issues I
> > faced.
> > >
> > > I fixed the java.lang.NoClassDefFoundError:
> > > org/apache/hadoop/http/HttpServer from the init.d script by exporting
> > > HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
> >
> > Which init script are you fixing? My point is that HBase 0.99 and later
> > doesn't have a master service anymore. Hence, the init script might need
> > be
> > just dropped.
> >
> > > Now I have another exception on the HBase side but I'm very confortable
> > to
> > > look at it:
> > > org.apache.hadoop.hbase.TableExistsException: hbase:namespace
> > > at
> > >
> > org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
> > > at
> > >
> > org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
> > > at
> > >
> > org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
> > > at
> > > org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
> > > at
> > >
> > org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
> > > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> > > at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> > > Did not have it when I run manually.
> > >
> > > I will continue and report when I found where it comes from..
> > >
> > > Thanks,
> > >
> > > JM
> > >
> > >
> > > 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
> > >
> > > > Currently supported HBase if 0.98.2 (or 3???) and I was able
> > personally to
> > > > setup a cluster from bigtop bits and run it. Furthermore, I was able
> > to do
> > > > it
> > > > with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
> > > > service
> > > > caveat.
> > > >
> > > > One of the possible reasons for the problem you see is merge of region
> > and
> > > > master services. So, the master service is no longer relevant and
> > needs to
> > > > be
> > > > removed (there's a ticket for it). Another one is the changes in the
> > HBase
> > > > build process which needs to be reflected in Bigtop.
> > > >
> > > > Hope it helps,
> > > > Cos
> > > >
> > > > On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> > > > > Hi,
> > > > >
> > > > > I have no issues to build and start HBase from HBase code.
> > > > >
> > > > > But when I try from BigTop, at stratup I get a class not found error:
> > > > > [root@hbr101 ~]# /etc/init.d/hbase-master start
> > > > > starting master, logging to
> > /var/log/hbase/hbase-hbase-master-hbr101.out
> > > > > Exception in thread "main" java.lang.NoClassDefFoundError:
> > > > > org/apache/hadoop/http/HttpServer
> > > > > at java.lang.ClassLoader.defineClass1(Native Method)
> > > > > at java.lang.ClassLoader.defineClass(Unknown Source)
> > > > > at java.security.SecureClassLoader.defineClass(Unknown Source)
> > > > > at java.net.URLClassLoader.defineClass(Unknown Source)
> > > > > at java.net.URLClassLoader.access$100(Unknown Source)
> > > > > at java.net.URLClassLoader$1.run(Unknown Source)
> > > > > at java.net.URLClassLoader$1.run(Unknown Source)
> > > > > at java.security.AccessController.doPrivileged(Native Method)
> > > > > at java.net.URLClassLoader.findClass(Unknown Source)
> > > > > Failed to start HBase master daemon. Return value: 1 [FAILED]
> > > > >
> > > > > If I export the Hadoop and HBase classpath, I'm able to pass this,
> > but
> > > > the
> > > > > I face another ClassNotFound exception on the HBase side.
> > > > >
> > > > > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> > > > > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> > > > > starting master, logging to
> > > > /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> > > > > Started HBase master daemon (hbase-master): [ OK ]
> > > > >
> > > > > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase
> > > > metrics
> > > > > system started
> > > > > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine:
> > Master
> > > > > exiting
> > > > > java.lang.RuntimeException: Failed construction of Master: class
> > > > >
> > > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> > > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > > > > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> > > > > Caused by: java.lang.NoClassDefFoundError:
> > > > com/yammer/metrics/stats/Sample
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> > > > > at
> > org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> > > > > at
> > org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> > > > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > > Method)
> > > > > at
> > > > >
> > > >
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > > > at
> > > > >
> > > >
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > > > at
> > java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > > > at
> > > > >
> > > >
> > org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > > > > ... 7 more
> > > > >
> > > > >
> > > > > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop
> > trunk
> > > > and
> > > > > has been able to start it? I checked and class is on the metric jar,
> > and
> > > > > the jar in there on the CP. so I'm wondering where this is coming
> > from
> > > > and
> > > > > still investigating. If I found anything, I will open a JIRA and
> > provide
> > > > > the details...
> > > > >
> > > > > Thanks,
> > > > >
> > > > > JM
> > > >
> >
Re: Start HBase build from BigTop
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
"Package specs are setting the permissions for most if not all files in the
package. If something is missed - let's fix it in the packages."
Sure. I will try to look at that. Will open a JIRA to track it.
"Which init script are you fixing?"
I face the issue when I call /etc/init.d/hbase-master so I will start from
there and see where the path should be set.
"My point is that HBase 0.99 and later doesn't have a master service
anymore"
I build with 0.98.5 so it should still be fine. I'm able to run now if I
export HBASE_CLASSPATH and change the jars permissions...
Thanks,
JM
2014-08-20 17:10 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
> On Wed, Aug 20, 2014 at 04:56PM, Jean-Marc Spaggiari wrote:
> > Hi Cos,
> >
> > I think build is fine because I'm able to start HBase from the command
> line
> > directly.
> >
> > I found one thing.
> >
> > -rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar
> >
> > Some jars don't have the correct rights. That's one of the issues I
> faced.
> >
> > I fixed the java.lang.NoClassDefFoundError:
> > org/apache/hadoop/http/HttpServer from the init.d script by exporting
> > HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
>
> Which init script are you fixing? My point is that HBase 0.99 and later
> doesn't have a master service anymore. Hence, the init script might need
> be
> just dropped.
>
> > Now I have another exception on the HBase side but I'm very confortable
> to
> > look at it:
> > org.apache.hadoop.hbase.TableExistsException: hbase:namespace
> > at
> >
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
> > at
> >
> org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
> > at
> >
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
> > at
> > org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
> > at
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> > at
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
> > at java.lang.Thread.run(Thread.java:745)
> >
> > Did not have it when I run manually.
> >
> > I will continue and report when I found where it comes from..
> >
> > Thanks,
> >
> > JM
> >
> >
> > 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
> >
> > > Currently supported HBase if 0.98.2 (or 3???) and I was able
> personally to
> > > setup a cluster from bigtop bits and run it. Furthermore, I was able
> to do
> > > it
> > > with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
> > > service
> > > caveat.
> > >
> > > One of the possible reasons for the problem you see is merge of region
> and
> > > master services. So, the master service is no longer relevant and
> needs to
> > > be
> > > removed (there's a ticket for it). Another one is the changes in the
> HBase
> > > build process which needs to be reflected in Bigtop.
> > >
> > > Hope it helps,
> > > Cos
> > >
> > > On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> > > > Hi,
> > > >
> > > > I have no issues to build and start HBase from HBase code.
> > > >
> > > > But when I try from BigTop, at stratup I get a class not found error:
> > > > [root@hbr101 ~]# /etc/init.d/hbase-master start
> > > > starting master, logging to
> /var/log/hbase/hbase-hbase-master-hbr101.out
> > > > Exception in thread "main" java.lang.NoClassDefFoundError:
> > > > org/apache/hadoop/http/HttpServer
> > > > at java.lang.ClassLoader.defineClass1(Native Method)
> > > > at java.lang.ClassLoader.defineClass(Unknown Source)
> > > > at java.security.SecureClassLoader.defineClass(Unknown Source)
> > > > at java.net.URLClassLoader.defineClass(Unknown Source)
> > > > at java.net.URLClassLoader.access$100(Unknown Source)
> > > > at java.net.URLClassLoader$1.run(Unknown Source)
> > > > at java.net.URLClassLoader$1.run(Unknown Source)
> > > > at java.security.AccessController.doPrivileged(Native Method)
> > > > at java.net.URLClassLoader.findClass(Unknown Source)
> > > > Failed to start HBase master daemon. Return value: 1 [FAILED]
> > > >
> > > > If I export the Hadoop and HBase classpath, I'm able to pass this,
> but
> > > the
> > > > I face another ClassNotFound exception on the HBase side.
> > > >
> > > > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> > > > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> > > > starting master, logging to
> > > /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> > > > Started HBase master daemon (hbase-master): [ OK ]
> > > >
> > > > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase
> > > metrics
> > > > system started
> > > > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine:
> Master
> > > > exiting
> > > > java.lang.RuntimeException: Failed construction of Master: class
> > > >
> > >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > > > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> > > > Caused by: java.lang.NoClassDefFoundError:
> > > com/yammer/metrics/stats/Sample
> > > > at
> > > >
> > >
> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> > > > at
> org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> > > > at
> org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> > > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > Method)
> > > > at
> > > >
> > >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > > at
> > > >
> > >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > > at
> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > > at
> > > >
> > >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > > > ... 7 more
> > > >
> > > >
> > > > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop
> trunk
> > > and
> > > > has been able to start it? I checked and class is on the metric jar,
> and
> > > > the jar in there on the CP. so I'm wondering where this is coming
> from
> > > and
> > > > still investigating. If I found anything, I will open a JIRA and
> provide
> > > > the details...
> > > >
> > > > Thanks,
> > > >
> > > > JM
> > >
>
Re: Start HBase build from BigTop
Posted by Konstantin Boudnik <co...@apache.org>.
On Wed, Aug 20, 2014 at 04:56PM, Jean-Marc Spaggiari wrote:
> Hi Cos,
>
> I think build is fine because I'm able to start HBase from the command line
> directly.
>
> I found one thing.
>
> -rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar
>
> Some jars don't have the correct rights. That's one of the issues I faced.
>
> I fixed the java.lang.NoClassDefFoundError:
> org/apache/hadoop/http/HttpServer from the init.d script by exporting
> HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
Which init script are you fixing? My point is that HBase 0.99 and later
doesn't have a master service anymore. Hence, the init script might need be
just dropped.
> Now I have another exception on the HBase side but I'm very confortable to
> look at it:
> org.apache.hadoop.hbase.TableExistsException: hbase:namespace
> at
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
> at
> org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
> at
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
> at
> org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
> at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
> at java.lang.Thread.run(Thread.java:745)
>
> Did not have it when I run manually.
>
> I will continue and report when I found where it comes from..
>
> Thanks,
>
> JM
>
>
> 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
>
> > Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
> > setup a cluster from bigtop bits and run it. Furthermore, I was able to do
> > it
> > with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
> > service
> > caveat.
> >
> > One of the possible reasons for the problem you see is merge of region and
> > master services. So, the master service is no longer relevant and needs to
> > be
> > removed (there's a ticket for it). Another one is the changes in the HBase
> > build process which needs to be reflected in Bigtop.
> >
> > Hope it helps,
> > Cos
> >
> > On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> > > Hi,
> > >
> > > I have no issues to build and start HBase from HBase code.
> > >
> > > But when I try from BigTop, at stratup I get a class not found error:
> > > [root@hbr101 ~]# /etc/init.d/hbase-master start
> > > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
> > > Exception in thread "main" java.lang.NoClassDefFoundError:
> > > org/apache/hadoop/http/HttpServer
> > > at java.lang.ClassLoader.defineClass1(Native Method)
> > > at java.lang.ClassLoader.defineClass(Unknown Source)
> > > at java.security.SecureClassLoader.defineClass(Unknown Source)
> > > at java.net.URLClassLoader.defineClass(Unknown Source)
> > > at java.net.URLClassLoader.access$100(Unknown Source)
> > > at java.net.URLClassLoader$1.run(Unknown Source)
> > > at java.net.URLClassLoader$1.run(Unknown Source)
> > > at java.security.AccessController.doPrivileged(Native Method)
> > > at java.net.URLClassLoader.findClass(Unknown Source)
> > > Failed to start HBase master daemon. Return value: 1 [FAILED]
> > >
> > > If I export the Hadoop and HBase classpath, I'm able to pass this, but
> > the
> > > I face another ClassNotFound exception on the HBase side.
> > >
> > > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> > > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> > > starting master, logging to
> > /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> > > Started HBase master daemon (hbase-master): [ OK ]
> > >
> > > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase
> > metrics
> > > system started
> > > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
> > > exiting
> > > java.lang.RuntimeException: Failed construction of Master: class
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> > > at
> > >
> > org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > > at
> > >
> > org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> > > at
> > >
> > org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> > > at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> > > at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > at
> > >
> > org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> > > Caused by: java.lang.NoClassDefFoundError:
> > com/yammer/metrics/stats/Sample
> > > at
> > >
> > org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> > > at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> > > at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> > > at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> > > at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> > > at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> > > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> > > at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> > > at
> > >
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > at
> > >
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > at
> > >
> > org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > > ... 7 more
> > >
> > >
> > > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk
> > and
> > > has been able to start it? I checked and class is on the metric jar, and
> > > the jar in there on the CP. so I'm wondering where this is coming from
> > and
> > > still investigating. If I found anything, I will open a JIRA and provide
> > > the details...
> > >
> > > Thanks,
> > >
> > > JM
> >
Re: Start HBase build from BigTop
Posted by Konstantin Boudnik <co...@apache.org>.
On Wed, Aug 20, 2014 at 05:04PM, Jean-Marc Spaggiari wrote:
> Ok. Found that the culprit jars (read only for root) have the same rights
> on the build machine in .m2/repository/... So 2 options. At the build time
> they need to be made a+r, or, at the deployment time they need to be made
> a+r...
Package specs are setting the permissions for most if not all files in the
package. If something is missed - let's fix it in the packages.
>
> JM
>
>
> 2014-08-20 16:56 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
>
> > Hi Cos,
> >
> > I think build is fine because I'm able to start HBase from the command
> > line directly.
> >
> > I found one thing.
> >
> > -rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar
> >
> > Some jars don't have the correct rights. That's one of the issues I faced.
> >
> > I fixed the java.lang.NoClassDefFoundError:
> > org/apache/hadoop/http/HttpServer from the init.d script by exporting
> > HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
> >
> > Now I have another exception on the HBase side but I'm very confortable to
> > look at it:
> > org.apache.hadoop.hbase.TableExistsException: hbase:namespace
> > at
> > org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
> > at
> > org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
> > at
> > org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
> > at
> > org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
> > at
> > org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> > at
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
> > at java.lang.Thread.run(Thread.java:745)
> >
> > Did not have it when I run manually.
> >
> > I will continue and report when I found where it comes from..
> >
> > Thanks,
> >
> > JM
> >
> >
> > 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
> >
> > Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
> >> setup a cluster from bigtop bits and run it. Furthermore, I was able to
> >> do it
> >> with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
> >> service
> >> caveat.
> >>
> >> One of the possible reasons for the problem you see is merge of region and
> >> master services. So, the master service is no longer relevant and needs
> >> to be
> >> removed (there's a ticket for it). Another one is the changes in the HBase
> >> build process which needs to be reflected in Bigtop.
> >>
> >> Hope it helps,
> >> Cos
> >>
> >> On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> >> > Hi,
> >> >
> >> > I have no issues to build and start HBase from HBase code.
> >> >
> >> > But when I try from BigTop, at stratup I get a class not found error:
> >> > [root@hbr101 ~]# /etc/init.d/hbase-master start
> >> > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
> >> > org/apache/hadoop/http/HttpServer
> >> > at java.lang.ClassLoader.defineClass1(Native Method)
> >> > at java.lang.ClassLoader.defineClass(Unknown Source)
> >> > at java.security.SecureClassLoader.defineClass(Unknown Source)
> >> > at java.net.URLClassLoader.defineClass(Unknown Source)
> >> > at java.net.URLClassLoader.access$100(Unknown Source)
> >> > at java.net.URLClassLoader$1.run(Unknown Source)
> >> > at java.net.URLClassLoader$1.run(Unknown Source)
> >> > at java.security.AccessController.doPrivileged(Native Method)
> >> > at java.net.URLClassLoader.findClass(Unknown Source)
> >> > Failed to start HBase master daemon. Return value: 1 [FAILED]
> >> >
> >> > If I export the Hadoop and HBase classpath, I'm able to pass this, but
> >> the
> >> > I face another ClassNotFound exception on the HBase side.
> >> >
> >> > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> >> > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> >> > starting master, logging to
> >> /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> >> > Started HBase master daemon (hbase-master): [ OK ]
> >> >
> >> > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase
> >> metrics
> >> > system started
> >> > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
> >> > exiting
> >> > java.lang.RuntimeException: Failed construction of Master: class
> >> >
> >> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> >> > at
> >> >
> >> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> >> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> >> > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> >> > Caused by: java.lang.NoClassDefFoundError:
> >> com/yammer/metrics/stats/Sample
> >> > at
> >> >
> >> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> >> > at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> >> > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> >> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> >> Method)
> >> > at
> >> >
> >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> >> > at
> >> >
> >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> >> > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> >> > at
> >> >
> >> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> >> > ... 7 more
> >> >
> >> >
> >> > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk
> >> and
> >> > has been able to start it? I checked and class is on the metric jar, and
> >> > the jar in there on the CP. so I'm wondering where this is coming from
> >> and
> >> > still investigating. If I found anything, I will open a JIRA and provide
> >> > the details...
> >> >
> >> > Thanks,
> >> >
> >> > JM
> >>
> >
> >
Re: Start HBase build from BigTop
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Ok. Found that the culprit jars (read only for root) have the same rights
on the build machine in .m2/repository/... So 2 options. At the build time
they need to be made a+r, or, at the deployment time they need to be made
a+r...
JM
2014-08-20 16:56 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Hi Cos,
>
> I think build is fine because I'm able to start HBase from the command
> line directly.
>
> I found one thing.
>
> -rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar
>
> Some jars don't have the correct rights. That's one of the issues I faced.
>
> I fixed the java.lang.NoClassDefFoundError:
> org/apache/hadoop/http/HttpServer from the init.d script by exporting
> HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
>
> Now I have another exception on the HBase side but I'm very confortable to
> look at it:
> org.apache.hadoop.hbase.TableExistsException: hbase:namespace
> at
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
> at
> org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
> at
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
> at
> org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
> at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
> at java.lang.Thread.run(Thread.java:745)
>
> Did not have it when I run manually.
>
> I will continue and report when I found where it comes from..
>
> Thanks,
>
> JM
>
>
> 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
>
> Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
>> setup a cluster from bigtop bits and run it. Furthermore, I was able to
>> do it
>> with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
>> service
>> caveat.
>>
>> One of the possible reasons for the problem you see is merge of region and
>> master services. So, the master service is no longer relevant and needs
>> to be
>> removed (there's a ticket for it). Another one is the changes in the HBase
>> build process which needs to be reflected in Bigtop.
>>
>> Hope it helps,
>> Cos
>>
>> On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
>> > Hi,
>> >
>> > I have no issues to build and start HBase from HBase code.
>> >
>> > But when I try from BigTop, at stratup I get a class not found error:
>> > [root@hbr101 ~]# /etc/init.d/hbase-master start
>> > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/http/HttpServer
>> > at java.lang.ClassLoader.defineClass1(Native Method)
>> > at java.lang.ClassLoader.defineClass(Unknown Source)
>> > at java.security.SecureClassLoader.defineClass(Unknown Source)
>> > at java.net.URLClassLoader.defineClass(Unknown Source)
>> > at java.net.URLClassLoader.access$100(Unknown Source)
>> > at java.net.URLClassLoader$1.run(Unknown Source)
>> > at java.net.URLClassLoader$1.run(Unknown Source)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(Unknown Source)
>> > Failed to start HBase master daemon. Return value: 1 [FAILED]
>> >
>> > If I export the Hadoop and HBase classpath, I'm able to pass this, but
>> the
>> > I face another ClassNotFound exception on the HBase side.
>> >
>> > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
>> > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
>> > starting master, logging to
>> /var/log/hbase/hbase-hbase-master-10-0-1-208.out
>> > Started HBase master daemon (hbase-master): [ OK ]
>> >
>> > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase
>> metrics
>> > system started
>> > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
>> > exiting
>> > java.lang.RuntimeException: Failed construction of Master: class
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
>> > at
>> >
>> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
>> > at
>> >
>> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
>> > at
>> >
>> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
>> > at
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
>> > at
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
>> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> > at
>> >
>> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
>> > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
>> > Caused by: java.lang.NoClassDefFoundError:
>> com/yammer/metrics/stats/Sample
>> > at
>> >
>> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
>> > at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
>> > at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
>> > at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
>> > at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
>> > at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
>> > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
>> > at
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
>> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>> Method)
>> > at
>> >
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> > at
>> >
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> > at
>> >
>> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
>> > ... 7 more
>> >
>> >
>> > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk
>> and
>> > has been able to start it? I checked and class is on the metric jar, and
>> > the jar in there on the CP. so I'm wondering where this is coming from
>> and
>> > still investigating. If I found anything, I will open a JIRA and provide
>> > the details...
>> >
>> > Thanks,
>> >
>> > JM
>>
>
>
Re: Start HBase build from BigTop
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Cos,
I think build is fine because I'm able to start HBase from the command line
directly.
I found one thing.
-rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar
Some jars don't have the correct rights. That's one of the issues I faced.
I fixed the java.lang.NoClassDefFoundError:
org/apache/hadoop/http/HttpServer from the init.d script by exporting
HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
Now I have another exception on the HBase side but I'm very confortable to
look at it:
org.apache.hadoop.hbase.TableExistsException: hbase:namespace
at
org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
at
org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
at
org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
at
org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
at java.lang.Thread.run(Thread.java:745)
Did not have it when I run manually.
I will continue and report when I found where it comes from..
Thanks,
JM
2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <co...@apache.org>:
> Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
> setup a cluster from bigtop bits and run it. Furthermore, I was able to do
> it
> with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
> service
> caveat.
>
> One of the possible reasons for the problem you see is merge of region and
> master services. So, the master service is no longer relevant and needs to
> be
> removed (there's a ticket for it). Another one is the changes in the HBase
> build process which needs to be reflected in Bigtop.
>
> Hope it helps,
> Cos
>
> On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> > Hi,
> >
> > I have no issues to build and start HBase from HBase code.
> >
> > But when I try from BigTop, at stratup I get a class not found error:
> > [root@hbr101 ~]# /etc/init.d/hbase-master start
> > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/http/HttpServer
> > at java.lang.ClassLoader.defineClass1(Native Method)
> > at java.lang.ClassLoader.defineClass(Unknown Source)
> > at java.security.SecureClassLoader.defineClass(Unknown Source)
> > at java.net.URLClassLoader.defineClass(Unknown Source)
> > at java.net.URLClassLoader.access$100(Unknown Source)
> > at java.net.URLClassLoader$1.run(Unknown Source)
> > at java.net.URLClassLoader$1.run(Unknown Source)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(Unknown Source)
> > Failed to start HBase master daemon. Return value: 1 [FAILED]
> >
> > If I export the Hadoop and HBase classpath, I'm able to pass this, but
> the
> > I face another ClassNotFound exception on the HBase side.
> >
> > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> > starting master, logging to
> /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> > Started HBase master daemon (hbase-master): [ OK ]
> >
> > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase
> metrics
> > system started
> > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
> > exiting
> > java.lang.RuntimeException: Failed construction of Master: class
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> > at
> >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > at
> >
> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> > at
> >
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> > at
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> > at
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > at
> >
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> > Caused by: java.lang.NoClassDefFoundError:
> com/yammer/metrics/stats/Sample
> > at
> >
> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> > at
> >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> > at
> >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> > at
> >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> > at
> >
> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> > at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> > at
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> > at
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > at
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > at
> >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > ... 7 more
> >
> >
> > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk
> and
> > has been able to start it? I checked and class is on the metric jar, and
> > the jar in there on the CP. so I'm wondering where this is coming from
> and
> > still investigating. If I found anything, I will open a JIRA and provide
> > the details...
> >
> > Thanks,
> >
> > JM
>
Re: Start HBase build from BigTop
Posted by Konstantin Boudnik <co...@apache.org>.
Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
setup a cluster from bigtop bits and run it. Furthermore, I was able to do it
with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master service
caveat.
One of the possible reasons for the problem you see is merge of region and
master services. So, the master service is no longer relevant and needs to be
removed (there's a ticket for it). Another one is the changes in the HBase
build process which needs to be reflected in Bigtop.
Hope it helps,
Cos
On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> Hi,
>
> I have no issues to build and start HBase from HBase code.
>
> But when I try from BigTop, at stratup I get a class not found error:
> [root@hbr101 ~]# /etc/init.d/hbase-master start
> starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/http/HttpServer
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(Unknown Source)
> at java.security.SecureClassLoader.defineClass(Unknown Source)
> at java.net.URLClassLoader.defineClass(Unknown Source)
> at java.net.URLClassLoader.access$100(Unknown Source)
> at java.net.URLClassLoader$1.run(Unknown Source)
> at java.net.URLClassLoader$1.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(Unknown Source)
> Failed to start HBase master daemon. Return value: 1 [FAILED]
>
> If I export the Hadoop and HBase classpath, I'm able to pass this, but the
> I face another ClassNotFound exception on the HBase side.
>
> export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> starting master, logging to /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> Started HBase master daemon (hbase-master): [ OK ]
>
> 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase metrics
> system started
> 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
> exiting
> java.lang.RuntimeException: Failed construction of Master: class
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> at
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> Caused by: java.lang.NoClassDefFoundError: com/yammer/metrics/stats/Sample
> at
> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> ... 7 more
>
>
> I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk and
> has been able to start it? I checked and class is on the metric jar, and
> the jar in there on the CP. so I'm wondering where this is coming from and
> still investigating. If I found anything, I will open a JIRA and provide
> the details...
>
> Thanks,
>
> JM
Re: Start HBase build from BigTop
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Ok. I'm able to start the master in standalone mode if I use
"/usr/bin/hbase master start" without any classpath nor class not found
issue.
I will try to figure why the init.d script creates issues...
2014-08-20 15:31 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Hi,
>
> I have no issues to build and start HBase from HBase code.
>
> But when I try from BigTop, at stratup I get a class not found error:
> [root@hbr101 ~]# /etc/init.d/hbase-master start
> starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/http/HttpServer
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(Unknown Source)
> at java.security.SecureClassLoader.defineClass(Unknown Source)
> at java.net.URLClassLoader.defineClass(Unknown Source)
> at java.net.URLClassLoader.access$100(Unknown Source)
> at java.net.URLClassLoader$1.run(Unknown Source)
> at java.net.URLClassLoader$1.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(Unknown Source)
> Failed to start HBase master daemon. Return value: 1 [FAILED]
>
> If I export the Hadoop and HBase classpath, I'm able to pass this, but the
> I face another ClassNotFound exception on the HBase side.
>
> export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> starting master, logging to
> /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> Started HBase master daemon (hbase-master): [ OK ]
>
> 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase metrics
> system started
> 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
> exiting
> java.lang.RuntimeException: Failed construction of Master: class
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> at
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> Caused by: java.lang.NoClassDefFoundError: com/yammer/metrics/stats/Sample
> at
> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> at
> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> ... 7 more
>
>
> I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk and
> has been able to start it? I checked and class is on the metric jar, and
> the jar in there on the CP. so I'm wondering where this is coming from and
> still investigating. If I found anything, I will open a JIRA and provide
> the details...
>
> Thanks,
>
> JM
>