You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Ted Yu <yu...@gmail.com> on 2014/01/16 18:41:15 UTC

lib and libexec folders in hadoop 2.2 WAS: Issue in HBASE setup

The latest question would be better answered in the hadoop user mailing
list.

Cheers


On Thu, Jan 16, 2014 at 9:36 AM, jeevi tesh <je...@gmail.com> wrote:

> but the issue with 2.2 is it does not have libexec , lib folders...
> so i installed 0.23.9. Can you please through some light why this important
> folders are missing in 2.2 and also in release version.
> Can i use lib and libexec folders of 0.23 with2.2
>
>
> On Thu, Jan 16, 2014 at 10:52 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > From 0.96 pom.xml:
> >
> >     <hadoop-two.version>2.2.0</hadoop-two.version>
> >
> > Meaning, 0.96.1.1-hadoop2 was built using hadoop 2.2.0
> >
> > See http://hbase.apache.org/book.html#d2907e520
> >
> > Can you deploy hadoop 2.2 ?
> >
> >
> > On Thu, Jan 16, 2014 at 9:16 AM, jeevi tesh <je...@gmail.com>
> > wrote:
> >
> > > hi ted,
> > > Thank you very much for taking initiative to help.
> > > Hadoop version is hadoop -0.23.9
> > > and hbase version is : hbase-0.96.1.1-hadoop2
> > > OS: Ubuntu
> > > It was copy paste issue
> > > So please find the update log file you can find error at the end of the
> > log
> > >
> > > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMasternull
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:200)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:150)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:177)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:134)
> > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2779)
> > > Caused by: java.lang.RuntimeException:
> > > java.lang.reflect.InvocationTargetException
> > > at
> > >
> > >
> >
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> > > at org.apache.hadoop.security.Groups.<init>(Groups.java:55)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:182)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:235)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:214)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:275)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:269)
> > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > at
> > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > > at
> > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > at java.lang.reflect.Method.invoke(Method.java:606)
> > > at org.apache.hadoop.hbase.util.Methods.call(Methods.java:39)
> > > at org.apache.hadoop.hbase.security.User.call(User.java:434)
> > > at org.apache.hadoop.hbase.security.User.callStatic(User.java:424)
> > > at org.apache.hadoop.hbase.security.User.access$200(User.java:49)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(User.java:412)
> > > at
> > >
> >
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:383)
> > > at org.apache.hadoop.hbase.security.User.login(User.java:207)
> > > at
> > >
> >
> org.apache.hadoop.hbase.security.UserProvider.login(UserProvider.java:113)
> > > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:455)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:256)
> > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> > > at
> > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > at
> > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > > ... 7 more
> > > Caused by: java.lang.reflect.InvocationTargetException
> > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> > > at
> > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > at
> > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > at
> > >
> > >
> >
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:129)
> > > ... 32 more
> > > Caused by: java.lang.UnsatisfiedLinkError:
> > > org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
> > > at
> > org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native
> > > Method)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.<clinit>(JniBasedUnixGroupsMapping.java:49)
> > > at
> > >
> > >
> >
> org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.<init>(JniBasedUnixGroupsMappingWithFallback.java:38)
> > > ... 37 more
> > >
> > >
> > > On Thu, Jan 16, 2014 at 9:02 PM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > Which hbase / hadoop version are you using ?
> > > >
> > > > 'jniBasedUnixGroupsMapping.anchorNative' doesn't appear in the stack
> > > trace
> > > > you pasted. Can you give a bit more information ?
> > > >
> > > > Thanks
> > > >
> > > >
> > > > On Wed, Jan 15, 2014 at 11:55 PM, jeevi tesh <jeevitesh.ms@gmail.com
> >
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Getting following error on issue of any command in hbase “error
> > > > > org.apache.hadoop.security.jniBasedUnixGroupsMapping.anchorNative”.
> > > > >
> > > > >
> > > > > The moment I issue command start-hbase.sh
> > > > >
> > > > > Getting following error in log file.
> > > > >
> > > > > Any suggestion will be of great help .
> > > > >
> > > > > Thanks
> > > > >
> > > > > 2014-01-16 12:34:42,462 ERROR [main] master.HMasterCommandLine:
> > Master
> > > > > exiting
> > > > >
> > > > > java.lang.RuntimeException: Failed construction of Master: class
> > > > > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMasternull
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:200)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:150)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:177)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:134)
> > > > >
> > > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > > > >
> > > > > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2779)
> > > > >
> > > > > Caused by: java.lang.RuntimeException:
> > > > > java.lang.reflect.InvocationTargetException
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
> > > > >
> > > > > at org.apache.hadoop.security.Groups.<init>(Groups.java:55)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:182)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:235)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:214)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:275)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:269)
> > > > >
> > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > >
> > > > > at java.lang.reflect.Method.invoke(Method.java:606)
> > > > >
> > > > > at org.apache.hadoop.hbase.util.Methods.call(Methods.java:39)
> > > > >
> > > > > at org.apache.hadoop.hbase.security.User.call(User.java:434)
> > > > >
> > > > > at org.apache.hadoop.hbase.security.User.callStatic(User.java:424)
> > > > >
> > > > > at org.apache.hadoop.hbase.security.User.access$200(User.java:49)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(User.java:412)
> > > > >
> > > > > at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:383)
> > > > >
> > > > > at org.apache.hadoop.hbase.security.User.login(User.java:207)
> > > > >
> > > > > at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.UserProvider.login(UserProvider.java:113)
> > > > >
> > > > > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:455)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:256)
> > > > >
> > > > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > Method)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > > >
> > > > > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > > > >
> > > > > ... 7 more
> > > > >
> > > > > Caused by: java.lang.reflect.InvocationTargetException
> > > > >
> > > > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > Method)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > > >
> > > > > at
> > > > >
> > > > >
> > > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > > >
> > > > > at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > > >
> > > >
> > >
> >
>