You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by abhishek1015 <ab...@gmail.com> on 2014/07/31 19:20:22 UTC

hbase 2.0.0-SNAPSHOT compatibility with hadoop 1.2.1?

Hello,

I successfully compiled hbase 2.0.0-SNAPSHOT with maven 3.0.5. After
configuring the cluster, when i start the cluster using 'hbase shell'
command, all services except HMaster starts. I see following security
related exception in HMaster log. Could it be because i am running it with
hadoop 1.2.1 version? I see that pom.xml recommends hadoop 3.0.0-SNAPSHOT
version. But, I am not sure where to get this SNAPSHOT.

Thanks for any help.

2014-07-31 17:23:54,897 ERROR [main] master.HMasterCommandLine: Master
exiting
java.lang.RuntimeException: Failed construction of Master: class
org.apache.hadoop.hbase.master.HMaster
        at
org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1796)
        at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:194)
        at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
        at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1810)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:129)
        at org.apache.hadoop.security.Groups.<init>(Groups.java:64)
        at
org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:240)
 at
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:255)
        at
org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:232)
        at
org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:309)
        at
org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:303)
        at
org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(User.java:349)
        at
org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:340)
        at org.apache.hadoop.hbase.security.User.login(User.java:208)
        at
org.apache.hadoop.hbase.security.UserProvider.login(UserProvider.java:113)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.login(HRegionServer.java:523)
        at org.apache.hadoop.hbase.master.HMaster.login(HMaster.java:341)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:470)
        at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:267)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at
org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1791)
        ... 5 more
Caused by: java.lang.UnsatisfiedLinkError:
org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
        at
org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native
Method)
        at
org.apache.hadoop.security.JniBasedUnixGroupsMapping.<clinit>(JniBasedUnixGroupsMapping.java:49)
        at
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.<init>(JniBasedUnixGroupsMappingWithFallback.java:38)
        ... 29 more


Abhishek



--
View this message in context: http://apache-hbase.679495.n3.nabble.com/hbase-2-0-0-SNAPSHOT-compatibility-with-hadoop-1-2-1-tp4062149.html
Sent from the HBase Developer mailing list archive at Nabble.com.

Re: hbase 2.0.0-SNAPSHOT compatibility with hadoop 1.2.1?

Posted by abhishek1015 <ab...@gmail.com>.

Thanks Mike. I appreciate your input.

I installed the newer version of the hadoop (2.2.0). This solved the
security issue I was facing. However, I see the regionserver port conflict
issue which I have posted on other thread.

Thanks
Abhishek



--
View this message in context: http://apache-hbase.679495.n3.nabble.com/hbase-2-0-0-SNAPSHOT-compatibility-with-hadoop-1-2-1-tp4062149p4062204.html
Sent from the HBase Developer mailing list archive at Nabble.com.

Re: hbase 2.0.0-SNAPSHOT compatibility with hadoop 1.2.1?

Posted by Mike Drob <ma...@cloudera.com>.

Hi Abishek!

According to the Hadoop compatibility table, it looks like HBase 1.0 is
only supposed to support Hadoop 2.2.0 and newer. HBase 2.0 branch is very
similar to the 1.0 branch and I expect it to have the same requirements.

http://hbase.apache.org/book.html#hadoop

Mike


On Thu, Jul 31, 2014 at 12:20 PM, abhishek1015 <ab...@gmail.com>
wrote:

> Hello,
>
> I successfully compiled hbase 2.0.0-SNAPSHOT with maven 3.0.5. After
> configuring the cluster, when i start the cluster using 'hbase shell'
> command, all services except HMaster starts. I see following security
> related exception in HMaster log. Could it be because i am running it with
> hadoop 1.2.1 version? I see that pom.xml recommends hadoop 3.0.0-SNAPSHOT
> version. But, I am not sure where to get this SNAPSHOT.
>
> Thanks for any help.
>
> 2014-07-31 17:23:54,897 ERROR [main] master.HMasterCommandLine: Master
> exiting
> java.lang.RuntimeException: Failed construction of Master: class
> org.apache.hadoop.hbase.master.HMaster
>         at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1796)
>         at
>
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:194)
>         at
>
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at
>
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
>         at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1810)
> Caused by: java.lang.reflect.InvocationTargetException
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at
>
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:129)
>         at org.apache.hadoop.security.Groups.<init>(Groups.java:64)
>         at
>
> org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:240)
>  at
>
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:255)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:232)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:309)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:303)
>         at
>
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(User.java:349)
>         at
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:340)
>         at org.apache.hadoop.hbase.security.User.login(User.java:208)
>         at
> org.apache.hadoop.hbase.security.UserProvider.login(UserProvider.java:113)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.login(HRegionServer.java:523)
>         at org.apache.hadoop.hbase.master.HMaster.login(HMaster.java:341)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:470)
>         at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:267)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1791)
>         ... 5 more
> Caused by: java.lang.UnsatisfiedLinkError:
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative()V
>         at
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.anchorNative(Native
> Method)
>         at
>
> org.apache.hadoop.security.JniBasedUnixGroupsMapping.<clinit>(JniBasedUnixGroupsMapping.java:49)
>         at
>
> org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.<init>(JniBasedUnixGroupsMappingWithFallback.java:38)
>         ... 29 more
>
>
> Abhishek
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/hbase-2-0-0-SNAPSHOT-compatibility-with-hadoop-1-2-1-tp4062149.html
> Sent from the HBase Developer mailing list archive at Nabble.com.
>