You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Lukáš Drbal <lu...@gmail.com> on 2014/04/23 21:15:05 UTC
HBase 0.94 on hadoop 2.2.0 (2.4.0)
Hi,
iam trying run HBase on hadoop 2.2 but master can't start.
I found a message in master log (snipped):
2014-04-23 20:58:24,246 FATAL org.apache.hadoop.hbase.master.HMaster: HBase
is having a problem with its Hadoop jars. You may need to recompile HBase
against Hadoop version 2.2.0 or change your hadoop jars to start properly
java.lang.NoClassDefFoundError:
org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
at
org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:240)
at
org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:634)
at
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:423)
at
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:148)
at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:133)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:573)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:433)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 8 more
2014-04-23 20:58:24,248 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting
2014-04-23 20:58:24,248 DEBUG org.apache.hadoop.hbase.master.HMaster:
Stopping service threads
I take actual 0.94 branch from git and run mvn clean install
assembly:single -Dhadoop.profile=2.2 -DskipTests
Here is my modifications in pom.xml
https://gist.github.com/LesTR/56d7d6ddbeb184460251
Local hadoop run fine and HBase has jars with right version
root@hadoop-master:/usr/share/hbase/lib# ls -l hadoop*
-rw-r--r-- 1 lestr lestr 16778 Apr 23 20:10 hadoop-annotations-2.2.0.jar
-rw-r--r-- 1 lestr lestr 49750 Apr 23 20:10 hadoop-auth-2.2.0.jar
-rw-r--r-- 1 lestr lestr 2735584 Apr 23 20:10 hadoop-common-2.2.0.jar
-rw-r--r-- 1 lestr lestr 1352859 Apr 23 20:10 hadoop-common-2.2.0-tests.jar
-rw-r--r-- 1 lestr lestr 5242252 Apr 23 20:10 hadoop-hdfs-2.2.0.jar
-rw-r--r-- 1 lestr lestr 1988460 Apr 23 20:10 hadoop-hdfs-2.2.0-tests.jar
-rw-r--r-- 1 lestr lestr 482042 Apr 23 20:10
hadoop-mapreduce-client-app-2.2.0.jar
-rw-r--r-- 1 lestr lestr 656365 Apr 23 20:10
hadoop-mapreduce-client-common-2.2.0.jar
-rw-r--r-- 1 lestr lestr 1455001 Apr 23 20:10
hadoop-mapreduce-client-core-2.2.0.jar
-rw-r--r-- 1 lestr lestr 117184 Apr 23 20:10
hadoop-mapreduce-client-hs-2.2.0.jar
-rw-r--r-- 1 lestr lestr 35216 Apr 23 20:10
hadoop-mapreduce-client-jobclient-2.2.0.jar
-rw-r--r-- 1 lestr lestr 1434852 Apr 23 20:10
hadoop-mapreduce-client-jobclient-2.2.0-tests.jar
-rw-r--r-- 1 lestr lestr 21537 Apr 23 20:10
hadoop-mapreduce-client-shuffle-2.2.0.jar
-rw-r--r-- 1 lestr lestr 2076 Apr 23 20:10 hadoop-minicluster-2.2.0.jar
-rw-r--r-- 1 lestr lestr 1158936 Apr 23 20:10 hadoop-yarn-api-2.2.0.jar
-rw-r--r-- 1 lestr lestr 94728 Apr 23 20:10 hadoop-yarn-client-2.2.0.jar
-rw-r--r-- 1 lestr lestr 1301627 Apr 23 20:10 hadoop-yarn-common-2.2.0.jar
-rw-r--r-- 1 lestr lestr 175554 Apr 23 20:10
hadoop-yarn-server-common-2.2.0.jar
-rw-r--r-- 1 lestr lestr 467638 Apr 23 20:10
hadoop-yarn-server-nodemanager-2.2.0.jar
-rw-r--r-- 1 lestr lestr 615387 Apr 23 20:10
hadoop-yarn-server-resourcemanager-2.2.0.jar
-rw-r--r-- 1 lestr lestr 35347 Apr 23 20:10
hadoop-yarn-server-tests-2.2.0-tests.jar
-rw-r--r-- 1 lestr lestr 25710 Apr 23 20:10
hadoop-yarn-server-web-proxy-2.2.0.jar
root@hadoop-master:/usr/share/hbase/lib#
Same situation on hadoop 2.4.
I found only org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction
class in hadoop 2.{2,4}
Any advice please?
--
Save The World - http://www.worldcommunitygrid.org/
http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
LesTR
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Stack <st...@duboce.net>.
Looks like you followed the instruction here:
http://hbase.apache.org/book.html#ftn.d248e643
So, when you start up your cluster for sure hbase has the hadoop 2.2. jars
in place under its lib all over your cluster (and there are no vestiges of
earlier hadoops on its CLASSPATH?).
In the master log, one of the first things it does is print out the
CLASSPATH it is using. Check it for old hadoops/hbases.
St.Ack
On Wed, Apr 23, 2014 at 12:15 PM, Lukáš Drbal <lu...@gmail.com> wrote:
> Hi,
>
> iam trying run HBase on hadoop 2.2 but master can't start.
>
> I found a message in master log (snipped):
>
> 2014-04-23 20:58:24,246 FATAL org.apache.hadoop.hbase.master.HMaster: HBase
> is having a problem with its Hadoop jars. You may need to recompile HBase
> against Hadoop version 2.2.0 or change your hadoop jars to start properly
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
> at
> org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:240)
> at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:634)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:423)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:148)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:133)
> at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:573)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:433)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 8 more
> 2014-04-23 20:58:24,248 INFO org.apache.hadoop.hbase.master.HMaster:
> Aborting
> 2014-04-23 20:58:24,248 DEBUG org.apache.hadoop.hbase.master.HMaster:
> Stopping service threads
>
>
> I take actual 0.94 branch from git and run mvn clean install
> assembly:single -Dhadoop.profile=2.2 -DskipTests
>
> Here is my modifications in pom.xml
> https://gist.github.com/LesTR/56d7d6ddbeb184460251
>
> Local hadoop run fine and HBase has jars with right version
>
> root@hadoop-master:/usr/share/hbase/lib# ls -l hadoop*
> -rw-r--r-- 1 lestr lestr 16778 Apr 23 20:10 hadoop-annotations-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 49750 Apr 23 20:10 hadoop-auth-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 2735584 Apr 23 20:10 hadoop-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1352859 Apr 23 20:10 hadoop-common-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 5242252 Apr 23 20:10 hadoop-hdfs-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1988460 Apr 23 20:10 hadoop-hdfs-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 482042 Apr 23 20:10
> hadoop-mapreduce-client-app-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 656365 Apr 23 20:10
> hadoop-mapreduce-client-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1455001 Apr 23 20:10
> hadoop-mapreduce-client-core-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 117184 Apr 23 20:10
> hadoop-mapreduce-client-hs-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 35216 Apr 23 20:10
> hadoop-mapreduce-client-jobclient-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1434852 Apr 23 20:10
> hadoop-mapreduce-client-jobclient-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 21537 Apr 23 20:10
> hadoop-mapreduce-client-shuffle-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 2076 Apr 23 20:10 hadoop-minicluster-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1158936 Apr 23 20:10 hadoop-yarn-api-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 94728 Apr 23 20:10 hadoop-yarn-client-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1301627 Apr 23 20:10 hadoop-yarn-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 175554 Apr 23 20:10
> hadoop-yarn-server-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 467638 Apr 23 20:10
> hadoop-yarn-server-nodemanager-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 615387 Apr 23 20:10
> hadoop-yarn-server-resourcemanager-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 35347 Apr 23 20:10
> hadoop-yarn-server-tests-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 25710 Apr 23 20:10
> hadoop-yarn-server-web-proxy-2.2.0.jar
> root@hadoop-master:/usr/share/hbase/lib#
>
> Same situation on hadoop 2.4.
>
> I found only org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction
> class in hadoop 2.{2,4}
>
> Any advice please?
>
> --
> Save The World - http://www.worldcommunitygrid.org/
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
>
> LesTR
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
I logged HBASE-11076 for updating refguide so that users have the right
steps to follow.
Cheers
On Fri, Apr 25, 2014 at 6:46 AM, Lukáš Drbal <lu...@gmail.com> wrote:
> Cool, it's running now.
>
> Thank you Ted.
>
> L.
>
>
> 2014-04-25 15:18 GMT+02:00 Ted Yu <yu...@gmail.com>:
>
> > In 0.94, there're some .proto files. The two related to exception you
> > posted are:
> >
> > ./src/main/protobuf/ErrorHandling.proto
> > ./src/main/protobuf/hbase.proto
> >
> > src/main/java/org/apache/hadoop/hbase/protobuf/generated contains classes
> > generated by protobuf 2.4 compiler.
> > You should regenerate classes for the above two .proto files.
> >
> > Run the following for each .proto file (assuming you have protobuf 2.5.0
> > installed locally):
> >
> > protoc -Isrc/main/protobuf --java_out=src/main/java $PROTO_FILE
> >
> > Then rebuild tar ball.
> >
> > Cheers
> >
> > On Fri, Apr 25, 2014 at 4:32 AM, Lukáš Drbal <lu...@gmail.com>
> > wrote:
> >
> > > Hi Guys,
> > >
> > > Ted thank you for -Dhadoop.version=2.2.0 it works.
> > >
> > > Now i have master running on hadoop 2.2.0 but region server don't run.
> > > Full log - https://gist.github.com/LesTR/57e2a8f2afe419b42405
> > >
> > >
> > > 2014-04-24 12:00:18,103 WARN
> > > org.apache.hadoop.hbase.regionserver.HRegionServer: Exception in
> > > region server :
> > > java.lang.UnsupportedOperationException: This is supposed to be
> > > overridden by subclasses.
> > > at
> > >
> >
> com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
> > > at
> > >
> >
> org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
> > > at
> > >
> >
> com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
> > > at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
> > > at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
> > > at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> > > From this exception i see a problem with protobufers libs. I change
> > > version from 2.4.0a to 2.5.0 as is mentioned in book and compiled with
> > > -Dprotobuf.version=2.5.0
> > >
> > > In classpath exits only 2.5.0 version
> > > root@hadoop-master:/usr/share/hbase/lib# hbase classpath | tr ":" "\n"
> > > | grep -i proto
> > > /usr/share/hbase/bin/../lib/protobuf-java-2.5.0.jar
> > >
> > > root@hadoop-master:/usr/share/hbase/lib#
> > >
> > > Any hint please?
> > >
> > >
> > > L.
> > >
> > >
> > >
> > >
> > >
> > >
> > > 2014-04-24 18:33 GMT+02:00 Ted Yu <yu...@gmail.com>:
> > >
> > > > Support for hadoop 3.0 is tracked by HBASE-6581
> > > >
> > > > FYI
> > > >
> > > >
> > > > On Thu, Apr 24, 2014 at 2:49 AM, Azuryy Yu <az...@gmail.com>
> wrote:
> > > >
> > > > > Hi Ted,
> > > > > Sorry I misunderstood something, I found these issues during built
> > > > > hbase-0.9* against hadoop trunk.
> > > > >
> > > > > we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0
> is
> > > > > reasonabl currently.
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com>
> > wrote:
> > > > >
> > > > > > Looking at branch-2 , we can
> > > > > > find
> > > > > >
> > > > >
> > > >
> > >
> >
> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
> > > > > >
> > > > > > Please refer to this commit:
> > > > > >
> > > > > > r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014)
> |
> > 1
> > > > line
> > > > > >
> > > > > > HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
> > > > Contributed
> > > > > > by Haohui Mai.
> > > > > >
> > > > > > bq. also some MapReduce issues
> > > > > >
> > > > > > Can you list what issues they're ?
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > > On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com>
> > > wrote:
> > > > > >
> > > > > > > This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
> > > > > > HttpServer
> > > > > > > was removed in the Hadoop2.4, but HBase InfoServer still use
> it,
> > > and
> > > > > > there
> > > > > > > are also some MapReduce issues, so if you build HBase-0.94
> > against
> > > > > > > Hadoop-2.4, it will fail.
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Save The World - http://www.worldcommunitygrid.org/
> > >
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
> > >
> > > LesTR
> > >
> >
>
>
>
> --
> Save The World - http://www.worldcommunitygrid.org/
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
>
> LesTR
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Lukáš Drbal <lu...@gmail.com>.
Cool, it's running now.
Thank you Ted.
L.
2014-04-25 15:18 GMT+02:00 Ted Yu <yu...@gmail.com>:
> In 0.94, there're some .proto files. The two related to exception you
> posted are:
>
> ./src/main/protobuf/ErrorHandling.proto
> ./src/main/protobuf/hbase.proto
>
> src/main/java/org/apache/hadoop/hbase/protobuf/generated contains classes
> generated by protobuf 2.4 compiler.
> You should regenerate classes for the above two .proto files.
>
> Run the following for each .proto file (assuming you have protobuf 2.5.0
> installed locally):
>
> protoc -Isrc/main/protobuf --java_out=src/main/java $PROTO_FILE
>
> Then rebuild tar ball.
>
> Cheers
>
> On Fri, Apr 25, 2014 at 4:32 AM, Lukáš Drbal <lu...@gmail.com>
> wrote:
>
> > Hi Guys,
> >
> > Ted thank you for -Dhadoop.version=2.2.0 it works.
> >
> > Now i have master running on hadoop 2.2.0 but region server don't run.
> > Full log - https://gist.github.com/LesTR/57e2a8f2afe419b42405
> >
> >
> > 2014-04-24 12:00:18,103 WARN
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Exception in
> > region server :
> > java.lang.UnsupportedOperationException: This is supposed to be
> > overridden by subclasses.
> > at
> >
> com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
> > at
> >
> org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
> > at
> >
> com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
> > at java.lang.Thread.run(Thread.java:745)
> >
> > From this exception i see a problem with protobufers libs. I change
> > version from 2.4.0a to 2.5.0 as is mentioned in book and compiled with
> > -Dprotobuf.version=2.5.0
> >
> > In classpath exits only 2.5.0 version
> > root@hadoop-master:/usr/share/hbase/lib# hbase classpath | tr ":" "\n"
> > | grep -i proto
> > /usr/share/hbase/bin/../lib/protobuf-java-2.5.0.jar
> >
> > root@hadoop-master:/usr/share/hbase/lib#
> >
> > Any hint please?
> >
> >
> > L.
> >
> >
> >
> >
> >
> >
> > 2014-04-24 18:33 GMT+02:00 Ted Yu <yu...@gmail.com>:
> >
> > > Support for hadoop 3.0 is tracked by HBASE-6581
> > >
> > > FYI
> > >
> > >
> > > On Thu, Apr 24, 2014 at 2:49 AM, Azuryy Yu <az...@gmail.com> wrote:
> > >
> > > > Hi Ted,
> > > > Sorry I misunderstood something, I found these issues during built
> > > > hbase-0.9* against hadoop trunk.
> > > >
> > > > we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0 is
> > > > reasonabl currently.
> > > >
> > > >
> > > >
> > > > On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com>
> wrote:
> > > >
> > > > > Looking at branch-2 , we can
> > > > > find
> > > > >
> > > >
> > >
> >
> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
> > > > >
> > > > > Please refer to this commit:
> > > > >
> > > > > r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) |
> 1
> > > line
> > > > >
> > > > > HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
> > > Contributed
> > > > > by Haohui Mai.
> > > > >
> > > > > bq. also some MapReduce issues
> > > > >
> > > > > Can you list what issues they're ?
> > > > >
> > > > > Thanks
> > > > >
> > > > > On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com>
> > wrote:
> > > > >
> > > > > > This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
> > > > > HttpServer
> > > > > > was removed in the Hadoop2.4, but HBase InfoServer still use it,
> > and
> > > > > there
> > > > > > are also some MapReduce issues, so if you build HBase-0.94
> against
> > > > > > Hadoop-2.4, it will fail.
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Save The World - http://www.worldcommunitygrid.org/
> > http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
> >
> > LesTR
> >
>
--
Save The World - http://www.worldcommunitygrid.org/
http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
LesTR
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by pprandive <pp...@rediffmail.com>.
Thank you so much!
-Prafulla
--
View this message in context: http://apache-hbase.679495.n3.nabble.com/HBase-0-94-on-hadoop-2-2-0-2-4-0-tp4058517p4059509.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
Yes - rebuilding hbase tar ball.
You can find the mvn command in #d of:
http://hbase.apache.org/book.html#d3001e523
Cheers
On Tue, May 20, 2014 at 11:47 PM, pprandive <pp...@rediffmail.com>wrote:
> Hi,
>
> I am also facing same issue so I followed your suggestion-
>
> I executed command,
>
> protoc -Isrc/main/protobuf --java_out=src/main/java
>
> for the both .proto files, i.e., ErrorHandling.proto and hbase.proto.
>
> However, I did not understand the next step.
> Could you please help me to understand meaning of 'rebuild tar ball'? Did
> you mean to recompile hbase?
>
> Thanks and Regards,
> Prafulla
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/HBase-0-94-on-hadoop-2-2-0-2-4-0-tp4058517p4059457.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by pprandive <pp...@rediffmail.com>.
Hi,
I am also facing same issue so I followed your suggestion-
I executed command,
protoc -Isrc/main/protobuf --java_out=src/main/java
for the both .proto files, i.e., ErrorHandling.proto and hbase.proto.
However, I did not understand the next step.
Could you please help me to understand meaning of 'rebuild tar ball'? Did
you mean to recompile hbase?
Thanks and Regards,
Prafulla
--
View this message in context: http://apache-hbase.679495.n3.nabble.com/HBase-0-94-on-hadoop-2-2-0-2-4-0-tp4058517p4059457.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
In 0.94, there're some .proto files. The two related to exception you
posted are:
./src/main/protobuf/ErrorHandling.proto
./src/main/protobuf/hbase.proto
src/main/java/org/apache/hadoop/hbase/protobuf/generated contains classes
generated by protobuf 2.4 compiler.
You should regenerate classes for the above two .proto files.
Run the following for each .proto file (assuming you have protobuf 2.5.0
installed locally):
protoc -Isrc/main/protobuf --java_out=src/main/java $PROTO_FILE
Then rebuild tar ball.
Cheers
On Fri, Apr 25, 2014 at 4:32 AM, Lukáš Drbal <lu...@gmail.com> wrote:
> Hi Guys,
>
> Ted thank you for -Dhadoop.version=2.2.0 it works.
>
> Now i have master running on hadoop 2.2.0 but region server don't run.
> Full log - https://gist.github.com/LesTR/57e2a8f2afe419b42405
>
>
> 2014-04-24 12:00:18,103 WARN
> org.apache.hadoop.hbase.regionserver.HRegionServer: Exception in
> region server :
> java.lang.UnsupportedOperationException: This is supposed to be
> overridden by subclasses.
> at
> com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
> at
> org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
> at
> com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
> at java.lang.Thread.run(Thread.java:745)
>
> From this exception i see a problem with protobufers libs. I change
> version from 2.4.0a to 2.5.0 as is mentioned in book and compiled with
> -Dprotobuf.version=2.5.0
>
> In classpath exits only 2.5.0 version
> root@hadoop-master:/usr/share/hbase/lib# hbase classpath | tr ":" "\n"
> | grep -i proto
> /usr/share/hbase/bin/../lib/protobuf-java-2.5.0.jar
>
> root@hadoop-master:/usr/share/hbase/lib#
>
> Any hint please?
>
>
> L.
>
>
>
>
>
>
> 2014-04-24 18:33 GMT+02:00 Ted Yu <yu...@gmail.com>:
>
> > Support for hadoop 3.0 is tracked by HBASE-6581
> >
> > FYI
> >
> >
> > On Thu, Apr 24, 2014 at 2:49 AM, Azuryy Yu <az...@gmail.com> wrote:
> >
> > > Hi Ted,
> > > Sorry I misunderstood something, I found these issues during built
> > > hbase-0.9* against hadoop trunk.
> > >
> > > we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0 is
> > > reasonabl currently.
> > >
> > >
> > >
> > > On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > Looking at branch-2 , we can
> > > > find
> > > >
> > >
> >
> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
> > > >
> > > > Please refer to this commit:
> > > >
> > > > r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) | 1
> > line
> > > >
> > > > HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
> > Contributed
> > > > by Haohui Mai.
> > > >
> > > > bq. also some MapReduce issues
> > > >
> > > > Can you list what issues they're ?
> > > >
> > > > Thanks
> > > >
> > > > On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com>
> wrote:
> > > >
> > > > > This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
> > > > HttpServer
> > > > > was removed in the Hadoop2.4, but HBase InfoServer still use it,
> and
> > > > there
> > > > > are also some MapReduce issues, so if you build HBase-0.94 against
> > > > > Hadoop-2.4, it will fail.
> > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Save The World - http://www.worldcommunitygrid.org/
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
>
> LesTR
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Lukáš Drbal <lu...@gmail.com>.
here https://gist.github.com/LesTR/137532401076ea0f4979
Thanks
--
Save The World - http://www.worldcommunitygrid.org/
http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
LesTR
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
Can you paste bin the output of the following command ?
mvn dependency:tree
Thanks
On Apr 25, 2014, at 4:32 AM, Lukáš Drbal <lu...@gmail.com> wrote:
> Hi Guys,
>
> Ted thank you for -Dhadoop.version=2.2.0 it works.
>
> Now i have master running on hadoop 2.2.0 but region server don't run.
> Full log - https://gist.github.com/LesTR/57e2a8f2afe419b42405
>
>
> 2014-04-24 12:00:18,103 WARN
> org.apache.hadoop.hbase.regionserver.HRegionServer: Exception in
> region server :
> java.lang.UnsupportedOperationException: This is supposed to be
> overridden by subclasses.
> at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
> at org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
> at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
> at java.lang.Thread.run(Thread.java:745)
>
> From this exception i see a problem with protobufers libs. I change
> version from 2.4.0a to 2.5.0 as is mentioned in book and compiled with
> -Dprotobuf.version=2.5.0
>
> In classpath exits only 2.5.0 version
> root@hadoop-master:/usr/share/hbase/lib# hbase classpath | tr ":" "\n"
> | grep -i proto
> /usr/share/hbase/bin/../lib/protobuf-java-2.5.0.jar
>
> root@hadoop-master:/usr/share/hbase/lib#
>
> Any hint please?
>
>
> L.
>
>
>
>
>
>
> 2014-04-24 18:33 GMT+02:00 Ted Yu <yu...@gmail.com>:
>
>> Support for hadoop 3.0 is tracked by HBASE-6581
>>
>> FYI
>>
>>
>> On Thu, Apr 24, 2014 at 2:49 AM, Azuryy Yu <az...@gmail.com> wrote:
>>
>>> Hi Ted,
>>> Sorry I misunderstood something, I found these issues during built
>>> hbase-0.9* against hadoop trunk.
>>>
>>> we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0 is
>>> reasonabl currently.
>>>
>>>
>>>
>>> On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
>>>
>>>> Looking at branch-2 , we can
>>>> find
>> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
>>>>
>>>> Please refer to this commit:
>>>>
>>>> r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) | 1
>> line
>>>>
>>>> HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
>> Contributed
>>>> by Haohui Mai.
>>>>
>>>> bq. also some MapReduce issues
>>>>
>>>> Can you list what issues they're ?
>>>>
>>>> Thanks
>>>>
>>>> On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com> wrote:
>>>>
>>>>> This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
>>>> HttpServer
>>>>> was removed in the Hadoop2.4, but HBase InfoServer still use it, and
>>>> there
>>>>> are also some MapReduce issues, so if you build HBase-0.94 against
>>>>> Hadoop-2.4, it will fail.
>
>
>
> --
> Save The World - http://www.worldcommunitygrid.org/
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
>
> LesTR
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Lukáš Drbal <lu...@gmail.com>.
Hi Guys,
Ted thank you for -Dhadoop.version=2.2.0 it works.
Now i have master running on hadoop 2.2.0 but region server don't run.
Full log - https://gist.github.com/LesTR/57e2a8f2afe419b42405
2014-04-24 12:00:18,103 WARN
org.apache.hadoop.hbase.regionserver.HRegionServer: Exception in
region server :
java.lang.UnsupportedOperationException: This is supposed to be
overridden by subclasses.
at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
at org.apache.hadoop.hbase.protobuf.generated.HBaseProtos$RegionServerInfo.getSerializedSize(HBaseProtos.java:883)
at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
at org.apache.hadoop.hbase.regionserver.HRegionServer.createMyEphemeralNode(HRegionServer.java:1148)
at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1109)
at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:758)
at java.lang.Thread.run(Thread.java:745)
>From this exception i see a problem with protobufers libs. I change
version from 2.4.0a to 2.5.0 as is mentioned in book and compiled with
-Dprotobuf.version=2.5.0
In classpath exits only 2.5.0 version
root@hadoop-master:/usr/share/hbase/lib# hbase classpath | tr ":" "\n"
| grep -i proto
/usr/share/hbase/bin/../lib/protobuf-java-2.5.0.jar
root@hadoop-master:/usr/share/hbase/lib#
Any hint please?
L.
2014-04-24 18:33 GMT+02:00 Ted Yu <yu...@gmail.com>:
> Support for hadoop 3.0 is tracked by HBASE-6581
>
> FYI
>
>
> On Thu, Apr 24, 2014 at 2:49 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> > Hi Ted,
> > Sorry I misunderstood something, I found these issues during built
> > hbase-0.9* against hadoop trunk.
> >
> > we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0 is
> > reasonabl currently.
> >
> >
> >
> > On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Looking at branch-2 , we can
> > > find
> > >
> >
> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
> > >
> > > Please refer to this commit:
> > >
> > > r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) | 1
> line
> > >
> > > HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
> Contributed
> > > by Haohui Mai.
> > >
> > > bq. also some MapReduce issues
> > >
> > > Can you list what issues they're ?
> > >
> > > Thanks
> > >
> > > On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com> wrote:
> > >
> > > > This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
> > > HttpServer
> > > > was removed in the Hadoop2.4, but HBase InfoServer still use it, and
> > > there
> > > > are also some MapReduce issues, so if you build HBase-0.94 against
> > > > Hadoop-2.4, it will fail.
> > > >
> > > >
> > >
> >
>
--
Save The World - http://www.worldcommunitygrid.org/
http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
LesTR
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
Support for hadoop 3.0 is tracked by HBASE-6581
FYI
On Thu, Apr 24, 2014 at 2:49 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Ted,
> Sorry I misunderstood something, I found these issues during built
> hbase-0.9* against hadoop trunk.
>
> we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0 is
> reasonabl currently.
>
>
>
> On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > Looking at branch-2 , we can
> > find
> >
> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
> >
> > Please refer to this commit:
> >
> > r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) | 1 line
> >
> > HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2. Contributed
> > by Haohui Mai.
> >
> > bq. also some MapReduce issues
> >
> > Can you list what issues they're ?
> >
> > Thanks
> >
> > On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com> wrote:
> >
> > > This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
> > HttpServer
> > > was removed in the Hadoop2.4, but HBase InfoServer still use it, and
> > there
> > > are also some MapReduce issues, so if you build HBase-0.94 against
> > > Hadoop-2.4, it will fail.
> > >
> > >
> >
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Azuryy Yu <az...@gmail.com>.
Hi Ted,
Sorry I misunderstood something, I found these issues during built
hbase-0.9* against hadoop trunk.
we can consider trunk as Hadoop-3.0, so hbase doesn't support 3.0 is
reasonabl currently.
On Thu, Apr 24, 2014 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
> Looking at branch-2 , we can
> find
> hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
>
> Please refer to this commit:
>
> r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) | 1 line
>
> HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2. Contributed
> by Haohui Mai.
>
> bq. also some MapReduce issues
>
> Can you list what issues they're ?
>
> Thanks
>
> On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com> wrote:
>
> > This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4,
> HttpServer
> > was removed in the Hadoop2.4, but HBase InfoServer still use it, and
> there
> > are also some MapReduce issues, so if you build HBase-0.94 against
> > Hadoop-2.4, it will fail.
> >
> >
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
Looking at branch-2 , we can
find hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer.java
Please refer to this commit:
r1561967 | suresh | 2014-01-27 23:50:54 -0800 (Mon, 27 Jan 2014) | 1 line
HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2. Contributed
by Haohui Mai.
bq. also some MapReduce issues
Can you list what issues they're ?
Thanks
On Wed, Apr 23, 2014 at 6:56 PM, Azuryy Yu <az...@gmail.com> wrote:
> This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4, HttpServer
> was removed in the Hadoop2.4, but HBase InfoServer still use it, and there
> are also some MapReduce issues, so if you build HBase-0.94 against
> Hadoop-2.4, it will fail.
>
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Azuryy Yu <az...@gmail.com>.
This is a serious issue, HBase-0.94 doesn't support Hadoop-2.4, HttpServer
was removed in the Hadoop2.4, but HBase InfoServer still use it, and there
are also some MapReduce issues, so if you build HBase-0.94 against
Hadoop-2.4, it will fail.
On Thu, Apr 24, 2014 at 4:31 AM, Ted Yu <yu...@gmail.com> wrote:
> There seems to be typo in your command line.
> To compile against hadoop 2.2 , you should use :
>
> mvn clean -DskipTests -Dhadoop.profile=2.0 -Dhadoop.version=2.2.0 <rest of
> command line>
>
>
> On Wed, Apr 23, 2014 at 12:15 PM, Lukáš Drbal <lu...@gmail.com>
> wrote:
>
> > Hi,
> >
> > iam trying run HBase on hadoop 2.2 but master can't start.
> >
> > I found a message in master log (snipped):
> >
> > 2014-04-23 20:58:24,246 FATAL org.apache.hadoop.hbase.master.HMaster:
> HBase
> > is having a problem with its Hadoop jars. You may need to recompile
> HBase
> > against Hadoop version 2.2.0 or change your hadoop jars to start properly
> > java.lang.NoClassDefFoundError:
> > org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
> > at
> > org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:240)
> > at
> > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:634)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:423)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:148)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:133)
> > at
> >
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:573)
> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:433)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > ... 8 more
> > 2014-04-23 20:58:24,248 INFO org.apache.hadoop.hbase.master.HMaster:
> > Aborting
> > 2014-04-23 20:58:24,248 DEBUG org.apache.hadoop.hbase.master.HMaster:
> > Stopping service threads
> >
> >
> > I take actual 0.94 branch from git and run mvn clean install
> > assembly:single -Dhadoop.profile=2.2 -DskipTests
> >
> > Here is my modifications in pom.xml
> > https://gist.github.com/LesTR/56d7d6ddbeb184460251
> >
> > Local hadoop run fine and HBase has jars with right version
> >
> > root@hadoop-master:/usr/share/hbase/lib# ls -l hadoop*
> > -rw-r--r-- 1 lestr lestr 16778 Apr 23 20:10
> hadoop-annotations-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 49750 Apr 23 20:10 hadoop-auth-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 2735584 Apr 23 20:10 hadoop-common-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 1352859 Apr 23 20:10
> hadoop-common-2.2.0-tests.jar
> > -rw-r--r-- 1 lestr lestr 5242252 Apr 23 20:10 hadoop-hdfs-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 1988460 Apr 23 20:10 hadoop-hdfs-2.2.0-tests.jar
> > -rw-r--r-- 1 lestr lestr 482042 Apr 23 20:10
> > hadoop-mapreduce-client-app-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 656365 Apr 23 20:10
> > hadoop-mapreduce-client-common-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 1455001 Apr 23 20:10
> > hadoop-mapreduce-client-core-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 117184 Apr 23 20:10
> > hadoop-mapreduce-client-hs-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 35216 Apr 23 20:10
> > hadoop-mapreduce-client-jobclient-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 1434852 Apr 23 20:10
> > hadoop-mapreduce-client-jobclient-2.2.0-tests.jar
> > -rw-r--r-- 1 lestr lestr 21537 Apr 23 20:10
> > hadoop-mapreduce-client-shuffle-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 2076 Apr 23 20:10
> hadoop-minicluster-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 1158936 Apr 23 20:10 hadoop-yarn-api-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 94728 Apr 23 20:10
> hadoop-yarn-client-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 1301627 Apr 23 20:10
> hadoop-yarn-common-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 175554 Apr 23 20:10
> > hadoop-yarn-server-common-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 467638 Apr 23 20:10
> > hadoop-yarn-server-nodemanager-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 615387 Apr 23 20:10
> > hadoop-yarn-server-resourcemanager-2.2.0.jar
> > -rw-r--r-- 1 lestr lestr 35347 Apr 23 20:10
> > hadoop-yarn-server-tests-2.2.0-tests.jar
> > -rw-r--r-- 1 lestr lestr 25710 Apr 23 20:10
> > hadoop-yarn-server-web-proxy-2.2.0.jar
> > root@hadoop-master:/usr/share/hbase/lib#
> >
> > Same situation on hadoop 2.4.
> >
> > I found only org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction
> > class in hadoop 2.{2,4}
> >
> > Any advice please?
> >
> > --
> > Save The World - http://www.worldcommunitygrid.org/
> > http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
> >
> > LesTR
> >
>
Re: HBase 0.94 on hadoop 2.2.0 (2.4.0)
Posted by Ted Yu <yu...@gmail.com>.
There seems to be typo in your command line.
To compile against hadoop 2.2 , you should use :
mvn clean -DskipTests -Dhadoop.profile=2.0 -Dhadoop.version=2.2.0 <rest of
command line>
On Wed, Apr 23, 2014 at 12:15 PM, Lukáš Drbal <lu...@gmail.com> wrote:
> Hi,
>
> iam trying run HBase on hadoop 2.2 but master can't start.
>
> I found a message in master log (snipped):
>
> 2014-04-23 20:58:24,246 FATAL org.apache.hadoop.hbase.master.HMaster: HBase
> is having a problem with its Hadoop jars. You may need to recompile HBase
> against Hadoop version 2.2.0 or change your hadoop jars to start properly
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
> at
> org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:240)
> at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:634)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:423)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:148)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:133)
> at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:573)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:433)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 8 more
> 2014-04-23 20:58:24,248 INFO org.apache.hadoop.hbase.master.HMaster:
> Aborting
> 2014-04-23 20:58:24,248 DEBUG org.apache.hadoop.hbase.master.HMaster:
> Stopping service threads
>
>
> I take actual 0.94 branch from git and run mvn clean install
> assembly:single -Dhadoop.profile=2.2 -DskipTests
>
> Here is my modifications in pom.xml
> https://gist.github.com/LesTR/56d7d6ddbeb184460251
>
> Local hadoop run fine and HBase has jars with right version
>
> root@hadoop-master:/usr/share/hbase/lib# ls -l hadoop*
> -rw-r--r-- 1 lestr lestr 16778 Apr 23 20:10 hadoop-annotations-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 49750 Apr 23 20:10 hadoop-auth-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 2735584 Apr 23 20:10 hadoop-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1352859 Apr 23 20:10 hadoop-common-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 5242252 Apr 23 20:10 hadoop-hdfs-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1988460 Apr 23 20:10 hadoop-hdfs-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 482042 Apr 23 20:10
> hadoop-mapreduce-client-app-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 656365 Apr 23 20:10
> hadoop-mapreduce-client-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1455001 Apr 23 20:10
> hadoop-mapreduce-client-core-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 117184 Apr 23 20:10
> hadoop-mapreduce-client-hs-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 35216 Apr 23 20:10
> hadoop-mapreduce-client-jobclient-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1434852 Apr 23 20:10
> hadoop-mapreduce-client-jobclient-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 21537 Apr 23 20:10
> hadoop-mapreduce-client-shuffle-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 2076 Apr 23 20:10 hadoop-minicluster-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1158936 Apr 23 20:10 hadoop-yarn-api-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 94728 Apr 23 20:10 hadoop-yarn-client-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 1301627 Apr 23 20:10 hadoop-yarn-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 175554 Apr 23 20:10
> hadoop-yarn-server-common-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 467638 Apr 23 20:10
> hadoop-yarn-server-nodemanager-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 615387 Apr 23 20:10
> hadoop-yarn-server-resourcemanager-2.2.0.jar
> -rw-r--r-- 1 lestr lestr 35347 Apr 23 20:10
> hadoop-yarn-server-tests-2.2.0-tests.jar
> -rw-r--r-- 1 lestr lestr 25710 Apr 23 20:10
> hadoop-yarn-server-web-proxy-2.2.0.jar
> root@hadoop-master:/usr/share/hbase/lib#
>
> Same situation on hadoop 2.4.
>
> I found only org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction
> class in hadoop 2.{2,4}
>
> Any advice please?
>
> --
> Save The World - http://www.worldcommunitygrid.org/
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
>
> LesTR
>