You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by tsuna <ts...@gmail.com> on 2013/10/29 00:19:07 UTC
0.96 and Hadoop 2.1.1
Hi there,
I have a cluster running vanilla Hadoop 2.1.1 and am trying to deploy
HBase 0.96 on top. At first the master was crapping out with this
when I was trying to start it:
2013-10-28 16:11:32,778 FATAL [master:r12s1:9102] master.HMaster:
Unhandled exception. Starting shutdown.
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RpcServerException):
Unknown out of band call #-2147483647
at org.apache.hadoop.ipc.Client.call(Client.java:1347)
at org.apache.hadoop.ipc.Client.call(Client.java:1300)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
at $Proxy12.setSafeMode(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:188)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at $Proxy12.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:561)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2124)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:994)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:978)
at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:433)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:852)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:435)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:786)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
at java.lang.Thread.run(Thread.java:636)
2013-10-28 16:11:32,781 INFO [master:r12s1:9102] master.HMaster: Aborting
Earlier posts on the ML suggest copying the hadoop-hdfs and
hadoop-common jars from the Hadoop distro, so I did that and replaced
the hadoop-hdfs-2.1.0-beta.jar and hadoop-common-2.1.0-beta.jar that
came with 0.96 under the lib/ directory with the corresponding 2.1.1
jars. The master is now failing to start with this:
2013-10-28 16:18:22,293 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class
org.apache.hadoop.hbase.master.HMaster
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2773)
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:184)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:134)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2787)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserGroupInformation.java:302)
at org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:347)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.hbase.util.Methods.call(Methods.java:39)
at org.apache.hadoop.hbase.security.User.call(User.java:414)
at org.apache.hadoop.hbase.security.User.callStatic(User.java:404)
at org.apache.hadoop.hbase.security.User.access$200(User.java:48)
at org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(User.java:392)
at org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:363)
at org.apache.hadoop.hbase.security.User.login(User.java:187)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:452)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2768)
... 5 more
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by tsuna <ts...@gmail.com>.
OK, whatever, I copied the missing .class file from 2.1.0 into the 2.1.1 jar
~/hbase/lib @r12s1.cs1> unzip hadoop-common-2.1.0-beta.jar~
org/apache/hadoop/util/PlatformName.class
Archive: hadoop-common-2.1.0-beta.jar~
inflating: org/apache/hadoop/util/PlatformName.class
~/hbase/lib @r12s1.cs1> zip hadoop-common-2.1.0-beta.jar
org/apache/hadoop/util/PlatformName.class
adding: org/apache/hadoop/util/PlatformName.class (deflated 50%)
The master came up fine now.
Anybody knows why PlatformName.class isn't in the 2.1.1 jar? I
realize this may be more of a question for the HDFS user list…
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by tsuna <ts...@gmail.com>.
On Mon, Oct 28, 2013 at 4:51 PM, Ted Yu <yu...@gmail.com> wrote:
> The files from
> http://www.us.apache.org/dist/hadoop/common/hadoop-2.1.1-beta/ were dated
> Sept 17th.
>
> Arun announced the passing of 2.1.1 RC on the 24th.
Interesting, so the Apache mirrors don't have a correct copy of the
2.1.1 release?
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by Ted Yu <yu...@gmail.com>.
The files from
http://www.us.apache.org/dist/hadoop/common/hadoop-2.1.1-beta/ were dated
Sept 17th.
Arun announced the passing of 2.1.1 RC on the 24th.
FYI
On Mon, Oct 28, 2013 at 4:45 PM, tsuna <ts...@gmail.com> wrote:
> On Mon, Oct 28, 2013 at 4:41 PM, Ted Yu <yu...@gmail.com> wrote:
> > After downloading from
> >
> http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-auth/2.1.1-beta
> ,
> > I could see:
> >
> > $ jar tvf hadoop-auth-2.1.1-beta.jar | grep PlatformName
> > 1862 Tue Sep 17 05:47:36 PDT 2013
> > org/apache/hadoop/util/PlatformName.class
>
> Weird:
>
> wget
> http://www.us.apache.org/dist/hadoop/common/hadoop-2.1.1-beta/hadoop-2.1.1-beta.tar.gz
> tar xfz hadoop-2.1.1-beta.tar.gz
> unzip -l hadoop-2.1.1-beta/share/hadoop/common/hadoop-common-2.1.1-beta.jar
> | fgrep PlatformName
> <nothing>
>
> Looks like they may have botched the release?
>
> --
> Benoit "tsuna" Sigoure
>
Re: 0.96 and Hadoop 2.1.1
Posted by tsuna <ts...@gmail.com>.
On Mon, Oct 28, 2013 at 4:41 PM, Ted Yu <yu...@gmail.com> wrote:
> After downloading from
> http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-auth/2.1.1-beta,
> I could see:
>
> $ jar tvf hadoop-auth-2.1.1-beta.jar | grep PlatformName
> 1862 Tue Sep 17 05:47:36 PDT 2013
> org/apache/hadoop/util/PlatformName.class
Weird:
wget http://www.us.apache.org/dist/hadoop/common/hadoop-2.1.1-beta/hadoop-2.1.1-beta.tar.gz
tar xfz hadoop-2.1.1-beta.tar.gz
unzip -l hadoop-2.1.1-beta/share/hadoop/common/hadoop-common-2.1.1-beta.jar
| fgrep PlatformName
<nothing>
Looks like they may have botched the release?
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by Ted Yu <yu...@gmail.com>.
After downloading from
http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-auth/2.1.1-beta,
I could see:
$ jar tvf hadoop-auth-2.1.1-beta.jar | grep PlatformName
1862 Tue Sep 17 05:47:36 PDT 2013
org/apache/hadoop/util/PlatformName.class
On Mon, Oct 28, 2013 at 4:28 PM, tsuna <ts...@gmail.com> wrote:
> On Mon, Oct 28, 2013 at 4:26 PM, Ted Yu <yu...@gmail.com> wrote:
> > See this thread:
>
> Yes, I've seen this thread (that's the one I referred to in my first
> post). Why would it not work with 2.1.1?
>
> --
> Benoit "tsuna" Sigoure
>
Re: 0.96 and Hadoop 2.1.1
Posted by tsuna <ts...@gmail.com>.
On Mon, Oct 28, 2013 at 4:26 PM, Ted Yu <yu...@gmail.com> wrote:
> See this thread:
Yes, I've seen this thread (that's the one I referred to in my first
post). Why would it not work with 2.1.1?
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by Ted Yu <yu...@gmail.com>.
See this thread:
http://search-hadoop.com/m/0Pnu41YGCIi/hbase+tianying+0.96&subj=RE+Hbase+0+96+and+Hadoop+2+2
On Mon, Oct 28, 2013 at 4:24 PM, tsuna <ts...@gmail.com> wrote:
> On Mon, Oct 28, 2013 at 4:22 PM, Ted Yu <yu...@gmail.com> wrote:
> > Please deploy hadoop 2.2
>
> So 2.1.1 is not compatible with 2.1.0? Looks like that class isn't in the
> jar
>
> ~/hbase/lib @r12s1.cs1> unzip -l hadoop-common-2.1.0-beta.jar | grep
> org.apache.hadoop.util.PlatformName
> ~/hbase/lib @r12s1.cs1> unzip -l hadoop-common-2.1.0-beta.jar~ | grep
> org.apache.hadoop.util.PlatformName
> 1707 08-15-2013 20:44 org/apache/hadoop/util/PlatformName.class
>
> WTF.
>
> --
> Benoit "tsuna" Sigoure
>
Re: 0.96 and Hadoop 2.1.1
Posted by tsuna <ts...@gmail.com>.
On Mon, Oct 28, 2013 at 4:22 PM, Ted Yu <yu...@gmail.com> wrote:
> Please deploy hadoop 2.2
So 2.1.1 is not compatible with 2.1.0? Looks like that class isn't in the jar
~/hbase/lib @r12s1.cs1> unzip -l hadoop-common-2.1.0-beta.jar | grep
org.apache.hadoop.util.PlatformName
~/hbase/lib @r12s1.cs1> unzip -l hadoop-common-2.1.0-beta.jar~ | grep
org.apache.hadoop.util.PlatformName
1707 08-15-2013 20:44 org/apache/hadoop/util/PlatformName.class
WTF.
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by Ted Yu <yu...@gmail.com>.
Please deploy hadoop 2.2
Cheers
On Mon, Oct 28, 2013 at 4:19 PM, tsuna <ts...@gmail.com> wrote:
> Hi there,
> I have a cluster running vanilla Hadoop 2.1.1 and am trying to deploy
> HBase 0.96 on top. At first the master was crapping out with this
> when I was trying to start it:
>
> 2013-10-28 16:11:32,778 FATAL [master:r12s1:9102] master.HMaster:
> Unhandled exception. Starting shutdown.
>
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RpcServerException):
> Unknown out of band call #-2147483647
> at org.apache.hadoop.ipc.Client.call(Client.java:1347)
> at org.apache.hadoop.ipc.Client.call(Client.java:1300)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
> at $Proxy12.setSafeMode(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:188)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
> at $Proxy12.setSafeMode(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:561)
> at
> org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2124)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:994)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:978)
> at
> org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:433)
> at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:852)
> at
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:435)
> at
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146)
> at
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:127)
> at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:786)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> at java.lang.Thread.run(Thread.java:636)
> 2013-10-28 16:11:32,781 INFO [master:r12s1:9102] master.HMaster: Aborting
>
>
> Earlier posts on the ML suggest copying the hadoop-hdfs and
> hadoop-common jars from the Hadoop distro, so I did that and replaced
> the hadoop-hdfs-2.1.0-beta.jar and hadoop-common-2.1.0-beta.jar that
> came with 0.96 under the lib/ directory with the corresponding 2.1.1
> jars. The master is now failing to start with this:
>
> 2013-10-28 16:18:22,293 ERROR [main] master.HMasterCommandLine: Master
> exiting
> java.lang.RuntimeException: Failed construction of Master: class
> org.apache.hadoop.hbase.master.HMaster
> at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2773)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:184)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:134)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2787)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.util.PlatformName
> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> at
> org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserGroupInformation.java:302)
> at
> org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:347)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.hbase.util.Methods.call(Methods.java:39)
> at org.apache.hadoop.hbase.security.User.call(User.java:414)
> at org.apache.hadoop.hbase.security.User.callStatic(User.java:404)
> at org.apache.hadoop.hbase.security.User.access$200(User.java:48)
> at
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(User.java:392)
> at
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:363)
> at org.apache.hadoop.hbase.security.User.login(User.java:187)
> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:452)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
> at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2768)
> ... 5 more
>
> --
> Benoit "tsuna" Sigoure
>
Re: 0.96 and Hadoop 2.1.1
Posted by tsuna <ts...@gmail.com>.
Thanks for tracking this down Cosmin, I left a note in
https://issues.apache.org/jira/browse/HADOOP-9944 (took me a while to
edit my comment to remove as many expletives as possible).
On Thu, Oct 31, 2013 at 2:16 AM, Cosmin Lehene <cl...@adobe.com> wrote:
> Benoit,
>
> This (Unknown out of band call #-2147483647) hints that something ³else²
> is being parsed.
>
> CallId has been changed from uint32 to sint32
>
> f9cc07986d797d4d0731d8774e7a1f4bcf3a1738
>
>
>
> Merge -c 1523885 from trunk to branch-2 to fix HADOOP-9944. Fix
> RpcRequestHeaderProto.callId to be sint32 rather than uint32 since
> ipc.Client.CONNECTION_CONTEXT_CALL_ID is signed (i.e. -3). Contributed
> by
> Arun C. Murthy.
>
> git-svn-id:
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.1-beta@152
> 3887
> 13f79535-47bb-0310-9956-ffa450edef68
>
>
> Cosmin
>
>
> On 29/10/13 01:19, "tsuna" <ts...@gmail.com> wrote:
>
>>Hi there,
>>I have a cluster running vanilla Hadoop 2.1.1 and am trying to deploy
>>HBase 0.96 on top. At first the master was crapping out with this
>>when I was trying to start it:
>>
>>2013-10-28 16:11:32,778 FATAL [master:r12s1:9102] master.HMaster:
>>Unhandled exception. Starting shutdown.
>>org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RpcServerExcep
>>tion):
>>Unknown out of band call #-2147483647
>> at org.apache.hadoop.ipc.Client.call(Client.java:1347)
>> at org.apache.hadoop.ipc.Client.call(Client.java:1300)
>> at
>>org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.j
>>ava:206)
>> at $Proxy12.setSafeMode(Unknown Source)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
>>57)
>> at
>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
>>pl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:616)
>> at
>>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvoca
>>tionHandler.java:188)
>> at
>>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHa
>>ndler.java:102)
>> at $Proxy12.setSafeMode(Unknown Source)
>> at
>>org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSa
>>feMode(ClientNamenodeProtocolTranslatorPB.java:561)
>> at
>>org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2124)
>> at
>>org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSy
>>stem.java:994)
>> at
>>org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSy
>>stem.java:978)
>> at
>>org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:433)
>> at
>>org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:852)
>> at
>>org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSys
>>tem.java:435)
>> at
>>org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLay
>>out(MasterFileSystem.java:146)
>> at
>>org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.ja
>>va:127)
>> at
>>org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:7
>>86)
>> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
>> at java.lang.Thread.run(Thread.java:636)
>>2013-10-28 16:11:32,781 INFO [master:r12s1:9102] master.HMaster: Aborting
>>
>>
>>Earlier posts on the ML suggest copying the hadoop-hdfs and
>>hadoop-common jars from the Hadoop distro, so I did that and replaced
>>the hadoop-hdfs-2.1.0-beta.jar and hadoop-common-2.1.0-beta.jar that
>>came with 0.96 under the lib/ directory with the corresponding 2.1.1
>>jars. The master is now failing to start with this:
>>
>>2013-10-28 16:18:22,293 ERROR [main] master.HMasterCommandLine: Master
>>exiting
>>java.lang.RuntimeException: Failed construction of Master: class
>>org.apache.hadoop.hbase.master.HMaster
>> at
>>org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2773)
>> at
>>org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterComma
>>ndLine.java:184)
>> at
>>org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.j
>>ava:134)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>>org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.ja
>>va:126)
>> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2787)
>>Caused by: java.lang.ClassNotFoundException:
>>org.apache.hadoop.util.PlatformName
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>> at
>>org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserG
>>roupInformation.java:302)
>> at
>>org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformat
>>ion.java:347)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
>>57)
>> at
>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
>>pl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:616)
>> at org.apache.hadoop.hbase.util.Methods.call(Methods.java:39)
>> at org.apache.hadoop.hbase.security.User.call(User.java:414)
>> at org.apache.hadoop.hbase.security.User.callStatic(User.java:404)
>> at org.apache.hadoop.hbase.security.User.access$200(User.java:48)
>> at
>>org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(U
>>ser.java:392)
>> at
>>org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:363
>>)
>> at org.apache.hadoop.hbase.security.User.login(User.java:187)
>> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:452)
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>Method)
>> at
>>sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcc
>>essorImpl.java:57)
>> at
>>sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstr
>>uctorAccessorImpl.java:45)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>> at
>>org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2768)
>> ... 5 more
>>
>>--
>>Benoit "tsuna" Sigoure
>
--
Benoit "tsuna" Sigoure
Re: 0.96 and Hadoop 2.1.1
Posted by Cosmin Lehene <cl...@adobe.com>.
Benoit,
This (Unknown out of band call #-2147483647) hints that something ³else²
is being parsed.
CallId has been changed from uint32 to sint32
f9cc07986d797d4d0731d8774e7a1f4bcf3a1738
Merge -c 1523885 from trunk to branch-2 to fix HADOOP-9944. Fix
RpcRequestHeaderProto.callId to be sint32 rather than uint32 since
ipc.Client.CONNECTION_CONTEXT_CALL_ID is signed (i.e. -3). Contributed
by
Arun C. Murthy.
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.1-beta@152
3887
13f79535-47bb-0310-9956-ffa450edef68
Cosmin
On 29/10/13 01:19, "tsuna" <ts...@gmail.com> wrote:
>Hi there,
>I have a cluster running vanilla Hadoop 2.1.1 and am trying to deploy
>HBase 0.96 on top. At first the master was crapping out with this
>when I was trying to start it:
>
>2013-10-28 16:11:32,778 FATAL [master:r12s1:9102] master.HMaster:
>Unhandled exception. Starting shutdown.
>org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RpcServerExcep
>tion):
>Unknown out of band call #-2147483647
> at org.apache.hadoop.ipc.Client.call(Client.java:1347)
> at org.apache.hadoop.ipc.Client.call(Client.java:1300)
> at
>org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.j
>ava:206)
> at $Proxy12.setSafeMode(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
>57)
> at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
>pl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvoca
>tionHandler.java:188)
> at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHa
>ndler.java:102)
> at $Proxy12.setSafeMode(Unknown Source)
> at
>org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSa
>feMode(ClientNamenodeProtocolTranslatorPB.java:561)
> at
>org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2124)
> at
>org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSy
>stem.java:994)
> at
>org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSy
>stem.java:978)
> at
>org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:433)
> at
>org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:852)
> at
>org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSys
>tem.java:435)
> at
>org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLay
>out(MasterFileSystem.java:146)
> at
>org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.ja
>va:127)
> at
>org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:7
>86)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
> at java.lang.Thread.run(Thread.java:636)
>2013-10-28 16:11:32,781 INFO [master:r12s1:9102] master.HMaster: Aborting
>
>
>Earlier posts on the ML suggest copying the hadoop-hdfs and
>hadoop-common jars from the Hadoop distro, so I did that and replaced
>the hadoop-hdfs-2.1.0-beta.jar and hadoop-common-2.1.0-beta.jar that
>came with 0.96 under the lib/ directory with the corresponding 2.1.1
>jars. The master is now failing to start with this:
>
>2013-10-28 16:18:22,293 ERROR [main] master.HMasterCommandLine: Master
>exiting
>java.lang.RuntimeException: Failed construction of Master: class
>org.apache.hadoop.hbase.master.HMaster
> at
>org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2773)
> at
>org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterComma
>ndLine.java:184)
> at
>org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.j
>ava:134)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
>org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.ja
>va:126)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2787)
>Caused by: java.lang.ClassNotFoundException:
>org.apache.hadoop.util.PlatformName
> at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> at
>org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserG
>roupInformation.java:302)
> at
>org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformat
>ion.java:347)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
>57)
> at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
>pl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.hbase.util.Methods.call(Methods.java:39)
> at org.apache.hadoop.hbase.security.User.call(User.java:414)
> at org.apache.hadoop.hbase.security.User.callStatic(User.java:404)
> at org.apache.hadoop.hbase.security.User.access$200(User.java:48)
> at
>org.apache.hadoop.hbase.security.User$SecureHadoopUser.isSecurityEnabled(U
>ser.java:392)
> at
>org.apache.hadoop.hbase.security.User$SecureHadoopUser.login(User.java:363
>)
> at org.apache.hadoop.hbase.security.User.login(User.java:187)
> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:452)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>Method)
> at
>sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcc
>essorImpl.java:57)
> at
>sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstr
>uctorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
> at
>org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2768)
> ... 5 more
>
>--
>Benoit "tsuna" Sigoure