You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jamie Cockrill <ja...@gmail.com> on 2010/07/06 13:19:22 UTC
Problem starting HBase Master for the first time, EOFException
Dear hbase-users,
I was wondering if you might be able to help. I am trying to setup
HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
Karmic CDH3 distribution. Zookeeper has installed fine, however when
it comes to starting an hbase master, it falls over with the following
exception:
(stack trace summarised to last bit)
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
Its clearly connecting to the HDFS, but it's giving it a strange
response. The section above of the trace identifies the hostname that
I've specified in the hbase.rootdir property in the hbase-site.xml and
also the IP address, which it must have looked up in DNS. For
information, that is set to:
hdfs://master:50071/hbase.
Also, as i'm just evaluating it at this stage, I'm installing
Zookeeper and hbase-master on the same machine as the namenode
(master). The regionservers will go somewhere else when I get to that
stage.
My hbase-site.xml was blank (between the configuration tags) and the
only things I've added so far are:
hbase.cluster.distributed="true"
hbase.rootdir="hdfs://master:50071/hbase"
hbase.zookeeper.quorum="master"
obviously in the <name><value> format of the XML file, without the quotes.
I'm at a bit of a loss as to what is going on. I've tried a wget to
the namenode dfshealth.asp page and that works fine (obviously thats
http:// rather than hdfs://). Any pointers on where to look?
Many thanks,
Jamie
I ran a wget to
Re: Problem starting HBase Master for the first time, EOFException
Posted by Jamie Cockrill <ja...@gmail.com>.
Hi Jeff,
Apologies for the slow reply, I must've missed the e-mail in the midst
of all the others. I've not created one for hbase before, so apologies
if I broke any conventions. I filed it under the ipc component as
ipc.Client was the last hbase related class in the stack trace before
it went off into the java.io wilderness. I've not set an affects
version as it's in the 0.89 branch and none of those versions appeared
in the list and i've only marked it as a minor improvement as it's
hardly a show-stopper and this thread is now appearing in google
search results so should be easy to find.
It's this one: https://issues.apache.org/jira/browse/HBASE-2826
Thanks,
Jamie
On 8 July 2010 01:24, Jeff Hammerbacher <ha...@cloudera.com> wrote:
> Hey James,
>
> Can you file a JIRA with information about the unhelpful exception message?
> I'm on a mission to hunt down common errors with unhelpful exceptions, and
> you seem to have discovered one.
>
> Thanks,
> Jeff
>
> On Tue, Jul 6, 2010 at 5:39 AM, Jamie Cockrill <ja...@gmail.com>wrote:
>
>> Dear hbase-users,
>>
>> Further to this, I've been doing a lot of kicking around with the
>> config and learned the following:
>>
>> - You get the same error if a process is listening on that port, that
>> is not a HDFS namenode;
>> - Although my web front-end for my namenode is on port 50071, it seems
>> the namenode itself (i.e. anything that wants hdfs://) is listening on
>> 50070.
>>
>> Having changed my hbase-site.xml to point to 50070 it now seems to
>> have started working. Apologies if anyone has wasted any time looking
>> at it. This begs the question, why is my namenode web server on a
>> different port, but I'll get to that another time.
>>
>> Many thanks,
>>
>> James
>>
>>
>> On 6 July 2010 12:19, Jamie Cockrill <ja...@gmail.com> wrote:
>> > Dear hbase-users,
>> >
>> > I was wondering if you might be able to help. I am trying to setup
>> > HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
>> > Karmic CDH3 distribution. Zookeeper has installed fine, however when
>> > it comes to starting an hbase master, it falls over with the following
>> > exception:
>> >
>> > (stack trace summarised to last bit)
>> > Caused by: java.io.EOFException
>> > at java.io.DataInputStream.readInt(DataInputStream.java:375)
>> > at
>> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
>> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>> >
>> > Its clearly connecting to the HDFS, but it's giving it a strange
>> > response. The section above of the trace identifies the hostname that
>> > I've specified in the hbase.rootdir property in the hbase-site.xml and
>> > also the IP address, which it must have looked up in DNS. For
>> > information, that is set to:
>> > hdfs://master:50071/hbase.
>> >
>> > Also, as i'm just evaluating it at this stage, I'm installing
>> > Zookeeper and hbase-master on the same machine as the namenode
>> > (master). The regionservers will go somewhere else when I get to that
>> > stage.
>> >
>> > My hbase-site.xml was blank (between the configuration tags) and the
>> > only things I've added so far are:
>> >
>> > hbase.cluster.distributed="true"
>> > hbase.rootdir="hdfs://master:50071/hbase"
>> > hbase.zookeeper.quorum="master"
>> >
>> > obviously in the <name><value> format of the XML file, without the
>> quotes.
>> >
>> > I'm at a bit of a loss as to what is going on. I've tried a wget to
>> > the namenode dfshealth.asp page and that works fine (obviously thats
>> > http:// rather than hdfs://). Any pointers on where to look?
>> >
>> > Many thanks,
>> >
>> > Jamie
>> >
>> > I ran a wget to
>> >
>>
>
Re: Problem starting HBase Master for the first time, EOFException
Posted by Jeff Hammerbacher <ha...@cloudera.com>.
Hey James,
Can you file a JIRA with information about the unhelpful exception message?
I'm on a mission to hunt down common errors with unhelpful exceptions, and
you seem to have discovered one.
Thanks,
Jeff
On Tue, Jul 6, 2010 at 5:39 AM, Jamie Cockrill <ja...@gmail.com>wrote:
> Dear hbase-users,
>
> Further to this, I've been doing a lot of kicking around with the
> config and learned the following:
>
> - You get the same error if a process is listening on that port, that
> is not a HDFS namenode;
> - Although my web front-end for my namenode is on port 50071, it seems
> the namenode itself (i.e. anything that wants hdfs://) is listening on
> 50070.
>
> Having changed my hbase-site.xml to point to 50070 it now seems to
> have started working. Apologies if anyone has wasted any time looking
> at it. This begs the question, why is my namenode web server on a
> different port, but I'll get to that another time.
>
> Many thanks,
>
> James
>
>
> On 6 July 2010 12:19, Jamie Cockrill <ja...@gmail.com> wrote:
> > Dear hbase-users,
> >
> > I was wondering if you might be able to help. I am trying to setup
> > HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
> > Karmic CDH3 distribution. Zookeeper has installed fine, however when
> > it comes to starting an hbase master, it falls over with the following
> > exception:
> >
> > (stack trace summarised to last bit)
> > Caused by: java.io.EOFException
> > at java.io.DataInputStream.readInt(DataInputStream.java:375)
> > at
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> >
> > Its clearly connecting to the HDFS, but it's giving it a strange
> > response. The section above of the trace identifies the hostname that
> > I've specified in the hbase.rootdir property in the hbase-site.xml and
> > also the IP address, which it must have looked up in DNS. For
> > information, that is set to:
> > hdfs://master:50071/hbase.
> >
> > Also, as i'm just evaluating it at this stage, I'm installing
> > Zookeeper and hbase-master on the same machine as the namenode
> > (master). The regionservers will go somewhere else when I get to that
> > stage.
> >
> > My hbase-site.xml was blank (between the configuration tags) and the
> > only things I've added so far are:
> >
> > hbase.cluster.distributed="true"
> > hbase.rootdir="hdfs://master:50071/hbase"
> > hbase.zookeeper.quorum="master"
> >
> > obviously in the <name><value> format of the XML file, without the
> quotes.
> >
> > I'm at a bit of a loss as to what is going on. I've tried a wget to
> > the namenode dfshealth.asp page and that works fine (obviously thats
> > http:// rather than hdfs://). Any pointers on where to look?
> >
> > Many thanks,
> >
> > Jamie
> >
> > I ran a wget to
> >
>
RE: Problem starting HBase Master for the first time, EOFException
Posted by Michael Segel <mi...@hotmail.com>.
Jamie... to answer your question...
If you change your configuration on the name node, you need to make sure that your data nodes also know about this. (Assuming you're putting a region server on each data node.)
If you don't add a configuration parameter in the hbase-site.xml, it goes to the default value in defaults xml file.
You have to remember that the web service is one that reports on the status and is not the TCP/IP port used for communication between nodes.
HTH
-Mike
> From: jamie.cockrill@gmail.com
> Date: Tue, 6 Jul 2010 13:39:31 +0100
> Subject: Re: Problem starting HBase Master for the first time, EOFException
> To: user@hbase.apache.org
>
> Dear hbase-users,
>
> Further to this, I've been doing a lot of kicking around with the
> config and learned the following:
>
> - You get the same error if a process is listening on that port, that
> is not a HDFS namenode;
> - Although my web front-end for my namenode is on port 50071, it seems
> the namenode itself (i.e. anything that wants hdfs://) is listening on
> 50070.
>
> Having changed my hbase-site.xml to point to 50070 it now seems to
> have started working. Apologies if anyone has wasted any time looking
> at it. This begs the question, why is my namenode web server on a
> different port, but I'll get to that another time.
>
> Many thanks,
>
> James
>
>
> On 6 July 2010 12:19, Jamie Cockrill <ja...@gmail.com> wrote:
> > Dear hbase-users,
> >
> > I was wondering if you might be able to help. I am trying to setup
> > HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
> > Karmic CDH3 distribution. Zookeeper has installed fine, however when
> > it comes to starting an hbase master, it falls over with the following
> > exception:
> >
> > (stack trace summarised to last bit)
> > Caused by: java.io.EOFException
> > at java.io.DataInputStream.readInt(DataInputStream.java:375)
> > at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> >
> > Its clearly connecting to the HDFS, but it's giving it a strange
> > response. The section above of the trace identifies the hostname that
> > I've specified in the hbase.rootdir property in the hbase-site.xml and
> > also the IP address, which it must have looked up in DNS. For
> > information, that is set to:
> > hdfs://master:50071/hbase.
> >
> > Also, as i'm just evaluating it at this stage, I'm installing
> > Zookeeper and hbase-master on the same machine as the namenode
> > (master). The regionservers will go somewhere else when I get to that
> > stage.
> >
> > My hbase-site.xml was blank (between the configuration tags) and the
> > only things I've added so far are:
> >
> > hbase.cluster.distributed="true"
> > hbase.rootdir="hdfs://master:50071/hbase"
> > hbase.zookeeper.quorum="master"
> >
> > obviously in the <name><value> format of the XML file, without the quotes.
> >
> > I'm at a bit of a loss as to what is going on. I've tried a wget to
> > the namenode dfshealth.asp page and that works fine (obviously thats
> > http:// rather than hdfs://). Any pointers on where to look?
> >
> > Many thanks,
> >
> > Jamie
> >
> > I ran a wget to
> >
_________________________________________________________________
The New Busy think 9 to 5 is a cute idea. Combine multiple calendars with Hotmail.
http://www.windowslive.com/campaign/thenewbusy?tile=multicalendar&ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_5
Re: Problem starting HBase Master for the first time, EOFException
Posted by Jamie Cockrill <ja...@gmail.com>.
Dear hbase-users,
Further to this, I've been doing a lot of kicking around with the
config and learned the following:
- You get the same error if a process is listening on that port, that
is not a HDFS namenode;
- Although my web front-end for my namenode is on port 50071, it seems
the namenode itself (i.e. anything that wants hdfs://) is listening on
50070.
Having changed my hbase-site.xml to point to 50070 it now seems to
have started working. Apologies if anyone has wasted any time looking
at it. This begs the question, why is my namenode web server on a
different port, but I'll get to that another time.
Many thanks,
James
On 6 July 2010 12:19, Jamie Cockrill <ja...@gmail.com> wrote:
> Dear hbase-users,
>
> I was wondering if you might be able to help. I am trying to setup
> HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
> Karmic CDH3 distribution. Zookeeper has installed fine, however when
> it comes to starting an hbase master, it falls over with the following
> exception:
>
> (stack trace summarised to last bit)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>
> Its clearly connecting to the HDFS, but it's giving it a strange
> response. The section above of the trace identifies the hostname that
> I've specified in the hbase.rootdir property in the hbase-site.xml and
> also the IP address, which it must have looked up in DNS. For
> information, that is set to:
> hdfs://master:50071/hbase.
>
> Also, as i'm just evaluating it at this stage, I'm installing
> Zookeeper and hbase-master on the same machine as the namenode
> (master). The regionservers will go somewhere else when I get to that
> stage.
>
> My hbase-site.xml was blank (between the configuration tags) and the
> only things I've added so far are:
>
> hbase.cluster.distributed="true"
> hbase.rootdir="hdfs://master:50071/hbase"
> hbase.zookeeper.quorum="master"
>
> obviously in the <name><value> format of the XML file, without the quotes.
>
> I'm at a bit of a loss as to what is going on. I've tried a wget to
> the namenode dfshealth.asp page and that works fine (obviously thats
> http:// rather than hdfs://). Any pointers on where to look?
>
> Many thanks,
>
> Jamie
>
> I ran a wget to
>
Re: Problem starting HBase Master for the first time, EOFException
Posted by Jean-Daniel Cryans <jd...@apache.org>.
I didn't try it, but like I said 0.89.20100924 can probably work with
CDH3B3 if you replace the hadoop jars we ship with, with those from
cloudera. Alternatively, cloudera already ships what seems to be
0.89.20100924 so might as well try it:
http://archive.cloudera.com/cdh/3/hbase-0.89.20100924+28.tar.gz
J-D
On Wed, Oct 20, 2010 at 11:45 AM, Jian Lu <jl...@local.com> wrote:
> Hi Jean, sorry I should have spotted the difference of 0.21.0 vs 0.20.0!
>
> If I want to use HBase 0.89.20100924, should I use cloudera's CDH3B3? But, you seem to mention there was a problem you have solved. Are there any steps we have to follow in order to solve the problem you mentioned at the end of your email?
>
>
> Thanks!
> Jack.
>
>
> -----Original Message-----
> From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
> Sent: Wednesday, October 20, 2010 11:35 AM
> To: user@hbase.apache.org
> Subject: Re: Problem starting HBase Master for the first time, EOFException
>
> HBase doesn't work on Hadoop 0.21.x, the Getting Started documentation
> specifically says:
>
> "This version of HBase will only run on Hadoop 0.20.x.HBase will lose
> data unless it is running on an HDFS that has a durable sync
> operation. Currently only the branch-0.20-append branch has this
> attribute. No official releases have been made from this branch as of
> this writing so you will have to build your own Hadoop from the tip of
> this branch (or install Cloudera's CDH3 (as of this writing, it is in
> beta); it has the 0.20-append patches needed to add a durable sync).
> See CHANGES.txt in branch-0.20.-append to see list of patches
> involved."
>
> Also I solved what I think is the other poster's issue on the IRC
> channel, basically he was using the Apache 0.89.20100924 release with
> cloudera's CDH3B3, which seems to be incompatible (although from the
> looks of it it's just a master of replacing the hadoop jar that hbase
> is running with).
>
> J-D
>
> On Wed, Oct 20, 2010 at 11:25 AM, Jian Lu <jl...@local.com> wrote:
>> I am having the same problem right now. The zoo keeper started OK but HMaster failed. Please help!!!!!!!!
>>
>> I have installed hadoop-0.21.0 on a three-node cluster, I started the Hadoop cluster successfully with NameNode on caiss01a:54310. I tried to setup hbase-0.89.20100924 in fully-distributed mode with: hbase.rootdir = hdfs://caiss01a:54310/hbase, hbase.cluster.distributed = true. Then I ran the ./bin/start-hbase.sh and got the error below:
>>
>>
>> 2010-10-20 11:21:50,591 INFO org.apache.hadoop.ipc.HBaseServer: Starting SocketReader
>> 2010-10-20 11:21:50,612 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=60000
>> 2010-10-20 11:21:51,094 ERROR org.apache.hadoop.hbase.master.HMaster: Failed to start master
>> java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to caiss01a/172.16.2.224:54310 failed on local ex
>> ception: java.io.EOFException
>> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
>> at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
>> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
>> ... 2 more
>> Caused by: java.io.IOException: Call to caiss01a/172.16.2.224:54310 failed on local exception: java.io.EOFException
>>
>>
>>
>> Please help!!!!!!!!!!! Thanks!
>>
>> Jack.
>>
>>
>>
>> -----Original Message-----
>> From: Andrew Nguyen [mailto:andrew-lists-hbase@ucsfcti.org]
>> Sent: Wednesday, October 20, 2010 8:55 AM
>> To: user@hbase.apache.org
>> Subject: Re: Problem starting HBase Master for the first time, EOFException
>>
>> I am having a very similar issue but I have verified that both the NameNode and HBase are pointing to the same port (in this case, the default of 8020). I am getting the same EOFException and have attached it here also:
>>
>> java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
>> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
>> at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
>> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
>> ... 2 more
>> Caused by: java.io.IOException: Call to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
>> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>> at org.apache.hadoop.ipc.Client.call(Client.java:743)
>> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>> at $Proxy0.getProtocolVersion(Unknown Source)
>> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:112)
>> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
>> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:176)
>> at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:217)
>> ... 7 more
>> Caused by: java.io.EOFException
>> at java.io.DataInputStream.readInt(DataInputStream.java:375)
>> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>>
>> I have previously setup several clusters successfully on Ubuntu but am trying to setup a pseudo-distributed cluster locally on my Macbook Pro. So, this is my first attempt on a Mac machine. I have verified that Hadoop is running as I can create directories in HDFS (I tried creating /hbase just to see if I could, then I subsequently removed it). Not sure what other causes there are for EOFExceptions that I can take a look at.
>>
>> Thanks!
>>
>> --
>> Andrew Nguyen
>> andrew@ucsfcti.org
>>
>> The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain confidential or privileged information. Any unauthorized review, dissemination, distribution, or copying of this communication is prohibited. If you are not the intended recipient, please notify the sender immediately by reply e-mail, and destroy all copies of this message and any attachments from your files.
>>
>>
>>
>>
>>
>>
>> On Jul 6, 2010, at 4:19 AM, Jamie Cockrill wrote:
>>
>>> Dear hbase-users,
>>>
>>> I was wondering if you might be able to help. I am trying to setup
>>> HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
>>> Karmic CDH3 distribution. Zookeeper has installed fine, however when
>>> it comes to starting an hbase master, it falls over with the following
>>> exception:
>>>
>>> (stack trace summarised to last bit)
>>> Caused by: java.io.EOFException
>>> at java.io.DataInputStream.readInt(DataInputStream.java:375)
>>> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
>>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>>>
>>> Its clearly connecting to the HDFS, but it's giving it a strange
>>> response. The section above of the trace identifies the hostname that
>>> I've specified in the hbase.rootdir property in the hbase-site.xml and
>>> also the IP address, which it must have looked up in DNS. For
>>> information, that is set to:
>>> hdfs://master:50071/hbase.
>>>
>>> Also, as i'm just evaluating it at this stage, I'm installing
>>> Zookeeper and hbase-master on the same machine as the namenode
>>> (master). The regionservers will go somewhere else when I get to that
>>> stage.
>>>
>>> My hbase-site.xml was blank (between the configuration tags) and the
>>> only things I've added so far are:
>>>
>>> hbase.cluster.distributed="true"
>>> hbase.rootdir="hdfs://master:50071/hbase"
>>> hbase.zookeeper.quorum="master"
>>>
>>> obviously in the <name><value> format of the XML file, without the quotes.
>>>
>>> I'm at a bit of a loss as to what is going on. I've tried a wget to
>>> the namenode dfshealth.asp page and that works fine (obviously thats
>>> http:// rather than hdfs://). Any pointers on where to look?
>>>
>>> Many thanks,
>>>
>>> Jamie
>>>
>>> I ran a wget to
>>
>>
>
RE: Problem starting HBase Master for the first time, EOFException
Posted by Jian Lu <jl...@local.com>.
Hi Jean, sorry I should have spotted the difference of 0.21.0 vs 0.20.0!
If I want to use HBase 0.89.20100924, should I use cloudera's CDH3B3? But, you seem to mention there was a problem you have solved. Are there any steps we have to follow in order to solve the problem you mentioned at the end of your email?
Thanks!
Jack.
-----Original Message-----
From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
Sent: Wednesday, October 20, 2010 11:35 AM
To: user@hbase.apache.org
Subject: Re: Problem starting HBase Master for the first time, EOFException
HBase doesn't work on Hadoop 0.21.x, the Getting Started documentation
specifically says:
"This version of HBase will only run on Hadoop 0.20.x.HBase will lose
data unless it is running on an HDFS that has a durable sync
operation. Currently only the branch-0.20-append branch has this
attribute. No official releases have been made from this branch as of
this writing so you will have to build your own Hadoop from the tip of
this branch (or install Cloudera's CDH3 (as of this writing, it is in
beta); it has the 0.20-append patches needed to add a durable sync).
See CHANGES.txt in branch-0.20.-append to see list of patches
involved."
Also I solved what I think is the other poster's issue on the IRC
channel, basically he was using the Apache 0.89.20100924 release with
cloudera's CDH3B3, which seems to be incompatible (although from the
looks of it it's just a master of replacing the hadoop jar that hbase
is running with).
J-D
On Wed, Oct 20, 2010 at 11:25 AM, Jian Lu <jl...@local.com> wrote:
> I am having the same problem right now. The zoo keeper started OK but HMaster failed. Please help!!!!!!!!
>
> I have installed hadoop-0.21.0 on a three-node cluster, I started the Hadoop cluster successfully with NameNode on caiss01a:54310. I tried to setup hbase-0.89.20100924 in fully-distributed mode with: hbase.rootdir = hdfs://caiss01a:54310/hbase, hbase.cluster.distributed = true. Then I ran the ./bin/start-hbase.sh and got the error below:
>
>
> 2010-10-20 11:21:50,591 INFO org.apache.hadoop.ipc.HBaseServer: Starting SocketReader
> 2010-10-20 11:21:50,612 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=60000
> 2010-10-20 11:21:51,094 ERROR org.apache.hadoop.hbase.master.HMaster: Failed to start master
> java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to caiss01a/172.16.2.224:54310 failed on local ex
> ception: java.io.EOFException
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
> at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
> ... 2 more
> Caused by: java.io.IOException: Call to caiss01a/172.16.2.224:54310 failed on local exception: java.io.EOFException
>
>
>
> Please help!!!!!!!!!!! Thanks!
>
> Jack.
>
>
>
> -----Original Message-----
> From: Andrew Nguyen [mailto:andrew-lists-hbase@ucsfcti.org]
> Sent: Wednesday, October 20, 2010 8:55 AM
> To: user@hbase.apache.org
> Subject: Re: Problem starting HBase Master for the first time, EOFException
>
> I am having a very similar issue but I have verified that both the NameNode and HBase are pointing to the same port (in this case, the default of 8020). I am getting the same EOFException and have attached it here also:
>
> java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
> at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
> ... 2 more
> Caused by: java.io.IOException: Call to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
> at org.apache.hadoop.ipc.Client.call(Client.java:743)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
> at $Proxy0.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:112)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:176)
> at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:217)
> ... 7 more
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>
> I have previously setup several clusters successfully on Ubuntu but am trying to setup a pseudo-distributed cluster locally on my Macbook Pro. So, this is my first attempt on a Mac machine. I have verified that Hadoop is running as I can create directories in HDFS (I tried creating /hbase just to see if I could, then I subsequently removed it). Not sure what other causes there are for EOFExceptions that I can take a look at.
>
> Thanks!
>
> --
> Andrew Nguyen
> andrew@ucsfcti.org
>
> The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain confidential or privileged information. Any unauthorized review, dissemination, distribution, or copying of this communication is prohibited. If you are not the intended recipient, please notify the sender immediately by reply e-mail, and destroy all copies of this message and any attachments from your files.
>
>
>
>
>
>
> On Jul 6, 2010, at 4:19 AM, Jamie Cockrill wrote:
>
>> Dear hbase-users,
>>
>> I was wondering if you might be able to help. I am trying to setup
>> HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
>> Karmic CDH3 distribution. Zookeeper has installed fine, however when
>> it comes to starting an hbase master, it falls over with the following
>> exception:
>>
>> (stack trace summarised to last bit)
>> Caused by: java.io.EOFException
>> at java.io.DataInputStream.readInt(DataInputStream.java:375)
>> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>>
>> Its clearly connecting to the HDFS, but it's giving it a strange
>> response. The section above of the trace identifies the hostname that
>> I've specified in the hbase.rootdir property in the hbase-site.xml and
>> also the IP address, which it must have looked up in DNS. For
>> information, that is set to:
>> hdfs://master:50071/hbase.
>>
>> Also, as i'm just evaluating it at this stage, I'm installing
>> Zookeeper and hbase-master on the same machine as the namenode
>> (master). The regionservers will go somewhere else when I get to that
>> stage.
>>
>> My hbase-site.xml was blank (between the configuration tags) and the
>> only things I've added so far are:
>>
>> hbase.cluster.distributed="true"
>> hbase.rootdir="hdfs://master:50071/hbase"
>> hbase.zookeeper.quorum="master"
>>
>> obviously in the <name><value> format of the XML file, without the quotes.
>>
>> I'm at a bit of a loss as to what is going on. I've tried a wget to
>> the namenode dfshealth.asp page and that works fine (obviously thats
>> http:// rather than hdfs://). Any pointers on where to look?
>>
>> Many thanks,
>>
>> Jamie
>>
>> I ran a wget to
>
>
Re: Problem starting HBase Master for the first time, EOFException
Posted by Jean-Daniel Cryans <jd...@apache.org>.
HBase doesn't work on Hadoop 0.21.x, the Getting Started documentation
specifically says:
"This version of HBase will only run on Hadoop 0.20.x.HBase will lose
data unless it is running on an HDFS that has a durable sync
operation. Currently only the branch-0.20-append branch has this
attribute. No official releases have been made from this branch as of
this writing so you will have to build your own Hadoop from the tip of
this branch (or install Cloudera's CDH3 (as of this writing, it is in
beta); it has the 0.20-append patches needed to add a durable sync).
See CHANGES.txt in branch-0.20.-append to see list of patches
involved."
Also I solved what I think is the other poster's issue on the IRC
channel, basically he was using the Apache 0.89.20100924 release with
cloudera's CDH3B3, which seems to be incompatible (although from the
looks of it it's just a master of replacing the hadoop jar that hbase
is running with).
J-D
On Wed, Oct 20, 2010 at 11:25 AM, Jian Lu <jl...@local.com> wrote:
> I am having the same problem right now. The zoo keeper started OK but HMaster failed. Please help!!!!!!!!
>
> I have installed hadoop-0.21.0 on a three-node cluster, I started the Hadoop cluster successfully with NameNode on caiss01a:54310. I tried to setup hbase-0.89.20100924 in fully-distributed mode with: hbase.rootdir = hdfs://caiss01a:54310/hbase, hbase.cluster.distributed = true. Then I ran the ./bin/start-hbase.sh and got the error below:
>
>
> 2010-10-20 11:21:50,591 INFO org.apache.hadoop.ipc.HBaseServer: Starting SocketReader
> 2010-10-20 11:21:50,612 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=60000
> 2010-10-20 11:21:51,094 ERROR org.apache.hadoop.hbase.master.HMaster: Failed to start master
> java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to caiss01a/172.16.2.224:54310 failed on local ex
> ception: java.io.EOFException
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
> at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
> ... 2 more
> Caused by: java.io.IOException: Call to caiss01a/172.16.2.224:54310 failed on local exception: java.io.EOFException
>
>
>
> Please help!!!!!!!!!!! Thanks!
>
> Jack.
>
>
>
> -----Original Message-----
> From: Andrew Nguyen [mailto:andrew-lists-hbase@ucsfcti.org]
> Sent: Wednesday, October 20, 2010 8:55 AM
> To: user@hbase.apache.org
> Subject: Re: Problem starting HBase Master for the first time, EOFException
>
> I am having a very similar issue but I have verified that both the NameNode and HBase are pointing to the same port (in this case, the default of 8020). I am getting the same EOFException and have attached it here also:
>
> java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
> at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
> at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
> ... 2 more
> Caused by: java.io.IOException: Call to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
> at org.apache.hadoop.ipc.Client.call(Client.java:743)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
> at $Proxy0.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:112)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:176)
> at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
> at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:217)
> ... 7 more
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>
> I have previously setup several clusters successfully on Ubuntu but am trying to setup a pseudo-distributed cluster locally on my Macbook Pro. So, this is my first attempt on a Mac machine. I have verified that Hadoop is running as I can create directories in HDFS (I tried creating /hbase just to see if I could, then I subsequently removed it). Not sure what other causes there are for EOFExceptions that I can take a look at.
>
> Thanks!
>
> --
> Andrew Nguyen
> andrew@ucsfcti.org
>
> The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain confidential or privileged information. Any unauthorized review, dissemination, distribution, or copying of this communication is prohibited. If you are not the intended recipient, please notify the sender immediately by reply e-mail, and destroy all copies of this message and any attachments from your files.
>
>
>
>
>
>
> On Jul 6, 2010, at 4:19 AM, Jamie Cockrill wrote:
>
>> Dear hbase-users,
>>
>> I was wondering if you might be able to help. I am trying to setup
>> HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
>> Karmic CDH3 distribution. Zookeeper has installed fine, however when
>> it comes to starting an hbase master, it falls over with the following
>> exception:
>>
>> (stack trace summarised to last bit)
>> Caused by: java.io.EOFException
>> at java.io.DataInputStream.readInt(DataInputStream.java:375)
>> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>>
>> Its clearly connecting to the HDFS, but it's giving it a strange
>> response. The section above of the trace identifies the hostname that
>> I've specified in the hbase.rootdir property in the hbase-site.xml and
>> also the IP address, which it must have looked up in DNS. For
>> information, that is set to:
>> hdfs://master:50071/hbase.
>>
>> Also, as i'm just evaluating it at this stage, I'm installing
>> Zookeeper and hbase-master on the same machine as the namenode
>> (master). The regionservers will go somewhere else when I get to that
>> stage.
>>
>> My hbase-site.xml was blank (between the configuration tags) and the
>> only things I've added so far are:
>>
>> hbase.cluster.distributed="true"
>> hbase.rootdir="hdfs://master:50071/hbase"
>> hbase.zookeeper.quorum="master"
>>
>> obviously in the <name><value> format of the XML file, without the quotes.
>>
>> I'm at a bit of a loss as to what is going on. I've tried a wget to
>> the namenode dfshealth.asp page and that works fine (obviously thats
>> http:// rather than hdfs://). Any pointers on where to look?
>>
>> Many thanks,
>>
>> Jamie
>>
>> I ran a wget to
>
>
RE: Problem starting HBase Master for the first time, EOFException
Posted by Jian Lu <jl...@local.com>.
I am having the same problem right now. The zoo keeper started OK but HMaster failed. Please help!!!!!!!!
I have installed hadoop-0.21.0 on a three-node cluster, I started the Hadoop cluster successfully with NameNode on caiss01a:54310. I tried to setup hbase-0.89.20100924 in fully-distributed mode with: hbase.rootdir = hdfs://caiss01a:54310/hbase, hbase.cluster.distributed = true. Then I ran the ./bin/start-hbase.sh and got the error below:
2010-10-20 11:21:50,591 INFO org.apache.hadoop.ipc.HBaseServer: Starting SocketReader
2010-10-20 11:21:50,612 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=60000
2010-10-20 11:21:51,094 ERROR org.apache.hadoop.hbase.master.HMaster: Failed to start master
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to caiss01a/172.16.2.224:54310 failed on local ex
ception: java.io.EOFException
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
... 2 more
Caused by: java.io.IOException: Call to caiss01a/172.16.2.224:54310 failed on local exception: java.io.EOFException
Please help!!!!!!!!!!! Thanks!
Jack.
-----Original Message-----
From: Andrew Nguyen [mailto:andrew-lists-hbase@ucsfcti.org]
Sent: Wednesday, October 20, 2010 8:55 AM
To: user@hbase.apache.org
Subject: Re: Problem starting HBase Master for the first time, EOFException
I am having a very similar issue but I have verified that both the NameNode and HBase are pointing to the same port (in this case, the default of 8020). I am getting the same EOFException and have attached it here also:
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
... 2 more
Caused by: java.io.IOException: Call to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
at org.apache.hadoop.ipc.Client.call(Client.java:743)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy0.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:112)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:176)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:217)
... 7 more
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
I have previously setup several clusters successfully on Ubuntu but am trying to setup a pseudo-distributed cluster locally on my Macbook Pro. So, this is my first attempt on a Mac machine. I have verified that Hadoop is running as I can create directories in HDFS (I tried creating /hbase just to see if I could, then I subsequently removed it). Not sure what other causes there are for EOFExceptions that I can take a look at.
Thanks!
--
Andrew Nguyen
andrew@ucsfcti.org
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain confidential or privileged information. Any unauthorized review, dissemination, distribution, or copying of this communication is prohibited. If you are not the intended recipient, please notify the sender immediately by reply e-mail, and destroy all copies of this message and any attachments from your files.
On Jul 6, 2010, at 4:19 AM, Jamie Cockrill wrote:
> Dear hbase-users,
>
> I was wondering if you might be able to help. I am trying to setup
> HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
> Karmic CDH3 distribution. Zookeeper has installed fine, however when
> it comes to starting an hbase master, it falls over with the following
> exception:
>
> (stack trace summarised to last bit)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>
> Its clearly connecting to the HDFS, but it's giving it a strange
> response. The section above of the trace identifies the hostname that
> I've specified in the hbase.rootdir property in the hbase-site.xml and
> also the IP address, which it must have looked up in DNS. For
> information, that is set to:
> hdfs://master:50071/hbase.
>
> Also, as i'm just evaluating it at this stage, I'm installing
> Zookeeper and hbase-master on the same machine as the namenode
> (master). The regionservers will go somewhere else when I get to that
> stage.
>
> My hbase-site.xml was blank (between the configuration tags) and the
> only things I've added so far are:
>
> hbase.cluster.distributed="true"
> hbase.rootdir="hdfs://master:50071/hbase"
> hbase.zookeeper.quorum="master"
>
> obviously in the <name><value> format of the XML file, without the quotes.
>
> I'm at a bit of a loss as to what is going on. I've tried a wget to
> the namenode dfshealth.asp page and that works fine (obviously thats
> http:// rather than hdfs://). Any pointers on where to look?
>
> Many thanks,
>
> Jamie
>
> I ran a wget to
Re: Problem starting HBase Master for the first time, EOFException
Posted by Andrew Nguyen <an...@ucsfcti.org>.
I am having a very similar issue but I have verified that both the NameNode and HBase are pointing to the same port (in this case, the default of 8020). I am getting the same EOFException and have attached it here also:
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMasterCall to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1232)
at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1338)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1389)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1230)
... 2 more
Caused by: java.io.IOException: Call to master-local/127.0.0.1:8020 failed on local exception: java.io.EOFException
at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
at org.apache.hadoop.ipc.Client.call(Client.java:743)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy0.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:112)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:176)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:217)
... 7 more
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
I have previously setup several clusters successfully on Ubuntu but am trying to setup a pseudo-distributed cluster locally on my Macbook Pro. So, this is my first attempt on a Mac machine. I have verified that Hadoop is running as I can create directories in HDFS (I tried creating /hbase just to see if I could, then I subsequently removed it). Not sure what other causes there are for EOFExceptions that I can take a look at.
Thanks!
--
Andrew Nguyen
andrew@ucsfcti.org
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain confidential or privileged information. Any unauthorized review, dissemination, distribution, or copying of this communication is prohibited. If you are not the intended recipient, please notify the sender immediately by reply e-mail, and destroy all copies of this message and any attachments from your files.
On Jul 6, 2010, at 4:19 AM, Jamie Cockrill wrote:
> Dear hbase-users,
>
> I was wondering if you might be able to help. I am trying to setup
> HBase (and as such, Zookeeper) on Ubuntu 10.04 using the Cloudera
> Karmic CDH3 distribution. Zookeeper has installed fine, however when
> it comes to starting an hbase master, it falls over with the following
> exception:
>
> (stack trace summarised to last bit)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:508)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>
> Its clearly connecting to the HDFS, but it's giving it a strange
> response. The section above of the trace identifies the hostname that
> I've specified in the hbase.rootdir property in the hbase-site.xml and
> also the IP address, which it must have looked up in DNS. For
> information, that is set to:
> hdfs://master:50071/hbase.
>
> Also, as i'm just evaluating it at this stage, I'm installing
> Zookeeper and hbase-master on the same machine as the namenode
> (master). The regionservers will go somewhere else when I get to that
> stage.
>
> My hbase-site.xml was blank (between the configuration tags) and the
> only things I've added so far are:
>
> hbase.cluster.distributed="true"
> hbase.rootdir="hdfs://master:50071/hbase"
> hbase.zookeeper.quorum="master"
>
> obviously in the <name><value> format of the XML file, without the quotes.
>
> I'm at a bit of a loss as to what is going on. I've tried a wget to
> the namenode dfshealth.asp page and that works fine (obviously thats
> http:// rather than hdfs://). Any pointers on where to look?
>
> Many thanks,
>
> Jamie
>
> I ran a wget to