You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Job <jo...@gridline.nl> on 2010/12/17 11:24:03 UTC
Creating HBase connection to remote Master
Hi,
I have setup a simple 2 node cluster using cloudera's distribution CDh3
of hadoop, hbase and zookeeper.
The system seems to be running fine. (http://192.168.10.139:60010 show
that the master is running with one regionserver, the 'zk dump' shows
the master address: "Master address: 192.168.10.139:60000"
On the server if check the HBase shell status, it looks all fine. I can
telnet from my own host to the master's IP: 192.168.10.139:60000
But next, from my code (using the same versions of the libs) when I try
create a connection to this server:
HBaseConfiguration config = new HBaseConfiguration();
config.set("hbase.zookeeper.quorum", zookeeper);
admin = new HBaseAdmin(config);
The log tells me, that the zookeeper session is being created (which
indeed shows up in de zk-dump and log on the server) but hangs on
'getMaster':
org.apache.hadoop.hbase.client.HConnectionManager$TableServers -
getMaster attempt 0 of 10 failed; retrying after sleep of 2000
etc.
It never receives the actual connection, also it doesn't tell if it
could retrieve the master address, and if it tries to connect to the
correct server.
Any idea what can be wrong here? - or pointers to where I should look
for debugging the problem.
Thanks!
Job
Re: Creating HBase connection to remote Master
Posted by Job <jo...@gridline.nl>.
Fixed! That did the trick: my local logging on debug revealed that i was
actually using hbase from mahout 0.4 - it was hiding on the classpath in
my multi module maven setup.
thanks,
Job
On vr, 2010-12-17 at 11:30 +0000, Friso van Vollenhoven wrote:
> Hi Job,
>
> Is lookup setup correctly, such that the nodes can do forward and reverse lookup for the IPs in the cluster? Just put all nodes in /etc/hosts on all machines (quite doable for a 2 node cluster).
>
> If you switch HBase (and Zookeeper) logging to DEBUG, you may see a bit more of what does and does not happen.
>
> Hope this helps.
>
>
> Friso
>
>
>
> On 17 dec 2010, at 11:24, Job wrote:
>
> > Hi,
> >
> > I have setup a simple 2 node cluster using cloudera's distribution CDh3
> > of hadoop, hbase and zookeeper.
> > The system seems to be running fine. (http://192.168.10.139:60010 show
> > that the master is running with one regionserver, the 'zk dump' shows
> > the master address: "Master address: 192.168.10.139:60000"
> >
> > On the server if check the HBase shell status, it looks all fine. I can
> > telnet from my own host to the master's IP: 192.168.10.139:60000
> >
> > But next, from my code (using the same versions of the libs) when I try
> > create a connection to this server:
> >
> > HBaseConfiguration config = new HBaseConfiguration();
> > config.set("hbase.zookeeper.quorum", zookeeper);
> > admin = new HBaseAdmin(config);
> >
> > The log tells me, that the zookeeper session is being created (which
> > indeed shows up in de zk-dump and log on the server) but hangs on
> > 'getMaster':
> >
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers -
> > getMaster attempt 0 of 10 failed; retrying after sleep of 2000
> >
> > etc.
> >
> > It never receives the actual connection, also it doesn't tell if it
> > could retrieve the master address, and if it tries to connect to the
> > correct server.
> >
> > Any idea what can be wrong here? - or pointers to where I should look
> > for debugging the problem.
> >
> > Thanks!
> >
> > Job
> >
>
--
Drs. Job Tiel Groenestege
GridLine - Intranet en Zoeken
GridLine
Keizersgracht 520
1017 EK Amsterdam
www: http://www.gridline.nl
mail: job@gridline.nl
tel: +31 20 616 2050
fax: +31 20 616 2051
De inhoud van dit bericht en de eventueel daarbij behorende bijlagen zijn persoonlijk gericht aan en derhalve uitsluitend bestemd voor de geadresseerde. Zij kunnen gegevens met betrekking tot een derde bevatten. De ontvanger die niet de geadresseerde is, noch bevoegd is dit bericht namens geadresseerde te ontvangen, wordt verzocht de afzender onmiddellijk op de hoogte te stellen van de ontvangst. Elk gebruik van de inhoud van dit bericht en/of van de daarbij behorende bijlagen door een ander dan de geadresseerde is onrechtmatig jegens afzender respectievelijk de hiervoor bedoelde derde.
Re: Creating HBase connection to remote Master
Posted by Friso van Vollenhoven <fv...@xebia.com>.
Hi Job,
Is lookup setup correctly, such that the nodes can do forward and reverse lookup for the IPs in the cluster? Just put all nodes in /etc/hosts on all machines (quite doable for a 2 node cluster).
If you switch HBase (and Zookeeper) logging to DEBUG, you may see a bit more of what does and does not happen.
Hope this helps.
Friso
On 17 dec 2010, at 11:24, Job wrote:
> Hi,
>
> I have setup a simple 2 node cluster using cloudera's distribution CDh3
> of hadoop, hbase and zookeeper.
> The system seems to be running fine. (http://192.168.10.139:60010 show
> that the master is running with one regionserver, the 'zk dump' shows
> the master address: "Master address: 192.168.10.139:60000"
>
> On the server if check the HBase shell status, it looks all fine. I can
> telnet from my own host to the master's IP: 192.168.10.139:60000
>
> But next, from my code (using the same versions of the libs) when I try
> create a connection to this server:
>
> HBaseConfiguration config = new HBaseConfiguration();
> config.set("hbase.zookeeper.quorum", zookeeper);
> admin = new HBaseAdmin(config);
>
> The log tells me, that the zookeeper session is being created (which
> indeed shows up in de zk-dump and log on the server) but hangs on
> 'getMaster':
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers -
> getMaster attempt 0 of 10 failed; retrying after sleep of 2000
>
> etc.
>
> It never receives the actual connection, also it doesn't tell if it
> could retrieve the master address, and if it tries to connect to the
> correct server.
>
> Any idea what can be wrong here? - or pointers to where I should look
> for debugging the problem.
>
> Thanks!
>
> Job
>