You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Dhanasekaran Anbalagan <bu...@gmail.com> on 2013/04/03 10:47:58 UTC

Hbase ConnectionLoss for /hbase/master

Hi Guys,

I trying to run hbase based parser program. Basically the parsed output
written in Hbase table. When I ran my program. tables created some data
also inserted to the table. but not fully table updated.

This Exception seen in console output. I try to find goggling it's gives
try to configure zookeeper session. I correctly
configure  hbase.zookeeper.quorum property I mentioned all my zookeeper
machine names.

2013-04-02 17:50:13,888 ERROR   RecoverableZooKeeper
[pool-1-thread-19-EventThread]: ZooKeeper exists failed after 3 retries
2013-04-02 17:50:13,900 ERROR   ZooKeeperWatcher
[pool-1-thread-19-EventThread]: hconnection Received unexpected
KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/master
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
at
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
at
org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.resetZooKeeperTrackers(HConnectionManager.java:597)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:1720)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:374)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
at
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)
2013-04-02 17:50:46,601 FATAL
HConnectionManager$HConnectionImplementation
[pool-1-thread-19-EventThread]: Unexpected exception during initialization,
aborting
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/master
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
at
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
at
org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.resetZooKeeperTrackers(HConnectionManager.java:597)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:1720)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:374)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
at
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)


Please guide me. how to fix this.

-Dhanasekaran.

Did I learn something today? If not, I wasted it.

Re: Hbase ConnectionLoss for /hbase/master

Posted by Ted Yu <yu...@gmail.com>.
Since the exception came from zookeeper, please check zookeeper log(s) on
the quorum.

Thanks


On Wed, Apr 3, 2013 at 8:43 AM, Jimmy Xiang <jx...@cloudera.com> wrote:

> Is this exception seen in the client side? Was your HBase still running
> fine at that moment?
>
> How many connections do you open in your client?  Which HBase version is
> it?
>
> Thanks,
> Jimmy
>
> On Wed, Apr 3, 2013 at 1:47 AM, Dhanasekaran Anbalagan
> <bu...@gmail.com>wrote:
>
> > Hi Guys,
> >
> > I trying to run hbase based parser program. Basically the parsed output
> > written in Hbase table. When I ran my program. tables created some data
> > also inserted to the table. but not fully table updated.
> >
> > This Exception seen in console output. I try to find goggling it's gives
> > try to configure zookeeper session. I correctly
> > configure  hbase.zookeeper.quorum property I mentioned all my zookeeper
> > machine names.
> >
> > 2013-04-02 17:50:13,888 ERROR   RecoverableZooKeeper
> > [pool-1-thread-19-EventThread]: ZooKeeper exists failed after 3 retries
> > 2013-04-02 17:50:13,900 ERROR   ZooKeeperWatcher
> > [pool-1-thread-19-EventThread]: hconnection Received unexpected
> > KeeperException, re-throwing exception
> > org.apache.zookeeper.KeeperException$ConnectionLossException:
> > KeeperErrorCode = ConnectionLoss for /hbase/master
> > at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.resetZooKeeperTrackers(HConnectionManager.java:597)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:1720)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:374)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
> > at
> >
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
> > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)
> > 2013-04-02 17:50:46,601 FATAL
> > HConnectionManager$HConnectionImplementation
> > [pool-1-thread-19-EventThread]: Unexpected exception during
> initialization,
> > aborting
> > org.apache.zookeeper.KeeperException$ConnectionLossException:
> > KeeperErrorCode = ConnectionLoss for /hbase/master
> > at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.resetZooKeeperTrackers(HConnectionManager.java:597)
> > at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:1720)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:374)
> > at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
> > at
> >
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
> > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)
> >
> >
> > Please guide me. how to fix this.
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> > --
> >
> >
> >
> >
>

Re: Hbase ConnectionLoss for /hbase/master

Posted by Jimmy Xiang <jx...@cloudera.com>.
Is this exception seen in the client side? Was your HBase still running
fine at that moment?

How many connections do you open in your client?  Which HBase version is it?

Thanks,
Jimmy

On Wed, Apr 3, 2013 at 1:47 AM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:

> Hi Guys,
>
> I trying to run hbase based parser program. Basically the parsed output
> written in Hbase table. When I ran my program. tables created some data
> also inserted to the table. but not fully table updated.
>
> This Exception seen in console output. I try to find goggling it's gives
> try to configure zookeeper session. I correctly
> configure  hbase.zookeeper.quorum property I mentioned all my zookeeper
> machine names.
>
> 2013-04-02 17:50:13,888 ERROR   RecoverableZooKeeper
> [pool-1-thread-19-EventThread]: ZooKeeper exists failed after 3 retries
> 2013-04-02 17:50:13,900 ERROR   ZooKeeperWatcher
> [pool-1-thread-19-EventThread]: hconnection Received unexpected
> KeeperException, re-throwing exception
> org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/master
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
> at
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
> at
> org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.resetZooKeeperTrackers(HConnectionManager.java:597)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:1720)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:374)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
> at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)
> 2013-04-02 17:50:46,601 FATAL
> HConnectionManager$HConnectionImplementation
> [pool-1-thread-19-EventThread]: Unexpected exception during initialization,
> aborting
> org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/master
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
> at
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
> at
> org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.resetZooKeeperTrackers(HConnectionManager.java:597)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:1720)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:374)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
> at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)
>
>
> Please guide me. how to fix this.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
> --
>
>
>
>