You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@zookeeper.apache.org by Lewis John Mcgibbney <le...@gmail.com> on 2013/11/06 11:53:11 UTC

Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9 tests

Hi Zookeepers,
I'm in the process of upgrading the HBase version over in Apache Gora from
0.90.4 to 0.94.9.
For our test suite we use an embedded HBase cluster [0]. The configuration
for which can also be seen here [1].
When I attempt to initiate the HBase cluster, I get the following output
(I've removed the classpath entries for brevity).

13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:host.name
=localhost
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.version=1.7.0_45
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.vendor=Oracle Corporation
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.home=/usr/java/jdk1.7.0_45/jre
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
...
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.io.tmpdir=/tmp
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:java.compiler=<NA>
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:os.name
=Linux
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:os.arch=i386
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:os.version=3.5.0-42-generic
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:user.name
=mary
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:user.home=/home/mary
13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
13/11/06 10:32:21 INFO server.ZooKeeperServer: Created server with tickTime
2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir
/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
snapdir
/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
13/11/06 10:32:21 INFO server.NIOServerCnxnFactory: binding to port
0.0.0.0/0.0.0.0:60055
13/11/06 10:32:22 INFO persistence.FileTxnSnapLog: Snapshotting: 0x0 to
/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2/snapshot.0
13/11/06 10:32:22 INFO server.NIOServerCnxnFactory: Accepted socket
connection from /127.0.0.1:44504
13/11/06 10:32:22 INFO server.NIOServerCnxn: Processing stat command from /
127.0.0.1:44504
13/11/06 10:32:22 INFO server.NIOServerCnxn: Stat command output
13/11/06 10:32:22 INFO zookeeper.MiniZooKeeperCluster: Started MiniZK
Cluster and connect 1 ZK server on client port: 60055
...
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:host.name
=localhost
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_45
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/java/jdk1.7.0_45/jre
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
...
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:os.version=3.5.0-42-generic
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:user.name
=mary
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/mary
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=20000 watcher=master:49556
13/11/06 10:32:23 INFO zookeeper.RecoverableZooKeeper: The identifier of
this process is 3297@mary-ISTART-2380
13/11/06 10:32:23 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
13/11/06 10:32:23 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
    at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
13/11/06 10:32:23 WARN zookeeper.RecoverableZooKeeper: Possibly transient
ZooKeeper exception:
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase
13/11/06 10:32:23 INFO util.RetryCounter: Sleeping 2000ms before retry #1...

Based on the way we run the instance and the zoo.cfg, I wonder if anyone
can point out to me what I need to do (config-wise?) to permit the
connection?

Thank you very much in advance.
Best
Lewis


[0]
https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/java/org/apache/gora/hbase/util/HBaseClusterSingleton.java
[1]
https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/conf/

-- 
*Lewis*

Re: Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9 tests

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Flavio,
Thanks again for your feedback.

On Wed, Nov 6, 2013 at 1:23 PM, Flavio Junqueira <fp...@yahoo.com>wrote:

> I don´t think you need to change the server (client) port, instead you need
> to change the connect string for the client.


I am sorry to come across as ignorant... but how do i do this? is this
configuration driven e.g. within zoo.cfg or do i need to write come code to
do this?


> If you change the server port
> and not the client connect string, then change the client port on the
> server
> to the default value, 2181, because this is the one the client is trying to
> use according to your log.
>
> AFAIK the only zookeeper config i have is within zoo.cfg with
clientPort=2181

Thanks again fro your time Flavio.
Best
Lewis

RE: Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9 tests

Posted by Flavio Junqueira <fp...@yahoo.com>.
I don´t think you need to change the server (client) port, instead you need
to change the connect string for the client. If you change the server port
and not the client connect string, then change the client port on the server
to the default value, 2181, because this is the one the client is trying to
use according to your log.

-Flavio

-----Original Message-----
From: Lewis John Mcgibbney [mailto:lewis.mcgibbney@gmail.com] 
Sent: 06 November 2013 13:18
To: user@zookeeper.apache.org
Subject: Re: Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9
tests

Hi Flavio,
Thanks for the feedback.
I tried changing the server port configuration in zoo.cfg to patch the
previous however Zookeeper then assigns a different client port regardless.

Is there anything else I should add to zoo.cfg apart from the following?
All I require is one server running locally.

tickTime=2000
dataDir=${user.dir}/zookeeper
clientPort=65144
maxClientCnxns=300
server.0=localhost:2888:3888

Thanks for the feedback Falvio. Much appreciated.
Best
Lewis


On Wed, Nov 6, 2013 at 11:02 AM, Flavio Junqueira
<fp...@yahoo.com>wrote:

> The server seems to be binding to a different than the one the client 
> is trying to connect to:
>
> >> Started MiniZK
> >> Cluster and connect 1 ZK server on client port: 60055
>
>
> >> Opening socket connection to
> >> server localhost/127.0.0.1:2181. Will not attempt to authenticate 
> >> using SASL (unknown error)
>
>
> -Flavio
>
> On Nov 6, 2013, at 11:54 AM, Lewis John Mcgibbney < 
> lewis.mcgibbney@gmail.com> wrote:
>
> > For anyone who's interested the full build output in all its glory 
> > can be found here
> >
> https://builds.apache.org/job/GORA_94_BRANCH/134/org.apache.gora$gora-
> hbase/consoleText
> > Thanks again for any help that comes my way.
> > Best
> > Lewis
> >
> >
> > On Wed, Nov 6, 2013 at 10:53 AM, Lewis John Mcgibbney < 
> > lewis.mcgibbney@gmail.com> wrote:
> >
> >> Hi Zookeepers,
> >> I'm in the process of upgrading the HBase version over in Apache 
> >> Gora
> from
> >> 0.90.4 to 0.94.9.
> >> For our test suite we use an embedded HBase cluster [0]. The
> configuration
> >> for which can also be seen here [1].
> >> When I attempt to initiate the HBase cluster, I get the following 
> >> output (I've removed the classpath entries for brevity).
> >>
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 
> >> 17:52
> GMT
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> >> host.name=localhost
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.version=1.7.0_45
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:java.vendor=Oracle Corporation
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:java.home=/usr/java/jdk1.7.0_45/jre
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >>
>
environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/t
arget/test-classes:
> >> ...
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr
> >> /lib
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:java.io.tmpdir=/tmp
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:java.compiler=<NA>
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> os.name
> >> =Linux
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:os.arch=i386
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:os.version=3.5.0-42-generic
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> >> user.name=mary
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:user.home=/home/mary
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server 
> >> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Created server with 
> >> tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 
> >> datadir
> >>
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a3
> 8c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c73
> 1f728cd8/zookeeper_0/version-2
> >> snapdir
> >>
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a3
> 8c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c73
> 1f728cd8/zookeeper_0/version-2
> >> 13/11/06 10:32:21 INFO server.NIOServerCnxnFactory: binding to port
> >> 0.0.0.0/0.0.0.0:60055
> >> 13/11/06 10:32:22 INFO persistence.FileTxnSnapLog: Snapshotting: 
> >> 0x0 to
> >>
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a3
> 8c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c73
> 1f728cd8/zookeeper_0/version-2/snapshot.0
> >> 13/11/06 10:32:22 INFO server.NIOServerCnxnFactory: Accepted socket 
> >> connection from /127.0.0.1:44504
> >> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Processing stat 
> >> command
> from /
> >> 127.0.0.1:44504
> >> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Stat command output
> >> 13/11/06 10:32:22 INFO zookeeper.MiniZooKeeperCluster: Started 
> >> MiniZK Cluster and connect 1 ZK server on client port: 60055 ...
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 
> >> 17:52
> GMT
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:
> host.name
> >> =localhost
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.version=1.7.0_45
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:java.vendor=Oracle Corporation
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:java.home=/usr/java/jdk1.7.0_45/jre
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >>
>
environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/t
arget/test-classes:
> >> ...
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr
> >> /lib
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:java.io.tmpdir=/tmp
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:java.compiler=<NA>
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:os.name =Linux
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=i386
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:os.version=3.5.0-42-generic
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:
> user.name
> >> =mary
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:user.home=/home/mary
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client 
> >> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Initiating client
> connection,
> >> connectString=localhost:2181 sessionTimeout=20000 
> >> watcher=master:49556
> >> 13/11/06 10:32:23 INFO zookeeper.RecoverableZooKeeper: The 
> >> identifier of this process is 3297@mary-ISTART-2380
> >> 13/11/06 10:32:23 INFO zookeeper.ClientCnxn: Opening socket 
> >> connection
> to
> >> server localhost/127.0.0.1:2181. Will not attempt to authenticate 
> >> using SASL (unknown error)
> >> 13/11/06 10:32:23 WARN zookeeper.ClientCnxn: Session 0x0 for server
> null,
> >> unexpected error, closing socket connection and attempting 
> >> reconnect
> >> java.net.ConnectException: Connection refused
> >>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> >>    at
> >> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
> >>    at
> >>
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketN
> IO.java:350)
> >>    at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> >> 13/11/06 10:32:23 WARN zookeeper.RecoverableZooKeeper: Possibly
> transient
> >> ZooKeeper exception:
> >> org.apache.zookeeper.KeeperException$ConnectionLossException:
> >> KeeperErrorCode = ConnectionLoss for /hbase
> >> 13/11/06 10:32:23 INFO util.RetryCounter: Sleeping 2000ms before 
> >> retry #1...
> >>
> >> Based on the way we run the instance and the zoo.cfg, I wonder if 
> >> anyone can point out to me what I need to do (config-wise?) to 
> >> permit the connection?
> >>
> >> Thank you very much in advance.
> >> Best
> >> Lewis
> >>
> >>
> >> [0]
> >>
> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/
> test/java/org/apache/gora/hbase/util/HBaseClusterSingleton.java
> >> [1]
> >>
> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/
> test/conf/
> >>
> >> --
> >> *Lewis*
> >>
> >
> >
> >
> > --
> > *Lewis*
>
>


--
*Lewis*


Re: Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9 tests

Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Flavio,
Thanks for the feedback.
I tried changing the server port configuration in zoo.cfg to patch the
previous however Zookeeper then assigns a different client port regardless.

Is there anything else I should add to zoo.cfg apart from the following?
All I require is one server running locally.

tickTime=2000
dataDir=${user.dir}/zookeeper
clientPort=65144
maxClientCnxns=300
server.0=localhost:2888:3888

Thanks for the feedback Falvio. Much appreciated.
Best
Lewis


On Wed, Nov 6, 2013 at 11:02 AM, Flavio Junqueira <fp...@yahoo.com>wrote:

> The server seems to be binding to a different than the one the client is
> trying to connect to:
>
> >> Started MiniZK
> >> Cluster and connect 1 ZK server on client port: 60055
>
>
> >> Opening socket connection to
> >> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> >> SASL (unknown error)
>
>
> -Flavio
>
> On Nov 6, 2013, at 11:54 AM, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
>
> > For anyone who's interested the full build output in all its glory can be
> > found here
> >
> https://builds.apache.org/job/GORA_94_BRANCH/134/org.apache.gora$gora-hbase/consoleText
> > Thanks again for any help that comes my way.
> > Best
> > Lewis
> >
> >
> > On Wed, Nov 6, 2013 at 10:53 AM, Lewis John Mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> >> Hi Zookeepers,
> >> I'm in the process of upgrading the HBase version over in Apache Gora
> from
> >> 0.90.4 to 0.94.9.
> >> For our test suite we use an embedded HBase cluster [0]. The
> configuration
> >> for which can also be seen here [1].
> >> When I attempt to initiate the HBase cluster, I get the following output
> >> (I've removed the classpath entries for brevity).
> >>
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52
> GMT
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> >> host.name=localhost
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.version=1.7.0_45
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.vendor=Oracle Corporation
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.home=/usr/java/jdk1.7.0_45/jre
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >>
> environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
> >> ...
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.io.tmpdir=/tmp
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:java.compiler=<NA>
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> os.name
> >> =Linux
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:os.arch=i386
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:os.version=3.5.0-42-generic
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> >> user.name=mary
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:user.home=/home/mary
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> >> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
> >> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Created server with
> >> tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir
> >>
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
> >> snapdir
> >>
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
> >> 13/11/06 10:32:21 INFO server.NIOServerCnxnFactory: binding to port
> >> 0.0.0.0/0.0.0.0:60055
> >> 13/11/06 10:32:22 INFO persistence.FileTxnSnapLog: Snapshotting: 0x0 to
> >>
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2/snapshot.0
> >> 13/11/06 10:32:22 INFO server.NIOServerCnxnFactory: Accepted socket
> >> connection from /127.0.0.1:44504
> >> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Processing stat command
> from /
> >> 127.0.0.1:44504
> >> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Stat command output
> >> 13/11/06 10:32:22 INFO zookeeper.MiniZooKeeperCluster: Started MiniZK
> >> Cluster and connect 1 ZK server on client port: 60055
> >> ...
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52
> GMT
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:
> host.name
> >> =localhost
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.version=1.7.0_45
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.vendor=Oracle Corporation
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.home=/usr/java/jdk1.7.0_45/jre
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >>
> environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
> >> ...
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.io.tmpdir=/tmp
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:java.compiler=<NA>
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.name
> >> =Linux
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=i386
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:os.version=3.5.0-42-generic
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:
> user.name
> >> =mary
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:user.home=/home/mary
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> >> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
> >> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Initiating client
> connection,
> >> connectString=localhost:2181 sessionTimeout=20000 watcher=master:49556
> >> 13/11/06 10:32:23 INFO zookeeper.RecoverableZooKeeper: The identifier of
> >> this process is 3297@mary-ISTART-2380
> >> 13/11/06 10:32:23 INFO zookeeper.ClientCnxn: Opening socket connection
> to
> >> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> >> SASL (unknown error)
> >> 13/11/06 10:32:23 WARN zookeeper.ClientCnxn: Session 0x0 for server
> null,
> >> unexpected error, closing socket connection and attempting reconnect
> >> java.net.ConnectException: Connection refused
> >>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> >>    at
> >> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
> >>    at
> >>
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> >>    at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> >> 13/11/06 10:32:23 WARN zookeeper.RecoverableZooKeeper: Possibly
> transient
> >> ZooKeeper exception:
> >> org.apache.zookeeper.KeeperException$ConnectionLossException:
> >> KeeperErrorCode = ConnectionLoss for /hbase
> >> 13/11/06 10:32:23 INFO util.RetryCounter: Sleeping 2000ms before retry
> >> #1...
> >>
> >> Based on the way we run the instance and the zoo.cfg, I wonder if anyone
> >> can point out to me what I need to do (config-wise?) to permit the
> >> connection?
> >>
> >> Thank you very much in advance.
> >> Best
> >> Lewis
> >>
> >>
> >> [0]
> >>
> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/java/org/apache/gora/hbase/util/HBaseClusterSingleton.java
> >> [1]
> >>
> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/conf/
> >>
> >> --
> >> *Lewis*
> >>
> >
> >
> >
> > --
> > *Lewis*
>
>


-- 
*Lewis*

Re: Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9 tests

Posted by Flavio Junqueira <fp...@yahoo.com>.
The server seems to be binding to a different than the one the client is trying to connect to:

>> Started MiniZK
>> Cluster and connect 1 ZK server on client port: 60055


>> Opening socket connection to
>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>> SASL (unknown error)


-Flavio

On Nov 6, 2013, at 11:54 AM, Lewis John Mcgibbney <le...@gmail.com> wrote:

> For anyone who's interested the full build output in all its glory can be
> found here
> https://builds.apache.org/job/GORA_94_BRANCH/134/org.apache.gora$gora-hbase/consoleText
> Thanks again for any help that comes my way.
> Best
> Lewis
> 
> 
> On Wed, Nov 6, 2013 at 10:53 AM, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
> 
>> Hi Zookeepers,
>> I'm in the process of upgrading the HBase version over in Apache Gora from
>> 0.90.4 to 0.94.9.
>> For our test suite we use an embedded HBase cluster [0]. The configuration
>> for which can also be seen here [1].
>> When I attempt to initiate the HBase cluster, I get the following output
>> (I've removed the classpath entries for brevity).
>> 
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
>> host.name=localhost
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.version=1.7.0_45
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.vendor=Oracle Corporation
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.home=/usr/java/jdk1.7.0_45/jre
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
>> ...
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.io.tmpdir=/tmp
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:java.compiler=<NA>
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:os.name
>> =Linux
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:os.arch=i386
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:os.version=3.5.0-42-generic
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
>> user.name=mary
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:user.home=/home/mary
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
>> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
>> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Created server with
>> tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir
>> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
>> snapdir
>> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
>> 13/11/06 10:32:21 INFO server.NIOServerCnxnFactory: binding to port
>> 0.0.0.0/0.0.0.0:60055
>> 13/11/06 10:32:22 INFO persistence.FileTxnSnapLog: Snapshotting: 0x0 to
>> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2/snapshot.0
>> 13/11/06 10:32:22 INFO server.NIOServerCnxnFactory: Accepted socket
>> connection from /127.0.0.1:44504
>> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Processing stat command from /
>> 127.0.0.1:44504
>> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Stat command output
>> 13/11/06 10:32:22 INFO zookeeper.MiniZooKeeperCluster: Started MiniZK
>> Cluster and connect 1 ZK server on client port: 60055
>> ...
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:host.name
>> =localhost
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.version=1.7.0_45
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.vendor=Oracle Corporation
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.home=/usr/java/jdk1.7.0_45/jre
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
>> ...
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.io.tmpdir=/tmp
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:java.compiler=<NA>
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.name
>> =Linux
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:os.version=3.5.0-42-generic
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:user.name
>> =mary
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:user.home=/home/mary
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
>> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
>> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Initiating client connection,
>> connectString=localhost:2181 sessionTimeout=20000 watcher=master:49556
>> 13/11/06 10:32:23 INFO zookeeper.RecoverableZooKeeper: The identifier of
>> this process is 3297@mary-ISTART-2380
>> 13/11/06 10:32:23 INFO zookeeper.ClientCnxn: Opening socket connection to
>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>> SASL (unknown error)
>> 13/11/06 10:32:23 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
>> unexpected error, closing socket connection and attempting reconnect
>> java.net.ConnectException: Connection refused
>>    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>    at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
>>    at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>>    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>> 13/11/06 10:32:23 WARN zookeeper.RecoverableZooKeeper: Possibly transient
>> ZooKeeper exception:
>> org.apache.zookeeper.KeeperException$ConnectionLossException:
>> KeeperErrorCode = ConnectionLoss for /hbase
>> 13/11/06 10:32:23 INFO util.RetryCounter: Sleeping 2000ms before retry
>> #1...
>> 
>> Based on the way we run the instance and the zoo.cfg, I wonder if anyone
>> can point out to me what I need to do (config-wise?) to permit the
>> connection?
>> 
>> Thank you very much in advance.
>> Best
>> Lewis
>> 
>> 
>> [0]
>> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/java/org/apache/gora/hbase/util/HBaseClusterSingleton.java
>> [1]
>> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/conf/
>> 
>> --
>> *Lewis*
>> 
> 
> 
> 
> -- 
> *Lewis*


Re: Struggling to use Zookeeper 3.4.5-1392090 for HBase 0.94.9 tests

Posted by Lewis John Mcgibbney <le...@gmail.com>.
For anyone who's interested the full build output in all its glory can be
found here
https://builds.apache.org/job/GORA_94_BRANCH/134/org.apache.gora$gora-hbase/consoleText
Thanks again for any help that comes my way.
Best
Lewis


On Wed, Nov 6, 2013 at 10:53 AM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:

> Hi Zookeepers,
> I'm in the process of upgrading the HBase version over in Apache Gora from
> 0.90.4 to 0.94.9.
> For our test suite we use an embedded HBase cluster [0]. The configuration
> for which can also be seen here [1].
> When I attempt to initiate the HBase cluster, I get the following output
> (I've removed the classpath entries for brevity).
>
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> host.name=localhost
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.version=1.7.0_45
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.vendor=Oracle Corporation
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.home=/usr/java/jdk1.7.0_45/jre
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
> ...
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.io.tmpdir=/tmp
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:java.compiler=<NA>
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:os.name
> =Linux
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:os.arch=i386
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:os.version=3.5.0-42-generic
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server environment:
> user.name=mary
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:user.home=/home/mary
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Server
> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
> 13/11/06 10:32:21 INFO server.ZooKeeperServer: Created server with
> tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
> snapdir
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2
> 13/11/06 10:32:21 INFO server.NIOServerCnxnFactory: binding to port
> 0.0.0.0/0.0.0.0:60055
> 13/11/06 10:32:22 INFO persistence.FileTxnSnapLog: Snapshotting: 0x0 to
> /home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-data/8f63a38c-2dcf-4b7a-91a3-f4e7100fa06f/dfscluster_9f234a3d-96ad-49c7-a46e-3c731f728cd8/zookeeper_0/version-2/snapshot.0
> 13/11/06 10:32:22 INFO server.NIOServerCnxnFactory: Accepted socket
> connection from /127.0.0.1:44504
> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Processing stat command from /
> 127.0.0.1:44504
> 13/11/06 10:32:22 INFO server.NIOServerCnxn: Stat command output
> 13/11/06 10:32:22 INFO zookeeper.MiniZooKeeperCluster: Started MiniZK
> Cluster and connect 1 ZK server on client port: 60055
> ...
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:host.name
> =localhost
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.version=1.7.0_45
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.vendor=Oracle Corporation
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.home=/usr/java/jdk1.7.0_45/jre
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.class.path=/home/mary/Downloads/apache/GORA_94/gora-hbase/target/test-classes:
> ...
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/tmp
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.name
> =Linux
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:os.version=3.5.0-42-generic
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client environment:user.name
> =mary
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/home/mary
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/home/mary/Downloads/apache/GORA_94/gora-hbase
> 13/11/06 10:32:23 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:2181 sessionTimeout=20000 watcher=master:49556
> 13/11/06 10:32:23 INFO zookeeper.RecoverableZooKeeper: The identifier of
> this process is 3297@mary-ISTART-2380
> 13/11/06 10:32:23 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (unknown error)
> 13/11/06 10:32:23 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)
>     at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 13/11/06 10:32:23 WARN zookeeper.RecoverableZooKeeper: Possibly transient
> ZooKeeper exception:
> org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase
> 13/11/06 10:32:23 INFO util.RetryCounter: Sleeping 2000ms before retry
> #1...
>
> Based on the way we run the instance and the zoo.cfg, I wonder if anyone
> can point out to me what I need to do (config-wise?) to permit the
> connection?
>
> Thank you very much in advance.
> Best
> Lewis
>
>
> [0]
> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/java/org/apache/gora/hbase/util/HBaseClusterSingleton.java
> [1]
> https://svn.apache.org/repos/asf/gora/branches/GORA_94/gora-hbase/src/test/conf/
>
> --
> *Lewis*
>



-- 
*Lewis*