You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by 74...@gmail.com on 2016/12/08 08:49:03 UTC
zookeeper is null
Hello,
I have and error i can't understand and resolve i think it was cause by this:
client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
My project was to use nutch crawler with hadoop and hbase.
I have start hbase ,yarn and dfs
I when i start a job like Injector Job for nutch, nothing hapend.
I have this writing on the console.
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/opt/hadoop/lib/native
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:os.version=4.4.0-45-generic
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:user.dir=/opt/hadoop
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x75cf7815, quorum=localhost:2181, baseZNode=/hbase
16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x58bf6bd3390001, negotiated timeout = 90000
16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to ZooKeeper ensemble=localhost:2181
16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=catalogtracker-on-hconnection-0x75cf7815, quorum=localhost:2181, baseZNode=/hbase
16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x58bf6bd3390002, negotiated timeout = 90000
my hbase-site.xml configuration is:
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://fontana-04:9000/opt/hbase</value>
</property>
<property>
<name>hbase.security.authentication</name>
<value>simple</value>
</property>
<property>
<name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>fontana-04,fontana-03</value>
</property>
<property>
<name>hbase.client.keyvalue.maxsize</name>
<value>0</value>
</property>
<property>
<name>zookeeper.znode.parent</name>
<value>/hbase</value>
</property>
</configuration>
Re: zookeeper is null
Posted by Ted Yu <yu...@gmail.com>.
From the config snippet Vincent posted, he was using only one zookeeper
server.
Vincent:
Can you replace localhost with the hostname where the zookeeper process
runs ?
Feel free to pastebin related logs if you still have issue(s).
Cheers
On Fri, Dec 9, 2016 at 12:11 PM, Josh Elser <jo...@gmail.com> wrote:
> ZooKeeper servers should only be deployed in numbers that can determine
> majorities. 1, 3, 5, etc. If you have only two ZooKeeper servers, they can
> not make a decision on elections.
>
> Would recommend that you use only one ZK server if you only have two nodes.
>
>
> Vincent Fontana wrote:
>
>> I started this project a few week ago.Thus I use only 2 computer at the
>> moment (probably more afterward when it works).
>>
>> I have change the configuration to:
>> <configuration>
>> <property>
>> <name>hbase.cluster.distributed</name>
>> <value>true</value>
>> </property>
>> <property>
>> <name>hbase.rootdir</name>
>> <value>hdfs://fontana-04:9000/opt/hbase</value>
>> </property>
>> <property>
>> <name>hbase.security.authentication</name>
>> <value>simple</value>
>> </property>
>> <property>
>> <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
>> <value>true</value>
>> </property>
>> <property>
>> <name>hbase.zookeeper.quorum</name>
>> <value>localhost:2181</value>
>> </property>
>> <property>
>> <name>hbase.client.keyvalue.maxsize</name>
>> <value>0</value>
>> </property>
>> <property>
>> <name>zookeeper.znode.parent</name>
>> <value>/hbase</value>
>> </property>
>> </configuration>
>>
>> and i have remove fontana-03 to slave, regionserver and quorum for more
>> clarity.
>>
>> Did i have make something wrong in other file or it was zookeeper?
>>
>>
>> the 2 error was:
>> WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error,
>> closing socket connection and attempting reconnect
>>
>> zookeeper.ClientCnxn: Opening socket connection to server localhost/
>> 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
>> error)
>>
>>
>>
>> 2016-12-08 11:49 GMT+01:00 Ted Yu<yu...@gmail.com>:
>>
>> Please check the zookeeper server logs to see what might be happening.
>>>
>>> bq. fontana-04,fontana-03
>>>
>>> Why only two servers in the quorum ? Can you add one more zookeeper
>>> server
>>> ?
>>>
>>> Cheers
>>>
>>> On Thu, Dec 8, 2016 at 1:18 AM, Vincent Fontana<74...@gmail.com>
>>> wrote:
>>>
>>> now i have this...
>>>>
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:java.library.path=/opt/hadoop/lib/native
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:java.io.tmpdir=/tmp
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:java.compiler=<NA>
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name
>>>> =Linux
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:os.arch=amd64
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:os.version=4.4.0-51-generic
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:
>>>> user.name
>>>> =hadoop
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:user.home=/home/hadoop
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>>> environment:user.dir=/opt/hadoop
>>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client
>>>> connection,
>>>> connectString=localhost:2181 sessionTimeout=90000
>>>> watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
>>>> 16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection
>>>> to
>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>>>> SASL (unknown error)
>>>> 16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server
>>>> null,
>>>> unexpected error, closing socket connection and attempting reconnect
>>>> java.net.ConnectException: Connexion refusée
>>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>>> at
>>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
>>>> at
>>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>>> ClientCnxnSocketNIO.java:361)
>>>> at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>>> ClientCnxn.java:1081)
>>>> 16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly
>>>>
>>> transient
>>>
>>>> ZooKeeper, quorum=localhost:2181,
>>>> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>>>> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>>>> 16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry
>>>> #0...
>>>> 16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection
>>>> to
>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>>>> SASL (unknown error)
>>>> 16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server
>>>> null,
>>>> unexpected error, closing socket connection and attempting reconnect
>>>> java.net.ConnectException: Connexion refusée
>>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>>> at
>>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
>>>> at
>>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>>> ClientCnxnSocketNIO.java:361)
>>>> at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>>> ClientCnxn.java:1081)
>>>> 16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly
>>>>
>>> transient
>>>
>>>> ZooKeeper, quorum=localhost:2181,
>>>> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>>>> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>>>> 16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry
>>>> #1...
>>>>
>>>>
>>>> 2016-12-08 10:02 GMT+01:00 Sandeep Nemuri<nh...@gmail.com>:
>>>>
>>>> Looks like your project is unable to pick zookeeper and zk node details
>>>>> which are in hbase-site.xml.
>>>>>
>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>>
>>>>> On Thu, Dec 8, 2016 at 2:19 PM,<74...@gmail.com> wrote:
>>>>>
>>>>> Hello,
>>>>>>
>>>>>> I have and error i can't understand and resolve i think it was cause
>>>>>>
>>>>> by
>>>
>>>> this:
>>>>>> client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
>>>>>>
>>>>>> My project was to use nutch crawler with hadoop and hbase.
>>>>>> I have start hbase ,yarn and dfs
>>>>>> I when i start a job like Injector Job for nutch, nothing hapend.
>>>>>>
>>>>>> I have this writing on the console.
>>>>>>
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:java.library.path=/opt/hadoop/lib/native
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:java.io.tmpdir=/tmp
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:java.compiler=<NA>
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
>>>>>>
>>>>> os.name
>>>
>>>> =Linux
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:os.arch=amd64
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:os.version=4.4.0-45-generic
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
>>>>>>
>>>>> user.name
>>>>
>>>>> =hadoop
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:user.home=/home/hadoop
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>>> environment:user.dir=/opt/hadoop
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client
>>>>>>
>>>>> connection,
>>>>
>>>>> connectString=localhost:2181 sessionTimeout=90000
>>>>>>
>>>>> watcher=hconnection-
>>>
>>>> 0x75cf7815,
>>>>>
>>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket
>>>>>>
>>>>> connection
>>>
>>>> to
>>>>
>>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate
>>>>>>
>>>>> using
>>>>
>>>>> SASL (unknown error)
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
>>>>>>
>>>>> established
>>>>>
>>>>>> to localhost/127.0.0.1:2181, initiating session
>>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
>>>>>> complete on server localhost/127.0.0.1:2181, sessionid =
>>>>>> 0x58bf6bd3390001, negotiated timeout = 90000
>>>>>> 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
>>>>>> ZooKeeper is null
>>>>>> 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib
>>>>>>
>>>>> is
>>>
>>>> deprecated. Instead, use io.native.lib.available
>>>>>> 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
>>>>>> identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
>>>>>> ZooKeeper ensemble=localhost:2181
>>>>>> 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client
>>>>>>
>>>>> connection,
>>>>
>>>>> connectString=localhost:2181 sessionTimeout=90000
>>>>>>
>>>>> watcher=catalogtracker-on-hconnection-0x75cf7815,
>>>>>
>>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket
>>>>>>
>>>>> connection
>>>
>>>> to
>>>>
>>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate
>>>>>>
>>>>> using
>>>>
>>>>> SASL (unknown error)
>>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
>>>>>>
>>>>> established
>>>>>
>>>>>> to localhost/127.0.0.1:2181, initiating session
>>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
>>>>>> complete on server localhost/127.0.0.1:2181, sessionid =
>>>>>> 0x58bf6bd3390002, negotiated timeout = 90000
>>>>>>
>>>>>> my hbase-site.xml configuration is:
>>>>>> <configuration>
>>>>>> <property>
>>>>>> <name>hbase.cluster.distributed</name>
>>>>>> <value>true</value>
>>>>>> </property>
>>>>>> <property>
>>>>>> <name>hbase.rootdir</name>
>>>>>> <value>hdfs://fontana-04:9000/opt/hbase</value>
>>>>>> </property>
>>>>>> <property>
>>>>>> <name>hbase.security.authentication</name>
>>>>>> <value>simple</value>
>>>>>> </property>
>>>>>> <property>
>>>>>> <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
>>>>>> <value>true</value>
>>>>>> </property>
>>>>>> <property>
>>>>>> <name>hbase.zookeeper.quorum</name>
>>>>>> <value>fontana-04,fontana-03</value>
>>>>>> </property>
>>>>>> <property>
>>>>>> <name>hbase.client.keyvalue.maxsize</name>
>>>>>> <value>0</value>
>>>>>> </property>
>>>>>> <property>
>>>>>> <name>zookeeper.znode.parent</name>
>>>>>> <value>/hbase</value>
>>>>>> </property>
>>>>>> </configuration>
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> * Regards*
>>>>> * Sandeep Nemuri*
>>>>>
>>>>>
>>
Re: zookeeper is null
Posted by Josh Elser <jo...@gmail.com>.
ZooKeeper servers should only be deployed in numbers that can determine
majorities. 1, 3, 5, etc. If you have only two ZooKeeper servers, they
can not make a decision on elections.
Would recommend that you use only one ZK server if you only have two nodes.
Vincent Fontana wrote:
> I started this project a few week ago.Thus I use only 2 computer at the
> moment (probably more afterward when it works).
>
> I have change the configuration to:
> <configuration>
> <property>
> <name>hbase.cluster.distributed</name>
> <value>true</value>
> </property>
> <property>
> <name>hbase.rootdir</name>
> <value>hdfs://fontana-04:9000/opt/hbase</value>
> </property>
> <property>
> <name>hbase.security.authentication</name>
> <value>simple</value>
> </property>
> <property>
> <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
> <value>true</value>
> </property>
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>localhost:2181</value>
> </property>
> <property>
> <name>hbase.client.keyvalue.maxsize</name>
> <value>0</value>
> </property>
> <property>
> <name>zookeeper.znode.parent</name>
> <value>/hbase</value>
> </property>
> </configuration>
>
> and i have remove fontana-03 to slave, regionserver and quorum for more
> clarity.
>
> Did i have make something wrong in other file or it was zookeeper?
>
>
> the 2 error was:
> WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error,
> closing socket connection and attempting reconnect
>
> zookeeper.ClientCnxn: Opening socket connection to server localhost/
> 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
>
>
>
> 2016-12-08 11:49 GMT+01:00 Ted Yu<yu...@gmail.com>:
>
>> Please check the zookeeper server logs to see what might be happening.
>>
>> bq. fontana-04,fontana-03
>>
>> Why only two servers in the quorum ? Can you add one more zookeeper server
>> ?
>>
>> Cheers
>>
>> On Thu, Dec 8, 2016 at 1:18 AM, Vincent Fontana<74...@gmail.com> wrote:
>>
>>> now i have this...
>>>
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:java.library.path=/opt/hadoop/lib/native
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:java.io.tmpdir=/tmp
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:java.compiler=<NA>
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name
>>> =Linux
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:os.arch=amd64
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:os.version=4.4.0-51-generic
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:user.name
>>> =hadoop
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:user.home=/home/hadoop
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
>>> environment:user.dir=/opt/hadoop
>>> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client connection,
>>> connectString=localhost:2181 sessionTimeout=90000
>>> watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
>>> 16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection to
>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>>> SASL (unknown error)
>>> 16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
>>> unexpected error, closing socket connection and attempting reconnect
>>> java.net.ConnectException: Connexion refus�e
>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>> at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
>>> at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>> ClientCnxnSocketNIO.java:361)
>>> at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>> ClientCnxn.java:1081)
>>> 16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly
>> transient
>>> ZooKeeper, quorum=localhost:2181,
>>> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>>> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>>> 16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry
>>> #0...
>>> 16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection to
>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
>>> SASL (unknown error)
>>> 16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
>>> unexpected error, closing socket connection and attempting reconnect
>>> java.net.ConnectException: Connexion refus�e
>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>> at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
>>> at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
>>> ClientCnxnSocketNIO.java:361)
>>> at org.apache.zookeeper.ClientCnxn$SendThread.run(
>>> ClientCnxn.java:1081)
>>> 16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly
>> transient
>>> ZooKeeper, quorum=localhost:2181,
>>> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>>> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>>> 16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry
>>> #1...
>>>
>>>
>>> 2016-12-08 10:02 GMT+01:00 Sandeep Nemuri<nh...@gmail.com>:
>>>
>>>> Looks like your project is unable to pick zookeeper and zk node details
>>>> which are in hbase-site.xml.
>>>>
>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>
>>>> On Thu, Dec 8, 2016 at 2:19 PM,<74...@gmail.com> wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> I have and error i can't understand and resolve i think it was cause
>> by
>>>>> this:
>>>>> client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
>>>>>
>>>>> My project was to use nutch crawler with hadoop and hbase.
>>>>> I have start hbase ,yarn and dfs
>>>>> I when i start a job like Injector Job for nutch, nothing hapend.
>>>>>
>>>>> I have this writing on the console.
>>>>>
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.library.path=/opt/hadoop/lib/native
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.io.tmpdir=/tmp
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.compiler=<NA>
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
>> os.name
>>>>> =Linux
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:os.arch=amd64
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:os.version=4.4.0-45-generic
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
>>> user.name
>>>>> =hadoop
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:user.home=/home/hadoop
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
>>>>> environment:user.dir=/opt/hadoop
>>>>> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client
>>> connection,
>>>>> connectString=localhost:2181 sessionTimeout=90000
>> watcher=hconnection-
>>>> 0x75cf7815,
>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket
>> connection
>>> to
>>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate
>>> using
>>>>> SASL (unknown error)
>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
>>>> established
>>>>> to localhost/127.0.0.1:2181, initiating session
>>>>> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
>>>>> complete on server localhost/127.0.0.1:2181, sessionid =
>>>>> 0x58bf6bd3390001, negotiated timeout = 90000
>>>>> 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
>>>>> ZooKeeper is null
>>>>> 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib
>> is
>>>>> deprecated. Instead, use io.native.lib.available
>>>>> 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
>>>>> identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
>>>>> ZooKeeper ensemble=localhost:2181
>>>>> 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client
>>> connection,
>>>>> connectString=localhost:2181 sessionTimeout=90000
>>>> watcher=catalogtracker-on-hconnection-0x75cf7815,
>>>>> quorum=localhost:2181, baseZNode=/hbase
>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket
>> connection
>>> to
>>>>> server localhost/127.0.0.1:2181. Will not attempt to authenticate
>>> using
>>>>> SASL (unknown error)
>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
>>>> established
>>>>> to localhost/127.0.0.1:2181, initiating session
>>>>> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
>>>>> complete on server localhost/127.0.0.1:2181, sessionid =
>>>>> 0x58bf6bd3390002, negotiated timeout = 90000
>>>>>
>>>>> my hbase-site.xml configuration is:
>>>>> <configuration>
>>>>> <property>
>>>>> <name>hbase.cluster.distributed</name>
>>>>> <value>true</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>hbase.rootdir</name>
>>>>> <value>hdfs://fontana-04:9000/opt/hbase</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>hbase.security.authentication</name>
>>>>> <value>simple</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
>>>>> <value>true</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>hbase.zookeeper.quorum</name>
>>>>> <value>fontana-04,fontana-03</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>hbase.client.keyvalue.maxsize</name>
>>>>> <value>0</value>
>>>>> </property>
>>>>> <property>
>>>>> <name>zookeeper.znode.parent</name>
>>>>> <value>/hbase</value>
>>>>> </property>
>>>>> </configuration>
>>>>>
>>>>
>>>>
>>>> --
>>>> * Regards*
>>>> * Sandeep Nemuri*
>>>>
>
Re: zookeeper is null
Posted by Vincent Fontana <74...@gmail.com>.
I started this project a few week ago.Thus I use only 2 computer at the
moment (probably more afterward when it works).
I have change the configuration to:
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://fontana-04:9000/opt/hbase</value>
</property>
<property>
<name>hbase.security.authentication</name>
<value>simple</value>
</property>
<property>
<name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>localhost:2181</value>
</property>
<property>
<name>hbase.client.keyvalue.maxsize</name>
<value>0</value>
</property>
<property>
<name>zookeeper.znode.parent</name>
<value>/hbase</value>
</property>
</configuration>
and i have remove fontana-03 to slave, regionserver and quorum for more
clarity.
Did i have make something wrong in other file or it was zookeeper?
the 2 error was:
WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error,
closing socket connection and attempting reconnect
zookeeper.ClientCnxn: Opening socket connection to server localhost/
127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2016-12-08 11:49 GMT+01:00 Ted Yu <yu...@gmail.com>:
> Please check the zookeeper server logs to see what might be happening.
>
> bq. fontana-04,fontana-03
>
> Why only two servers in the quorum ? Can you add one more zookeeper server
> ?
>
> Cheers
>
> On Thu, Dec 8, 2016 at 1:18 AM, Vincent Fontana <74...@gmail.com> wrote:
>
> > now i have this...
> >
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:java.library.path=/opt/hadoop/lib/native
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:java.io.tmpdir=/tmp
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:java.compiler=<NA>
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name
> > =Linux
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:os.arch=amd64
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:os.version=4.4.0-51-generic
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:user.name
> > =hadoop
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:user.home=/home/hadoop
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> > environment:user.dir=/opt/hadoop
> > 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client connection,
> > connectString=localhost:2181 sessionTimeout=90000
> > watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
> > 16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection to
> > server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> > SASL (unknown error)
> > 16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> > unexpected error, closing socket connection and attempting reconnect
> > java.net.ConnectException: Connexion refusée
> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > at
> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
> > at
> > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > ClientCnxnSocketNIO.java:361)
> > at org.apache.zookeeper.ClientCnxn$SendThread.run(
> > ClientCnxn.java:1081)
> > 16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly
> transient
> > ZooKeeper, quorum=localhost:2181,
> > exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
> > KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
> > 16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry
> > #0...
> > 16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection to
> > server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> > SASL (unknown error)
> > 16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> > unexpected error, closing socket connection and attempting reconnect
> > java.net.ConnectException: Connexion refusée
> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > at
> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
> > at
> > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > ClientCnxnSocketNIO.java:361)
> > at org.apache.zookeeper.ClientCnxn$SendThread.run(
> > ClientCnxn.java:1081)
> > 16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly
> transient
> > ZooKeeper, quorum=localhost:2181,
> > exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
> > KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
> > 16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry
> > #1...
> >
> >
> > 2016-12-08 10:02 GMT+01:00 Sandeep Nemuri <nh...@gmail.com>:
> >
> > > Looks like your project is unable to pick zookeeper and zk node details
> > > which are in hbase-site.xml.
> > >
> > > quorum=localhost:2181, baseZNode=/hbase
> > >
> > > On Thu, Dec 8, 2016 at 2:19 PM, <74...@gmail.com> wrote:
> > >
> > > > Hello,
> > > >
> > > > I have and error i can't understand and resolve i think it was cause
> by
> > > > this:
> > > > client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
> > > >
> > > > My project was to use nutch crawler with hadoop and hbase.
> > > > I have start hbase ,yarn and dfs
> > > > I when i start a job like Injector Job for nutch, nothing hapend.
> > > >
> > > > I have this writing on the console.
> > > >
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:java.library.path=/opt/hadoop/lib/native
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:java.io.tmpdir=/tmp
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:java.compiler=<NA>
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
> os.name
> > > > =Linux
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:os.arch=amd64
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:os.version=4.4.0-45-generic
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
> > user.name
> > > > =hadoop
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:user.home=/home/hadoop
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > > environment:user.dir=/opt/hadoop
> > > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client
> > connection,
> > > > connectString=localhost:2181 sessionTimeout=90000
> watcher=hconnection-
> > > 0x75cf7815,
> > > > quorum=localhost:2181, baseZNode=/hbase
> > > > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket
> connection
> > to
> > > > server localhost/127.0.0.1:2181. Will not attempt to authenticate
> > using
> > > > SASL (unknown error)
> > > > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
> > > established
> > > > to localhost/127.0.0.1:2181, initiating session
> > > > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
> > > > complete on server localhost/127.0.0.1:2181, sessionid =
> > > > 0x58bf6bd3390001, negotiated timeout = 90000
> > > > 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
> > > > ZooKeeper is null
> > > > 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib
> is
> > > > deprecated. Instead, use io.native.lib.available
> > > > 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
> > > > identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
> > > > ZooKeeper ensemble=localhost:2181
> > > > 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client
> > connection,
> > > > connectString=localhost:2181 sessionTimeout=90000
> > > watcher=catalogtracker-on-hconnection-0x75cf7815,
> > > > quorum=localhost:2181, baseZNode=/hbase
> > > > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket
> connection
> > to
> > > > server localhost/127.0.0.1:2181. Will not attempt to authenticate
> > using
> > > > SASL (unknown error)
> > > > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
> > > established
> > > > to localhost/127.0.0.1:2181, initiating session
> > > > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
> > > > complete on server localhost/127.0.0.1:2181, sessionid =
> > > > 0x58bf6bd3390002, negotiated timeout = 90000
> > > >
> > > > my hbase-site.xml configuration is:
> > > > <configuration>
> > > > <property>
> > > > <name>hbase.cluster.distributed</name>
> > > > <value>true</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.rootdir</name>
> > > > <value>hdfs://fontana-04:9000/opt/hbase</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.security.authentication</name>
> > > > <value>simple</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
> > > > <value>true</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.zookeeper.quorum</name>
> > > > <value>fontana-04,fontana-03</value>
> > > > </property>
> > > > <property>
> > > > <name>hbase.client.keyvalue.maxsize</name>
> > > > <value>0</value>
> > > > </property>
> > > > <property>
> > > > <name>zookeeper.znode.parent</name>
> > > > <value>/hbase</value>
> > > > </property>
> > > > </configuration>
> > > >
> > >
> > >
> > >
> > > --
> > > * Regards*
> > > * Sandeep Nemuri*
> > >
> >
>
Re: zookeeper is null
Posted by Ted Yu <yu...@gmail.com>.
Please check the zookeeper server logs to see what might be happening.
bq. fontana-04,fontana-03
Why only two servers in the quorum ? Can you add one more zookeeper server ?
Cheers
On Thu, Dec 8, 2016 at 1:18 AM, Vincent Fontana <74...@gmail.com> wrote:
> now i have this...
>
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:java.library.path=/opt/hadoop/lib/native
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/tmp
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name
> =Linux
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=amd64
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:os.version=4.4.0-51-generic
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:user.name
> =hadoop
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/home/hadoop
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/opt/hadoop
> 16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:2181 sessionTimeout=90000
> watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
> 16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (unknown error)
> 16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connexion refusée
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:361)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1081)
> 16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly transient
> ZooKeeper, quorum=localhost:2181,
> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
> 16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry
> #0...
> 16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (unknown error)
> 16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connexion refusée
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:361)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1081)
> 16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly transient
> ZooKeeper, quorum=localhost:2181,
> exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
> 16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry
> #1...
>
>
> 2016-12-08 10:02 GMT+01:00 Sandeep Nemuri <nh...@gmail.com>:
>
> > Looks like your project is unable to pick zookeeper and zk node details
> > which are in hbase-site.xml.
> >
> > quorum=localhost:2181, baseZNode=/hbase
> >
> > On Thu, Dec 8, 2016 at 2:19 PM, <74...@gmail.com> wrote:
> >
> > > Hello,
> > >
> > > I have and error i can't understand and resolve i think it was cause by
> > > this:
> > > client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
> > >
> > > My project was to use nutch crawler with hadoop and hbase.
> > > I have start hbase ,yarn and dfs
> > > I when i start a job like Injector Job for nutch, nothing hapend.
> > >
> > > I have this writing on the console.
> > >
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:java.library.path=/opt/hadoop/lib/native
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:java.io.tmpdir=/tmp
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:java.compiler=<NA>
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:os.name
> > > =Linux
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:os.arch=amd64
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:os.version=4.4.0-45-generic
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
> user.name
> > > =hadoop
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:user.home=/home/hadoop
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > > environment:user.dir=/opt/hadoop
> > > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client
> connection,
> > > connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-
> > 0x75cf7815,
> > > quorum=localhost:2181, baseZNode=/hbase
> > > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket connection
> to
> > > server localhost/127.0.0.1:2181. Will not attempt to authenticate
> using
> > > SASL (unknown error)
> > > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
> > established
> > > to localhost/127.0.0.1:2181, initiating session
> > > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
> > > complete on server localhost/127.0.0.1:2181, sessionid =
> > > 0x58bf6bd3390001, negotiated timeout = 90000
> > > 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
> > > ZooKeeper is null
> > > 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib is
> > > deprecated. Instead, use io.native.lib.available
> > > 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
> > > identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
> > > ZooKeeper ensemble=localhost:2181
> > > 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client
> connection,
> > > connectString=localhost:2181 sessionTimeout=90000
> > watcher=catalogtracker-on-hconnection-0x75cf7815,
> > > quorum=localhost:2181, baseZNode=/hbase
> > > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket connection
> to
> > > server localhost/127.0.0.1:2181. Will not attempt to authenticate
> using
> > > SASL (unknown error)
> > > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
> > established
> > > to localhost/127.0.0.1:2181, initiating session
> > > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
> > > complete on server localhost/127.0.0.1:2181, sessionid =
> > > 0x58bf6bd3390002, negotiated timeout = 90000
> > >
> > > my hbase-site.xml configuration is:
> > > <configuration>
> > > <property>
> > > <name>hbase.cluster.distributed</name>
> > > <value>true</value>
> > > </property>
> > > <property>
> > > <name>hbase.rootdir</name>
> > > <value>hdfs://fontana-04:9000/opt/hbase</value>
> > > </property>
> > > <property>
> > > <name>hbase.security.authentication</name>
> > > <value>simple</value>
> > > </property>
> > > <property>
> > > <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
> > > <value>true</value>
> > > </property>
> > > <property>
> > > <name>hbase.zookeeper.quorum</name>
> > > <value>fontana-04,fontana-03</value>
> > > </property>
> > > <property>
> > > <name>hbase.client.keyvalue.maxsize</name>
> > > <value>0</value>
> > > </property>
> > > <property>
> > > <name>zookeeper.znode.parent</name>
> > > <value>/hbase</value>
> > > </property>
> > > </configuration>
> > >
> >
> >
> >
> > --
> > * Regards*
> > * Sandeep Nemuri*
> >
>
Re: zookeeper is null
Posted by Vincent Fontana <74...@gmail.com>.
now i have this...
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/opt/hadoop/lib/native
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:os.version=4.4.0-51-generic
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:user.name
=hadoop
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/hadoop
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/opt/hadoop
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=90000
watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connexion refusée
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly transient
ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry #0...
16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connexion refusée
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly transient
ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry #1...
2016-12-08 10:02 GMT+01:00 Sandeep Nemuri <nh...@gmail.com>:
> Looks like your project is unable to pick zookeeper and zk node details
> which are in hbase-site.xml.
>
> quorum=localhost:2181, baseZNode=/hbase
>
> On Thu, Dec 8, 2016 at 2:19 PM, <74...@gmail.com> wrote:
>
> > Hello,
> >
> > I have and error i can't understand and resolve i think it was cause by
> > this:
> > client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
> >
> > My project was to use nutch crawler with hadoop and hbase.
> > I have start hbase ,yarn and dfs
> > I when i start a job like Injector Job for nutch, nothing hapend.
> >
> > I have this writing on the console.
> >
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:java.library.path=/opt/hadoop/lib/native
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:java.io.tmpdir=/tmp
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:java.compiler=<NA>
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:os.name
> > =Linux
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:os.arch=amd64
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:os.version=4.4.0-45-generic
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:user.name
> > =hadoop
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:user.home=/home/hadoop
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> > environment:user.dir=/opt/hadoop
> > 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client connection,
> > connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-
> 0x75cf7815,
> > quorum=localhost:2181, baseZNode=/hbase
> > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket connection to
> > server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> > SASL (unknown error)
> > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
> established
> > to localhost/127.0.0.1:2181, initiating session
> > 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
> > complete on server localhost/127.0.0.1:2181, sessionid =
> > 0x58bf6bd3390001, negotiated timeout = 90000
> > 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
> > ZooKeeper is null
> > 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib is
> > deprecated. Instead, use io.native.lib.available
> > 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
> > identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
> > ZooKeeper ensemble=localhost:2181
> > 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client connection,
> > connectString=localhost:2181 sessionTimeout=90000
> watcher=catalogtracker-on-hconnection-0x75cf7815,
> > quorum=localhost:2181, baseZNode=/hbase
> > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket connection to
> > server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> > SASL (unknown error)
> > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
> established
> > to localhost/127.0.0.1:2181, initiating session
> > 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
> > complete on server localhost/127.0.0.1:2181, sessionid =
> > 0x58bf6bd3390002, negotiated timeout = 90000
> >
> > my hbase-site.xml configuration is:
> > <configuration>
> > <property>
> > <name>hbase.cluster.distributed</name>
> > <value>true</value>
> > </property>
> > <property>
> > <name>hbase.rootdir</name>
> > <value>hdfs://fontana-04:9000/opt/hbase</value>
> > </property>
> > <property>
> > <name>hbase.security.authentication</name>
> > <value>simple</value>
> > </property>
> > <property>
> > <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
> > <value>true</value>
> > </property>
> > <property>
> > <name>hbase.zookeeper.quorum</name>
> > <value>fontana-04,fontana-03</value>
> > </property>
> > <property>
> > <name>hbase.client.keyvalue.maxsize</name>
> > <value>0</value>
> > </property>
> > <property>
> > <name>zookeeper.znode.parent</name>
> > <value>/hbase</value>
> > </property>
> > </configuration>
> >
>
>
>
> --
> * Regards*
> * Sandeep Nemuri*
>
Re: zookeeper is null
Posted by Sandeep Nemuri <nh...@gmail.com>.
Looks like your project is unable to pick zookeeper and zk node details
which are in hbase-site.xml.
quorum=localhost:2181, baseZNode=/hbase
On Thu, Dec 8, 2016 at 2:19 PM, <74...@gmail.com> wrote:
> Hello,
>
> I have and error i can't understand and resolve i think it was cause by
> this:
> client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
>
> My project was to use nutch crawler with hadoop and hbase.
> I have start hbase ,yarn and dfs
> I when i start a job like Injector Job for nutch, nothing hapend.
>
> I have this writing on the console.
>
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:java.library.path=/opt/hadoop/lib/native
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/tmp
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:os.name
> =Linux
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:os.arch=amd64
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:os.version=4.4.0-45-generic
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:user.name
> =hadoop
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/home/hadoop
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/opt/hadoop
> 16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x75cf7815,
> quorum=localhost:2181, baseZNode=/hbase
> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (unknown error)
> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection established
> to localhost/127.0.0.1:2181, initiating session
> 16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
> complete on server localhost/127.0.0.1:2181, sessionid =
> 0x58bf6bd3390001, negotiated timeout = 90000
> 16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
> ZooKeeper is null
> 16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib is
> deprecated. Instead, use io.native.lib.available
> 16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
> identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
> ZooKeeper ensemble=localhost:2181
> 16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:2181 sessionTimeout=90000 watcher=catalogtracker-on-hconnection-0x75cf7815,
> quorum=localhost:2181, baseZNode=/hbase
> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (unknown error)
> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection established
> to localhost/127.0.0.1:2181, initiating session
> 16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
> complete on server localhost/127.0.0.1:2181, sessionid =
> 0x58bf6bd3390002, negotiated timeout = 90000
>
> my hbase-site.xml configuration is:
> <configuration>
> <property>
> <name>hbase.cluster.distributed</name>
> <value>true</value>
> </property>
> <property>
> <name>hbase.rootdir</name>
> <value>hdfs://fontana-04:9000/opt/hbase</value>
> </property>
> <property>
> <name>hbase.security.authentication</name>
> <value>simple</value>
> </property>
> <property>
> <name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
> <value>true</value>
> </property>
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>fontana-04,fontana-03</value>
> </property>
> <property>
> <name>hbase.client.keyvalue.maxsize</name>
> <value>0</value>
> </property>
> <property>
> <name>zookeeper.znode.parent</name>
> <value>/hbase</value>
> </property>
> </configuration>
>
--
* Regards*
* Sandeep Nemuri*