You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Mark Jarecki <mj...@bigpond.net.au> on 2011/02/27 12:17:41 UTC

Hbase 0.90.1 install OS X 10.6.6

Hi guys,

I'm trying to install Hbase 0.90.1 on OS X 10.6.6 in psuedo-distributed mode for use on a laptop, as instructed on:

http://blog.ibd.com/howto/hbase-hadoop-on-mac-ox-x/
AND
http://hbase.apache.org/book/notsoquick.html
(Especially section 1.3.2.2.1 Psuedo-distributed followed by 1.3.2.3)

After completing most of what I think follows the installation process, I call: 
bin/start-hbase.sh

When I log into the hbase shell to create some test data, I get :
ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase

The logs reads:
11/02/27 12:10:47 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
11/02/27 12:10:47 ERROR master.HMasterCommandLine: ZooKeeper not available

Obviously, Zookeeper is not installed, unavailable or something else. I'm not sure which, as all the installation instructions aren't clear on the matter. Section 1.3.2.3 of the docs says:

"If you are managing your own ZooKeeper, start it and confirm its running else, HBase will start up ZooKeeper for you as part of its start process."

But I'm not sure if I'm supposed to manage my own Zookeeper, especially since I didn't actually install it. I did try setting export HBASE_MANAGES_ZK=true in hbase-env.sh, but it made no difference. 

Any ideas on how to fix my Hbase install?

Thanks, any help would be greatly appreciated!

Mark

Re: Hbase 0.90.1 install OS X 10.6.6

Posted by Mark Jarecki <mj...@bigpond.net.au>.
Ahhh, that's it!

Ended up being:
org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client = 42, server = 41)

Copied the hadoop-0.20.2-core.jar into hbase/lib and all is fine.

Thanks a million.

Mark

On 28/02/2011, at 12:26 PM, Jean-Daniel Cryans wrote:

>> 2011-02-28 11:36:43,953 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
> 
> There should be a stack trace after that line, which would give the
> reason why the master didn't start properly.
> 
> J-D
> 
> On Sun, Feb 27, 2011 at 5:05 PM, Mark Jarecki <mj...@bigpond.net.au> wrote:
>> I did a fresh install, being especially careful to follow the instructions at http://hbase.apache.org/book/notsoquick.html. Still got the same error as before when trying hbase shell.
>> 
>> Any help would be most appreciated.
>> 
>> The relevant log section is below.
>> 
>> Mon 28 Feb 2011 11:36:41 EST Starting master on some.host
>> ulimit -n 256
>> 2011-02-28 11:36:42,793 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
>> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:host.name=some.host
>> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.version=1.6.0_22
>> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.vendor=Apple Inc.
>> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
>> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.class.path=/Users/me/hbase/hbase-0.90.1/bin/../conf:/Library/Java/Home/lib/tools.jar:/Users/me/hbase/hbase-0.90.1/bin/..:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1-tests.jar:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/avro-1.3.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-cli-1.2.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-codec-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-el-1.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-httpclient-3.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-lang-2.5.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-logging-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/guava-r06.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/hadoop-core-0.20-append-r1056497.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-compiler-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-runtime-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jaxb-api-2.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-core-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-json-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-server-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-util-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jruby-complete-1.0.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-api-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsr311-api-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/log4j-1.2.16.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/protobuf-java-2.3.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-api-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-log4j12-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/stax-api-1.0.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/thrift-0.2.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/zookeeper-3.3.2.jar
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.io.tmpdir=/var/folders/bv/bva2ayjTHm8-h4W2-nh8gE+++TI/-Tmp-/
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.compiler=<NA>
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.name=Mac OS X
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.arch=x86_64
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.version=10.6.6
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.name=me
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.home=/Users/me
>> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.dir=/Users/me/hbase/hbase-0.90.1
>> 2011-02-28 11:36:42,817 INFO org.apache.zookeeper.server.ZooKeeperServer: Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /tmp/hbase-me/zookeeper/zookeeper/version-2 snapdir /tmp/hbase-me/zookeeper/zookeeper/version-2
>> 2011-02-28 11:36:42,847 INFO org.apache.zookeeper.server.NIOServerCnxn: binding to port 0.0.0.0/0.0.0.0:2181
>> 2011-02-28 11:36:42,875 INFO org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting: 0
>> 2011-02-28 11:36:42,984 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49805
>> 2011-02-28 11:36:42,993 INFO org.apache.zookeeper.server.NIOServerCnxn: Processing stat command from /127.0.0.1:49805
>> 2011-02-28 11:36:42,996 INFO org.apache.zookeeper.server.NIOServerCnxn: Stat command output
>> 2011-02-28 11:36:42,997 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:49805 (no session established for client)
>> 2011-02-28 11:36:42,998 INFO org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster: Started MiniZK Server on client port: 2181
>> 2011-02-28 11:36:43,124 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMasterCommandLine$LocalHMaster, port=49806
>> 2011-02-28 11:36:43,230 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server Responder: starting
>> 2011-02-28 11:36:43,231 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 49806: starting
>> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 49806: starting
>> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 49806: starting
>> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 49806: starting
>> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 49806: starting
>> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 49806: starting
>> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 49806: starting
>> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 49806: starting
>> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 49806: starting
>> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 49806: starting
>> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 49806: starting
>> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
>> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=some.host
>> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22
>> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Apple Inc.
>> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
>> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/Users/me/hbase/hbase-0.90.1/bin/../conf:/Library/Java/Home/lib/tools.jar:/Users/me/hbase/hbase-0.90.1/bin/..:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1-tests.jar:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/avro-1.3.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-cli-1.2.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-codec-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-el-1.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-httpclient-3.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-lang-2.5.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-logging-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/guava-r06.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/hadoop-core-0.20-append-r1056497.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-compiler-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-runtime-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jaxb-api-2.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-core-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-json-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-server-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-util-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jruby-complete-1.0.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-api-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsr311-api-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/log4j-1.2.16.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/protobuf-java-2.3.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-api-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-log4j12-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/stax-api-1.0.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/thrift-0.2.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/zookeeper-3.3.2.jar
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/bv/bva2ayjTHm8-h4W2-nh8gE+++TI/-Tmp-/
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=x86_64
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=10.6.6
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=me
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/Users/me
>> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/Users/me/hbase/hbase-0.90.1
>> 2011-02-28 11:36:43,274 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=master:49806
>> 2011-02-28 11:36:43,300 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
>> 2011-02-28 11:36:43,302 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
>> 2011-02-28 11:36:43,304 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49807
>> 2011-02-28 11:36:43,307 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:49807
>> 2011-02-28 11:36:43,310 INFO org.apache.zookeeper.server.persistence.FileTxnLog: Creating new log file: log.1
>> 2011-02-28 11:36:43,357 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0000 with negotiated timeout 40000 for client /127.0.0.1:49807
>> 2011-02-28 11:36:43,358 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x12e69b2190a0000, negotiated timeout = 40000
>> 2011-02-28 11:36:43,405 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=some.host:49806
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: version
>> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
>> 2011-02-28 11:36:43,424 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
>> 2011-02-28 11:36:43,424 INFO org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized
>> 2011-02-28 11:36:43,483 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
>> 2011-02-28 11:36:43,484 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
>> 2011-02-28 11:36:43,484 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
>> 2011-02-28 11:36:43,484 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49808
>> 2011-02-28 11:36:43,485 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:49808
>> 2011-02-28 11:36:43,486 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0001 with negotiated timeout 40000 for client /127.0.0.1:49808
>> 2011-02-28 11:36:43,486 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x12e69b2190a0001, negotiated timeout = 40000
>> 2011-02-28 11:36:43,488 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
>> 2011-02-28 11:36:43,489 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
>> 2011-02-28 11:36:43,490 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
>> 2011-02-28 11:36:43,492 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
>> 2011-02-28 11:36:43,503 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HRegionServer, port=49809
>> 2011-02-28 11:36:43,558 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=regionserver:49809
>> 2011-02-28 11:36:43,559 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:2181
>> 2011-02-28 11:36:43,560 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:2181, initiating session
>> 2011-02-28 11:36:43,560 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:49810
>> 2011-02-28 11:36:43,560 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:49810
>> 2011-02-28 11:36:43,562 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0002 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:49810
>> 2011-02-28 11:36:43,563 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:2181, sessionid = 0x12e69b2190a0002, negotiated timeout = 40000
>> 2011-02-28 11:36:43,565 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
>> 2011-02-28 11:36:43,565 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=some.host:49806
>> 2011-02-28 11:36:43,566 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
>> 2011-02-28 11:36:43,568 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
>> 2011-02-28 11:36:43,569 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
>> 2011-02-28 11:36:43,953 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
>> 
>> On 28/02/2011, at 6:30 AM, Stack wrote:
>> 
>>> Can you check the logs under the $HBASE_HOME/logs directory?  Any clue
>>> therein?  (Your reasoning below looks right -- zk ensemble is not
>>> starting for some reason though its likely managed by hbase)
>>> St.Ack
>>> 
>>> On Sun, Feb 27, 2011 at 3:17 AM, Mark Jarecki <mj...@bigpond.net.au> wrote:
>>>> Hi guys,
>>>> 
>>>> I'm trying to install Hbase 0.90.1 on OS X 10.6.6 in psuedo-distributed mode for use on a laptop, as instructed on:
>>>> 
>>>> http://blog.ibd.com/howto/hbase-hadoop-on-mac-ox-x/
>>>> AND
>>>> http://hbase.apache.org/book/notsoquick.html
>>>> (Especially section 1.3.2.2.1 Psuedo-distributed followed by 1.3.2.3)
>>>> 
>>>> After completing most of what I think follows the installation process, I call:
>>>> bin/start-hbase.sh
>>>> 
>>>> When I log into the hbase shell to create some test data, I get :
>>>> ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
>>>> 
>>>> The logs reads:
>>>> 11/02/27 12:10:47 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
>>>> java.net.ConnectException: Connection refused
>>>>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>>>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>>>>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
>>>> 11/02/27 12:10:47 ERROR master.HMasterCommandLine: ZooKeeper not available
>>>> 
>>>> Obviously, Zookeeper is not installed, unavailable or something else. I'm not sure which, as all the installation instructions aren't clear on the matter. Section 1.3.2.3 of the docs says:
>>>> 
>>>> "If you are managing your own ZooKeeper, start it and confirm its running else, HBase will start up ZooKeeper for you as part of its start process."
>>>> 
>>>> But I'm not sure if I'm supposed to manage my own Zookeeper, especially since I didn't actually install it. I did try setting export HBASE_MANAGES_ZK=true in hbase-env.sh, but it made no difference.
>>>> 
>>>> Any ideas on how to fix my Hbase install?
>>>> 
>>>> Thanks, any help would be greatly appreciated!
>>>> 
>>>> Mark
>> 
>> 


Re: Hbase 0.90.1 install OS X 10.6.6

Posted by Jean-Daniel Cryans <jd...@apache.org>.
> 2011-02-28 11:36:43,953 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.

There should be a stack trace after that line, which would give the
reason why the master didn't start properly.

J-D

On Sun, Feb 27, 2011 at 5:05 PM, Mark Jarecki <mj...@bigpond.net.au> wrote:
> I did a fresh install, being especially careful to follow the instructions at http://hbase.apache.org/book/notsoquick.html. Still got the same error as before when trying hbase shell.
>
> Any help would be most appreciated.
>
> The relevant log section is below.
>
> Mon 28 Feb 2011 11:36:41 EST Starting master on some.host
> ulimit -n 256
> 2011-02-28 11:36:42,793 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:host.name=some.host
> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.version=1.6.0_22
> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.vendor=Apple Inc.
> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
> 2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.class.path=/Users/me/hbase/hbase-0.90.1/bin/../conf:/Library/Java/Home/lib/tools.jar:/Users/me/hbase/hbase-0.90.1/bin/..:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1-tests.jar:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/avro-1.3.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-cli-1.2.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-codec-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-el-1.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-httpclient-3.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-lang-2.5.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-logging-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/guava-r06.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/hadoop-core-0.20-append-r1056497.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-compiler-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-runtime-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jaxb-api-2.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-core-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-json-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-server-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-util-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jruby-complete-1.0.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-api-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsr311-api-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/log4j-1.2.16.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/protobuf-java-2.3.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-api-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-log4j12-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/stax-api-1.0.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/thrift-0.2.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/zookeeper-3.3.2.jar
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.io.tmpdir=/var/folders/bv/bva2ayjTHm8-h4W2-nh8gE+++TI/-Tmp-/
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.compiler=<NA>
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.name=Mac OS X
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.arch=x86_64
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.version=10.6.6
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.name=me
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.home=/Users/me
> 2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.dir=/Users/me/hbase/hbase-0.90.1
> 2011-02-28 11:36:42,817 INFO org.apache.zookeeper.server.ZooKeeperServer: Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /tmp/hbase-me/zookeeper/zookeeper/version-2 snapdir /tmp/hbase-me/zookeeper/zookeeper/version-2
> 2011-02-28 11:36:42,847 INFO org.apache.zookeeper.server.NIOServerCnxn: binding to port 0.0.0.0/0.0.0.0:2181
> 2011-02-28 11:36:42,875 INFO org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting: 0
> 2011-02-28 11:36:42,984 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49805
> 2011-02-28 11:36:42,993 INFO org.apache.zookeeper.server.NIOServerCnxn: Processing stat command from /127.0.0.1:49805
> 2011-02-28 11:36:42,996 INFO org.apache.zookeeper.server.NIOServerCnxn: Stat command output
> 2011-02-28 11:36:42,997 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:49805 (no session established for client)
> 2011-02-28 11:36:42,998 INFO org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster: Started MiniZK Server on client port: 2181
> 2011-02-28 11:36:43,124 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMasterCommandLine$LocalHMaster, port=49806
> 2011-02-28 11:36:43,230 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server Responder: starting
> 2011-02-28 11:36:43,231 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 49806: starting
> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 49806: starting
> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 49806: starting
> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 49806: starting
> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 49806: starting
> 2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 49806: starting
> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 49806: starting
> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 49806: starting
> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 49806: starting
> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 49806: starting
> 2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 49806: starting
> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=some.host
> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22
> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Apple Inc.
> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
> 2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/Users/me/hbase/hbase-0.90.1/bin/../conf:/Library/Java/Home/lib/tools.jar:/Users/me/hbase/hbase-0.90.1/bin/..:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1-tests.jar:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/avro-1.3.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-cli-1.2.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-codec-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-el-1.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-httpclient-3.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-lang-2.5.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-logging-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/guava-r06.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/hadoop-core-0.20-append-r1056497.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-compiler-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-runtime-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jaxb-api-2.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-core-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-json-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-server-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-util-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jruby-complete-1.0.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-api-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsr311-api-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/log4j-1.2.16.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/protobuf-java-2.3.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-api-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-log4j12-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/stax-api-1.0.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/thrift-0.2.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/zookeeper-3.3.2.jar
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/bv/bva2ayjTHm8-h4W2-nh8gE+++TI/-Tmp-/
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=x86_64
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=10.6.6
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=me
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/Users/me
> 2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/Users/me/hbase/hbase-0.90.1
> 2011-02-28 11:36:43,274 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=master:49806
> 2011-02-28 11:36:43,300 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
> 2011-02-28 11:36:43,302 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
> 2011-02-28 11:36:43,304 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49807
> 2011-02-28 11:36:43,307 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:49807
> 2011-02-28 11:36:43,310 INFO org.apache.zookeeper.server.persistence.FileTxnLog: Creating new log file: log.1
> 2011-02-28 11:36:43,357 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0000 with negotiated timeout 40000 for client /127.0.0.1:49807
> 2011-02-28 11:36:43,358 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x12e69b2190a0000, negotiated timeout = 40000
> 2011-02-28 11:36:43,405 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=some.host:49806
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: version
> 2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
> 2011-02-28 11:36:43,424 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
> 2011-02-28 11:36:43,424 INFO org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized
> 2011-02-28 11:36:43,483 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
> 2011-02-28 11:36:43,484 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
> 2011-02-28 11:36:43,484 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
> 2011-02-28 11:36:43,484 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49808
> 2011-02-28 11:36:43,485 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:49808
> 2011-02-28 11:36:43,486 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0001 with negotiated timeout 40000 for client /127.0.0.1:49808
> 2011-02-28 11:36:43,486 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x12e69b2190a0001, negotiated timeout = 40000
> 2011-02-28 11:36:43,488 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
> 2011-02-28 11:36:43,489 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
> 2011-02-28 11:36:43,490 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
> 2011-02-28 11:36:43,492 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
> 2011-02-28 11:36:43,503 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HRegionServer, port=49809
> 2011-02-28 11:36:43,558 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=regionserver:49809
> 2011-02-28 11:36:43,559 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:2181
> 2011-02-28 11:36:43,560 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:2181, initiating session
> 2011-02-28 11:36:43,560 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:49810
> 2011-02-28 11:36:43,560 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:49810
> 2011-02-28 11:36:43,562 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0002 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:49810
> 2011-02-28 11:36:43,563 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:2181, sessionid = 0x12e69b2190a0002, negotiated timeout = 40000
> 2011-02-28 11:36:43,565 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
> 2011-02-28 11:36:43,565 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=some.host:49806
> 2011-02-28 11:36:43,566 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
> 2011-02-28 11:36:43,568 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
> 2011-02-28 11:36:43,569 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
> 2011-02-28 11:36:43,953 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
>
> On 28/02/2011, at 6:30 AM, Stack wrote:
>
>> Can you check the logs under the $HBASE_HOME/logs directory?  Any clue
>> therein?  (Your reasoning below looks right -- zk ensemble is not
>> starting for some reason though its likely managed by hbase)
>> St.Ack
>>
>> On Sun, Feb 27, 2011 at 3:17 AM, Mark Jarecki <mj...@bigpond.net.au> wrote:
>>> Hi guys,
>>>
>>> I'm trying to install Hbase 0.90.1 on OS X 10.6.6 in psuedo-distributed mode for use on a laptop, as instructed on:
>>>
>>> http://blog.ibd.com/howto/hbase-hadoop-on-mac-ox-x/
>>> AND
>>> http://hbase.apache.org/book/notsoquick.html
>>> (Especially section 1.3.2.2.1 Psuedo-distributed followed by 1.3.2.3)
>>>
>>> After completing most of what I think follows the installation process, I call:
>>> bin/start-hbase.sh
>>>
>>> When I log into the hbase shell to create some test data, I get :
>>> ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
>>>
>>> The logs reads:
>>> 11/02/27 12:10:47 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
>>> java.net.ConnectException: Connection refused
>>>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>>>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
>>> 11/02/27 12:10:47 ERROR master.HMasterCommandLine: ZooKeeper not available
>>>
>>> Obviously, Zookeeper is not installed, unavailable or something else. I'm not sure which, as all the installation instructions aren't clear on the matter. Section 1.3.2.3 of the docs says:
>>>
>>> "If you are managing your own ZooKeeper, start it and confirm its running else, HBase will start up ZooKeeper for you as part of its start process."
>>>
>>> But I'm not sure if I'm supposed to manage my own Zookeeper, especially since I didn't actually install it. I did try setting export HBASE_MANAGES_ZK=true in hbase-env.sh, but it made no difference.
>>>
>>> Any ideas on how to fix my Hbase install?
>>>
>>> Thanks, any help would be greatly appreciated!
>>>
>>> Mark
>
>

Re: Hbase 0.90.1 install OS X 10.6.6

Posted by Mark Jarecki <mj...@bigpond.net.au>.
I did a fresh install, being especially careful to follow the instructions at http://hbase.apache.org/book/notsoquick.html. Still got the same error as before when trying hbase shell.

Any help would be most appreciated.

The relevant log section is below.

Mon 28 Feb 2011 11:36:41 EST Starting master on some.host
ulimit -n 256
2011-02-28 11:36:42,793 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:host.name=some.host
2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.version=1.6.0_22
2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.vendor=Apple Inc.
2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
2011-02-28 11:36:42,794 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.class.path=/Users/me/hbase/hbase-0.90.1/bin/../conf:/Library/Java/Home/lib/tools.jar:/Users/me/hbase/hbase-0.90.1/bin/..:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1-tests.jar:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/avro-1.3.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-cli-1.2.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-codec-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-el-1.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-httpclient-3.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-lang-2.5.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-logging-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/guava-r06.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/hadoop-core-0.20-append-r1056497.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-compiler-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-runtime-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jaxb-api-2.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-core-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-json-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-server-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-util-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jruby-complete-1.0.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-api-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsr311-api-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/log4j-1.2.16.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/protobuf-java-2.3.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-api-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-log4j12-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/stax-api-1.0.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/thrift-0.2.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/zookeeper-3.3.2.jar
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.io.tmpdir=/var/folders/bv/bva2ayjTHm8-h4W2-nh8gE+++TI/-Tmp-/
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.compiler=<NA>
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.name=Mac OS X
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.arch=x86_64
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.version=10.6.6
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.name=me
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.home=/Users/me
2011-02-28 11:36:42,795 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.dir=/Users/me/hbase/hbase-0.90.1
2011-02-28 11:36:42,817 INFO org.apache.zookeeper.server.ZooKeeperServer: Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /tmp/hbase-me/zookeeper/zookeeper/version-2 snapdir /tmp/hbase-me/zookeeper/zookeeper/version-2
2011-02-28 11:36:42,847 INFO org.apache.zookeeper.server.NIOServerCnxn: binding to port 0.0.0.0/0.0.0.0:2181
2011-02-28 11:36:42,875 INFO org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting: 0
2011-02-28 11:36:42,984 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49805
2011-02-28 11:36:42,993 INFO org.apache.zookeeper.server.NIOServerCnxn: Processing stat command from /127.0.0.1:49805
2011-02-28 11:36:42,996 INFO org.apache.zookeeper.server.NIOServerCnxn: Stat command output
2011-02-28 11:36:42,997 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:49805 (no session established for client)
2011-02-28 11:36:42,998 INFO org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster: Started MiniZK Server on client port: 2181
2011-02-28 11:36:43,124 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMasterCommandLine$LocalHMaster, port=49806
2011-02-28 11:36:43,230 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server Responder: starting
2011-02-28 11:36:43,231 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 49806: starting
2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 49806: starting
2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 49806: starting
2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 49806: starting
2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 49806: starting
2011-02-28 11:36:43,233 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 49806: starting
2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 49806: starting
2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 49806: starting
2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 49806: starting
2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 49806: starting
2011-02-28 11:36:43,234 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 49806: starting
2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=some.host
2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22
2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Apple Inc.
2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
2011-02-28 11:36:43,272 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/Users/me/hbase/hbase-0.90.1/bin/../conf:/Library/Java/Home/lib/tools.jar:/Users/me/hbase/hbase-0.90.1/bin/..:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1-tests.jar:/Users/me/hbase/hbase-0.90.1/bin/../hbase-0.90.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/avro-1.3.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-cli-1.2.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-codec-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-el-1.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-httpclient-3.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-lang-2.5.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/commons-logging-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/guava-r06.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/hadoop-core-0.20-append-r1056497.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-compiler-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jasper-runtime-5.5.23.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jaxb-api-2.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-core-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-json-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jersey-server-1.4.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jetty-util-6.1.26.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jruby-complete-1.0.3.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsp-api-2.1-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/jsr311-api-1.1.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/log4j-1.2.16.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/protobuf-java-2.3.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-api-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/slf4j-log4j12-1.5.8.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/stax-api-1.0.1.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/thrift-0.2.0.jar:/Users/me/hbase/hbase-0.90.1/bin/../lib/zookeeper-3.3.2.jar
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/bv/bva2ayjTHm8-h4W2-nh8gE+++TI/-Tmp-/
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=x86_64
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=10.6.6
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=me
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/Users/me
2011-02-28 11:36:43,273 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/Users/me/hbase/hbase-0.90.1
2011-02-28 11:36:43,274 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=master:49806
2011-02-28 11:36:43,300 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
2011-02-28 11:36:43,302 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
2011-02-28 11:36:43,304 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49807
2011-02-28 11:36:43,307 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:49807
2011-02-28 11:36:43,310 INFO org.apache.zookeeper.server.persistence.FileTxnLog: Creating new log file: log.1
2011-02-28 11:36:43,357 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0000 with negotiated timeout 40000 for client /127.0.0.1:49807
2011-02-28 11:36:43,358 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x12e69b2190a0000, negotiated timeout = 40000
2011-02-28 11:36:43,405 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=Master, sessionId=some.host:49806
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: revision
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUser
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsDate
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsUrl
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: date
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsRevision
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: user
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: hdfsVersion
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: url
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: MetricsString added: version
2011-02-28 11:36:43,423 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
2011-02-28 11:36:43,424 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo
2011-02-28 11:36:43,424 INFO org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized
2011-02-28 11:36:43,483 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
2011-02-28 11:36:43,484 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
2011-02-28 11:36:43,484 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
2011-02-28 11:36:43,484 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /127.0.0.1:49808
2011-02-28 11:36:43,485 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /127.0.0.1:49808
2011-02-28 11:36:43,486 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0001 with negotiated timeout 40000 for client /127.0.0.1:49808
2011-02-28 11:36:43,486 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x12e69b2190a0001, negotiated timeout = 40000
2011-02-28 11:36:43,488 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
2011-02-28 11:36:43,489 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
2011-02-28 11:36:43,490 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
2011-02-28 11:36:43,492 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0001 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
2011-02-28 11:36:43,503 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HRegionServer, port=49809
2011-02-28 11:36:43,558 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=regionserver:49809
2011-02-28 11:36:43,559 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:2181
2011-02-28 11:36:43,560 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:2181, initiating session
2011-02-28 11:36:43,560 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted socket connection from /fe80:0:0:0:0:0:0:1%1:49810
2011-02-28 11:36:43,560 INFO org.apache.zookeeper.server.NIOServerCnxn: Client attempting to establish new session at /fe80:0:0:0:0:0:0:1%1:49810
2011-02-28 11:36:43,562 INFO org.apache.zookeeper.server.NIOServerCnxn: Established session 0x12e69b2190a0002 with negotiated timeout 40000 for client /fe80:0:0:0:0:0:0:1%1:49810
2011-02-28 11:36:43,563 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:2181, sessionid = 0x12e69b2190a0002, negotiated timeout = 40000
2011-02-28 11:36:43,565 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
2011-02-28 11:36:43,565 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=some.host:49806
2011-02-28 11:36:43,566 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
2011-02-28 11:36:43,568 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
2011-02-28 11:36:43,569 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x12e69b2190a0002 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
2011-02-28 11:36:43,953 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.

On 28/02/2011, at 6:30 AM, Stack wrote:

> Can you check the logs under the $HBASE_HOME/logs directory?  Any clue
> therein?  (Your reasoning below looks right -- zk ensemble is not
> starting for some reason though its likely managed by hbase)
> St.Ack
> 
> On Sun, Feb 27, 2011 at 3:17 AM, Mark Jarecki <mj...@bigpond.net.au> wrote:
>> Hi guys,
>> 
>> I'm trying to install Hbase 0.90.1 on OS X 10.6.6 in psuedo-distributed mode for use on a laptop, as instructed on:
>> 
>> http://blog.ibd.com/howto/hbase-hadoop-on-mac-ox-x/
>> AND
>> http://hbase.apache.org/book/notsoquick.html
>> (Especially section 1.3.2.2.1 Psuedo-distributed followed by 1.3.2.3)
>> 
>> After completing most of what I think follows the installation process, I call:
>> bin/start-hbase.sh
>> 
>> When I log into the hbase shell to create some test data, I get :
>> ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
>> 
>> The logs reads:
>> 11/02/27 12:10:47 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
>> java.net.ConnectException: Connection refused
>>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
>> 11/02/27 12:10:47 ERROR master.HMasterCommandLine: ZooKeeper not available
>> 
>> Obviously, Zookeeper is not installed, unavailable or something else. I'm not sure which, as all the installation instructions aren't clear on the matter. Section 1.3.2.3 of the docs says:
>> 
>> "If you are managing your own ZooKeeper, start it and confirm its running else, HBase will start up ZooKeeper for you as part of its start process."
>> 
>> But I'm not sure if I'm supposed to manage my own Zookeeper, especially since I didn't actually install it. I did try setting export HBASE_MANAGES_ZK=true in hbase-env.sh, but it made no difference.
>> 
>> Any ideas on how to fix my Hbase install?
>> 
>> Thanks, any help would be greatly appreciated!
>> 
>> Mark


Re: Hbase 0.90.1 install OS X 10.6.6

Posted by Stack <st...@duboce.net>.
Can you check the logs under the $HBASE_HOME/logs directory?  Any clue
therein?  (Your reasoning below looks right -- zk ensemble is not
starting for some reason though its likely managed by hbase)
St.Ack

On Sun, Feb 27, 2011 at 3:17 AM, Mark Jarecki <mj...@bigpond.net.au> wrote:
> Hi guys,
>
> I'm trying to install Hbase 0.90.1 on OS X 10.6.6 in psuedo-distributed mode for use on a laptop, as instructed on:
>
> http://blog.ibd.com/howto/hbase-hadoop-on-mac-ox-x/
> AND
> http://hbase.apache.org/book/notsoquick.html
> (Especially section 1.3.2.2.1 Psuedo-distributed followed by 1.3.2.3)
>
> After completing most of what I think follows the installation process, I call:
> bin/start-hbase.sh
>
> When I log into the hbase shell to create some test data, I get :
> ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
>
> The logs reads:
> 11/02/27 12:10:47 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
> 11/02/27 12:10:47 ERROR master.HMasterCommandLine: ZooKeeper not available
>
> Obviously, Zookeeper is not installed, unavailable or something else. I'm not sure which, as all the installation instructions aren't clear on the matter. Section 1.3.2.3 of the docs says:
>
> "If you are managing your own ZooKeeper, start it and confirm its running else, HBase will start up ZooKeeper for you as part of its start process."
>
> But I'm not sure if I'm supposed to manage my own Zookeeper, especially since I didn't actually install it. I did try setting export HBASE_MANAGES_ZK=true in hbase-env.sh, but it made no difference.
>
> Any ideas on how to fix my Hbase install?
>
> Thanks, any help would be greatly appreciated!
>
> Mark