You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Pat Ferrel <pa...@occamsmachete.com> on 2015/03/21 20:43:48 UTC
HBase standalone ZooKeeper error
I’m trying to run the standalone HBase with the Zookeeper that it launches, on a Mac
I’ve carefully gone through the quickstart and get the error below. I’ve also done the following things to try to resolve this.
1) According to the Hbase quickstart the dataDir is supposed to not exist so Hbase won’t do a migration and so I’ve tried with an empty one and a non-existent dataDir, same error. Also the default is to use /tmp/… which is fine no specified hbase.zookeeper.property.dataDir too but no help.
2) HBASE_MANAGES_ZK was unset but is defaulted to true, setting it explicitly to true gives the same error.
3) Some suggestions tell you to remove any ipv6 references to localhost in /etc/hosts so I did that to no avail.
4) zookeeper is never launched by hbase from the output of jps -l.
When I launch the HBase shell and run “help” is works but when I run “status” it throws and exception.
[ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
[ERROR] [ZooKeeperWatcher] hconnection-0x3bb25aa6, quorum=localhost:2181, baseZNode=/hbase Received unexpected KeeperException, re-throwing exception
[WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
[ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble: localhost). Please make sure that the configuration is pointing at the correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper, so if you have not configured HBase to use an external ZooKeeper, that means your HBase is not started or configured properly.
[ERROR] [Storage$] Error initializing storage client for source HBASE
[ERROR] [Storage$] Can't connect to ZooKeeper
io.prediction.data.storage.StorageClientException: Data source HBASE was not properly initialized.
at io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
at io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
at scala.Option.getOrElse(Option.scala:120)
at io.prediction.data.storage.Storage$.getDataObject(Storage.scala:181)
at io.prediction.data.storage.Storage$.getDataObject(Storage.scala:166)
at io.prediction.data.storage.Storage$.getLEvents(Storage.scala:274)
at io.prediction.data.storage.Storage$.verifyAllDataObjects(Storage.scala:240)
at io.prediction.tools.console.Console$.status(Console.scala:968)
at io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
at io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:573)
at scala.Option.map(Option.scala:145)
at io.prediction.tools.console.Console$.main(Console.scala:573)
at io.prediction.tools.console.Console.main(Console.scala)
All the log output says is:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/pat/hbase/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/pat/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
[WARN] [NativeCodeLoader] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[INFO] [log] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[INFO] [log] jetty-6.1.26
[INFO] [log] Started SelectChannelConnector@0.0.0.0 <ma...@0.0.0.0>:61342
[INFO] [log] jetty-6.1.26
[INFO] [log] Started SelectChannelConnector@0.0.0.0 <ma...@0.0.0.0>:60010
[FATAL] [HMaster] Unhandled exception. Starting shutdown.
[INFO] [log] Stopped SelectChannelConnector@0.0.0.0 <ma...@0.0.0.0>:60010
Re: HBase standalone ZooKeeper error
Posted by Pat Ferrel <pa...@occamsmachete.com>.
Cleaned the install and did this to get new binary:
wget https://archive.apache.org/dist/hbase/hbase-0.98.11/hbase-0.98.11-hadoop2-bin.tar.gz
Now the same config works. The previous download was following Hbase instructions and had the same version numbers but I didn’t check the signature. Anyway, seems to be resolved.
On Mar 21, 2015, at 2:09 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
Hmm, ok so no meaning in that message. I’m beginning to wonder if I’ve done something stupid like comma instead of period. I’ll try a fresh reinstall.
On Mar 21, 2015, at 2:04 PM, Ted Yu <yu...@gmail.com> wrote:
bq. HBase will work with Java 7 I assume?
Yes.
Here is the version of Java on my Mac:
java version "1.7.0_60"
Java(TM) SE Runtime Environment (build 1.7.0_60-b19)
Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode)
bq. Not sure why it thinks ZooKeeper “exists”?
You were referring to the ERROR message which I think came from
RecoverableZooKeeper#retryOrThrow():
if (!retryCounter.shouldRetry()) {
LOG.error("ZooKeeper " + opName + " failed after "
+ retryCounter.getMaxAttempts() + " attempts");
'exists' is the name the operation.
I can try to run hbase-0.98.11-hadoop2 locally when I get a chance.
Cheers
On Sat, Mar 21, 2015 at 1:50 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> No, from the binary tar for hbase-0.98.11-hadoop2 trying to run locally
> standalone with native FS. I’ve carefully gone through the quickstart using
> the minimal config. BTW HBase will work with Java 7 I assume?
>
> The trace was from an app that uses HBase but I get the same when running
> “status” in the HBase shell. The shell launches and can get help but
> nothing that actually uses the DB. So “status” crashes HBase with the same
> error.
>
> The comment about ZooKeeper was to point out that there was no separate
> instance of Zookeeper running. Not sure why it thinks ZooKeeper “exists”?
>
> I’ve set those both to local filesystem non-existent dirs since no startup
> has initialized them yet. But I’ve tried setting them to empty dirs too.
>
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>file:///Users/pat/hbase-data</value>
> </property>
> <property>
> <name>hbase.zookeeper.property.dataDir</name>
> <value>/Users/pat/zookeeper-data</value>
> </property>
> </configuration>
>
>
> On Mar 21, 2015, at 1:04 PM, Ted Yu <yu...@gmail.com> wrote:
>
> I followed section 2.2 in http://hbase.apache.org/book.html#quickstart in
> working directory of hbase-1 branch.
>
> Here is my hbase-site.xml :
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>file:////Users/tyu/tmp</value>
> </property>
> <property>
> <name>hbase.zookeeper.property.dataDir</name>
> <value>/Users/tyu/tmp/zk</value>
> </property>
> </configuration>
>
> I then typed 'bin/start-hbase.sh'
>
> jps command shows HMaster process.
>
> bq. zookeeper is never launched by hbase from the output of jps -l.
> See the following in item 5 of 2.2:
> In standalone mode HBase runs all daemons within this single JVM, i.e. the
> HMaster, a single HRegionServer, and the ZooKeeper daemon.
>
> Can you tell us the version of HBase you run with ?
> From io.prediction.data.storage.StorageClientException , it seems you have
> your own build.
>
> Cheers
>
> On Sat, Mar 21, 2015 at 12:43 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
>> I’m trying to run the standalone HBase with the Zookeeper that it
>> launches, on a Mac
>>
>> I’ve carefully gone through the quickstart and get the error below. I’ve
>> also done the following things to try to resolve this.
>> 1) According to the Hbase quickstart the dataDir is supposed to not
> exist
>> so Hbase won’t do a migration and so I’ve tried with an empty one and a
>> non-existent dataDir, same error. Also the default is to use /tmp/… which
>> is fine no specified hbase.zookeeper.property.dataDir too but no help.
>> 2) HBASE_MANAGES_ZK was unset but is defaulted to true, setting it
>> explicitly to true gives the same error.
>> 3) Some suggestions tell you to remove any ipv6 references to localhost
> in
>> /etc/hosts so I did that to no avail.
>> 4) zookeeper is never launched by hbase from the output of jps -l.
>>
>> When I launch the HBase shell and run “help” is works but when I run
>> “status” it throws and exception.
>>
>> [ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
>> [ERROR] [ZooKeeperWatcher] hconnection-0x3bb25aa6, quorum=localhost:2181,
>> baseZNode=/hbase Received unexpected KeeperException, re-throwing
> exception
>> [WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
>> [ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble:
>> localhost). Please make sure that the configuration is pointing at the
>> correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper,
> so
>> if you have not configured HBase to use an external ZooKeeper, that means
>> your HBase is not started or configured properly.
>> [ERROR] [Storage$] Error initializing storage client for source HBASE
>> [ERROR] [Storage$] Can't connect to ZooKeeper
>> io.prediction.data.storage.StorageClientException: Data source HBASE was
>> not properly initialized.
>> at
>> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
>> at
>> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
>> at scala.Option.getOrElse(Option.scala:120)
>> at
>> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:181)
>> at
>> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:166)
>> at
>> io.prediction.data.storage.Storage$.getLEvents(Storage.scala:274)
>> at
>>
> io.prediction.data.storage.Storage$.verifyAllDataObjects(Storage.scala:240)
>> at io.prediction.tools.console.Console$.status(Console.scala:968)
>> at
>>
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
>> at
>>
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:573)
>> at scala.Option.map(Option.scala:145)
>> at io.prediction.tools.console.Console$.main(Console.scala:573)
>> at io.prediction.tools.console.Console.main(Console.scala)
>>
>> All the log output says is:
>>
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in
>>
> [jar:file:/Users/pat/hbase/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>>
> [jar:file:/Users/pat/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
>> http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
>> [WARN] [NativeCodeLoader] Unable to load native-hadoop library for your
>> platform... using builtin-java classes where applicable
>> [INFO] [log] Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
>> via org.mortbay.log.Slf4jLog
>> [INFO] [log] jetty-6.1.26
>> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
>> SelectChannelConnector@0.0.0.0>:61342
>> [INFO] [log] jetty-6.1.26
>> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
>> SelectChannelConnector@0.0.0.0>:60010
>> [FATAL] [HMaster] Unhandled exception. Starting shutdown.
>> [INFO] [log] Stopped SelectChannelConnector@0.0.0.0 <mailto:
>> SelectChannelConnector@0.0.0.0>:60010
>
>
Re: HBase standalone ZooKeeper error
Posted by Pat Ferrel <pa...@occamsmachete.com>.
Hmm, ok so no meaning in that message. I’m beginning to wonder if I’ve done something stupid like comma instead of period. I’ll try a fresh reinstall.
On Mar 21, 2015, at 2:04 PM, Ted Yu <yu...@gmail.com> wrote:
bq. HBase will work with Java 7 I assume?
Yes.
Here is the version of Java on my Mac:
java version "1.7.0_60"
Java(TM) SE Runtime Environment (build 1.7.0_60-b19)
Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode)
bq. Not sure why it thinks ZooKeeper “exists”?
You were referring to the ERROR message which I think came from
RecoverableZooKeeper#retryOrThrow():
if (!retryCounter.shouldRetry()) {
LOG.error("ZooKeeper " + opName + " failed after "
+ retryCounter.getMaxAttempts() + " attempts");
'exists' is the name the operation.
I can try to run hbase-0.98.11-hadoop2 locally when I get a chance.
Cheers
On Sat, Mar 21, 2015 at 1:50 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> No, from the binary tar for hbase-0.98.11-hadoop2 trying to run locally
> standalone with native FS. I’ve carefully gone through the quickstart using
> the minimal config. BTW HBase will work with Java 7 I assume?
>
> The trace was from an app that uses HBase but I get the same when running
> “status” in the HBase shell. The shell launches and can get help but
> nothing that actually uses the DB. So “status” crashes HBase with the same
> error.
>
> The comment about ZooKeeper was to point out that there was no separate
> instance of Zookeeper running. Not sure why it thinks ZooKeeper “exists”?
>
> I’ve set those both to local filesystem non-existent dirs since no startup
> has initialized them yet. But I’ve tried setting them to empty dirs too.
>
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>file:///Users/pat/hbase-data</value>
> </property>
> <property>
> <name>hbase.zookeeper.property.dataDir</name>
> <value>/Users/pat/zookeeper-data</value>
> </property>
> </configuration>
>
>
> On Mar 21, 2015, at 1:04 PM, Ted Yu <yu...@gmail.com> wrote:
>
> I followed section 2.2 in http://hbase.apache.org/book.html#quickstart in
> working directory of hbase-1 branch.
>
> Here is my hbase-site.xml :
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>file:////Users/tyu/tmp</value>
> </property>
> <property>
> <name>hbase.zookeeper.property.dataDir</name>
> <value>/Users/tyu/tmp/zk</value>
> </property>
> </configuration>
>
> I then typed 'bin/start-hbase.sh'
>
> jps command shows HMaster process.
>
> bq. zookeeper is never launched by hbase from the output of jps -l.
> See the following in item 5 of 2.2:
> In standalone mode HBase runs all daemons within this single JVM, i.e. the
> HMaster, a single HRegionServer, and the ZooKeeper daemon.
>
> Can you tell us the version of HBase you run with ?
> From io.prediction.data.storage.StorageClientException , it seems you have
> your own build.
>
> Cheers
>
> On Sat, Mar 21, 2015 at 12:43 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
>> I’m trying to run the standalone HBase with the Zookeeper that it
>> launches, on a Mac
>>
>> I’ve carefully gone through the quickstart and get the error below. I’ve
>> also done the following things to try to resolve this.
>> 1) According to the Hbase quickstart the dataDir is supposed to not
> exist
>> so Hbase won’t do a migration and so I’ve tried with an empty one and a
>> non-existent dataDir, same error. Also the default is to use /tmp/… which
>> is fine no specified hbase.zookeeper.property.dataDir too but no help.
>> 2) HBASE_MANAGES_ZK was unset but is defaulted to true, setting it
>> explicitly to true gives the same error.
>> 3) Some suggestions tell you to remove any ipv6 references to localhost
> in
>> /etc/hosts so I did that to no avail.
>> 4) zookeeper is never launched by hbase from the output of jps -l.
>>
>> When I launch the HBase shell and run “help” is works but when I run
>> “status” it throws and exception.
>>
>> [ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
>> [ERROR] [ZooKeeperWatcher] hconnection-0x3bb25aa6, quorum=localhost:2181,
>> baseZNode=/hbase Received unexpected KeeperException, re-throwing
> exception
>> [WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
>> [ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble:
>> localhost). Please make sure that the configuration is pointing at the
>> correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper,
> so
>> if you have not configured HBase to use an external ZooKeeper, that means
>> your HBase is not started or configured properly.
>> [ERROR] [Storage$] Error initializing storage client for source HBASE
>> [ERROR] [Storage$] Can't connect to ZooKeeper
>> io.prediction.data.storage.StorageClientException: Data source HBASE was
>> not properly initialized.
>> at
>> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
>> at
>> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
>> at scala.Option.getOrElse(Option.scala:120)
>> at
>> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:181)
>> at
>> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:166)
>> at
>> io.prediction.data.storage.Storage$.getLEvents(Storage.scala:274)
>> at
>>
> io.prediction.data.storage.Storage$.verifyAllDataObjects(Storage.scala:240)
>> at io.prediction.tools.console.Console$.status(Console.scala:968)
>> at
>>
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
>> at
>>
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:573)
>> at scala.Option.map(Option.scala:145)
>> at io.prediction.tools.console.Console$.main(Console.scala:573)
>> at io.prediction.tools.console.Console.main(Console.scala)
>>
>> All the log output says is:
>>
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in
>>
> [jar:file:/Users/pat/hbase/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>>
> [jar:file:/Users/pat/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
>> http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
>> [WARN] [NativeCodeLoader] Unable to load native-hadoop library for your
>> platform... using builtin-java classes where applicable
>> [INFO] [log] Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
>> via org.mortbay.log.Slf4jLog
>> [INFO] [log] jetty-6.1.26
>> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
>> SelectChannelConnector@0.0.0.0>:61342
>> [INFO] [log] jetty-6.1.26
>> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
>> SelectChannelConnector@0.0.0.0>:60010
>> [FATAL] [HMaster] Unhandled exception. Starting shutdown.
>> [INFO] [log] Stopped SelectChannelConnector@0.0.0.0 <mailto:
>> SelectChannelConnector@0.0.0.0>:60010
>
>
Re: HBase standalone ZooKeeper error
Posted by Ted Yu <yu...@gmail.com>.
bq. HBase will work with Java 7 I assume?
Yes.
Here is the version of Java on my Mac:
java version "1.7.0_60"
Java(TM) SE Runtime Environment (build 1.7.0_60-b19)
Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode)
bq. Not sure why it thinks ZooKeeper “exists”?
You were referring to the ERROR message which I think came from
RecoverableZooKeeper#retryOrThrow():
if (!retryCounter.shouldRetry()) {
LOG.error("ZooKeeper " + opName + " failed after "
+ retryCounter.getMaxAttempts() + " attempts");
'exists' is the name the operation.
I can try to run hbase-0.98.11-hadoop2 locally when I get a chance.
Cheers
On Sat, Mar 21, 2015 at 1:50 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> No, from the binary tar for hbase-0.98.11-hadoop2 trying to run locally
> standalone with native FS. I’ve carefully gone through the quickstart using
> the minimal config. BTW HBase will work with Java 7 I assume?
>
> The trace was from an app that uses HBase but I get the same when running
> “status” in the HBase shell. The shell launches and can get help but
> nothing that actually uses the DB. So “status” crashes HBase with the same
> error.
>
> The comment about ZooKeeper was to point out that there was no separate
> instance of Zookeeper running. Not sure why it thinks ZooKeeper “exists”?
>
> I’ve set those both to local filesystem non-existent dirs since no startup
> has initialized them yet. But I’ve tried setting them to empty dirs too.
>
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>file:///Users/pat/hbase-data</value>
> </property>
> <property>
> <name>hbase.zookeeper.property.dataDir</name>
> <value>/Users/pat/zookeeper-data</value>
> </property>
> </configuration>
>
>
> On Mar 21, 2015, at 1:04 PM, Ted Yu <yu...@gmail.com> wrote:
>
> I followed section 2.2 in http://hbase.apache.org/book.html#quickstart in
> working directory of hbase-1 branch.
>
> Here is my hbase-site.xml :
> <configuration>
> <property>
> <name>hbase.rootdir</name>
> <value>file:////Users/tyu/tmp</value>
> </property>
> <property>
> <name>hbase.zookeeper.property.dataDir</name>
> <value>/Users/tyu/tmp/zk</value>
> </property>
> </configuration>
>
> I then typed 'bin/start-hbase.sh'
>
> jps command shows HMaster process.
>
> bq. zookeeper is never launched by hbase from the output of jps -l.
> See the following in item 5 of 2.2:
> In standalone mode HBase runs all daemons within this single JVM, i.e. the
> HMaster, a single HRegionServer, and the ZooKeeper daemon.
>
> Can you tell us the version of HBase you run with ?
> From io.prediction.data.storage.StorageClientException , it seems you have
> your own build.
>
> Cheers
>
> On Sat, Mar 21, 2015 at 12:43 PM, Pat Ferrel <pa...@occamsmachete.com>
> wrote:
>
> > I’m trying to run the standalone HBase with the Zookeeper that it
> > launches, on a Mac
> >
> > I’ve carefully gone through the quickstart and get the error below. I’ve
> > also done the following things to try to resolve this.
> > 1) According to the Hbase quickstart the dataDir is supposed to not
> exist
> > so Hbase won’t do a migration and so I’ve tried with an empty one and a
> > non-existent dataDir, same error. Also the default is to use /tmp/… which
> > is fine no specified hbase.zookeeper.property.dataDir too but no help.
> > 2) HBASE_MANAGES_ZK was unset but is defaulted to true, setting it
> > explicitly to true gives the same error.
> > 3) Some suggestions tell you to remove any ipv6 references to localhost
> in
> > /etc/hosts so I did that to no avail.
> > 4) zookeeper is never launched by hbase from the output of jps -l.
> >
> > When I launch the HBase shell and run “help” is works but when I run
> > “status” it throws and exception.
> >
> > [ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
> > [ERROR] [ZooKeeperWatcher] hconnection-0x3bb25aa6, quorum=localhost:2181,
> > baseZNode=/hbase Received unexpected KeeperException, re-throwing
> exception
> > [WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
> > [ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble:
> > localhost). Please make sure that the configuration is pointing at the
> > correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper,
> so
> > if you have not configured HBase to use an external ZooKeeper, that means
> > your HBase is not started or configured properly.
> > [ERROR] [Storage$] Error initializing storage client for source HBASE
> > [ERROR] [Storage$] Can't connect to ZooKeeper
> > io.prediction.data.storage.StorageClientException: Data source HBASE was
> > not properly initialized.
> > at
> > io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
> > at
> > io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
> > at scala.Option.getOrElse(Option.scala:120)
> > at
> > io.prediction.data.storage.Storage$.getDataObject(Storage.scala:181)
> > at
> > io.prediction.data.storage.Storage$.getDataObject(Storage.scala:166)
> > at
> > io.prediction.data.storage.Storage$.getLEvents(Storage.scala:274)
> > at
> >
> io.prediction.data.storage.Storage$.verifyAllDataObjects(Storage.scala:240)
> > at io.prediction.tools.console.Console$.status(Console.scala:968)
> > at
> >
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
> > at
> >
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:573)
> > at scala.Option.map(Option.scala:145)
> > at io.prediction.tools.console.Console$.main(Console.scala:573)
> > at io.prediction.tools.console.Console.main(Console.scala)
> >
> > All the log output says is:
> >
> > SLF4J: Class path contains multiple SLF4J bindings.
> > SLF4J: Found binding in
> >
> [jar:file:/Users/pat/hbase/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: Found binding in
> >
> [jar:file:/Users/pat/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
> > http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
> > [WARN] [NativeCodeLoader] Unable to load native-hadoop library for your
> > platform... using builtin-java classes where applicable
> > [INFO] [log] Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
> > via org.mortbay.log.Slf4jLog
> > [INFO] [log] jetty-6.1.26
> > [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
> > SelectChannelConnector@0.0.0.0>:61342
> > [INFO] [log] jetty-6.1.26
> > [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
> > SelectChannelConnector@0.0.0.0>:60010
> > [FATAL] [HMaster] Unhandled exception. Starting shutdown.
> > [INFO] [log] Stopped SelectChannelConnector@0.0.0.0 <mailto:
> > SelectChannelConnector@0.0.0.0>:60010
>
>
Re: HBase standalone ZooKeeper error
Posted by Pat Ferrel <pa...@occamsmachete.com>.
No, from the binary tar for hbase-0.98.11-hadoop2 trying to run locally standalone with native FS. I’ve carefully gone through the quickstart using the minimal config. BTW HBase will work with Java 7 I assume?
The trace was from an app that uses HBase but I get the same when running “status” in the HBase shell. The shell launches and can get help but nothing that actually uses the DB. So “status” crashes HBase with the same error.
The comment about ZooKeeper was to point out that there was no separate instance of Zookeeper running. Not sure why it thinks ZooKeeper “exists”?
I’ve set those both to local filesystem non-existent dirs since no startup has initialized them yet. But I’ve tried setting them to empty dirs too.
<configuration>
<property>
<name>hbase.rootdir</name>
<value>file:///Users/pat/hbase-data</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/Users/pat/zookeeper-data</value>
</property>
</configuration>
On Mar 21, 2015, at 1:04 PM, Ted Yu <yu...@gmail.com> wrote:
I followed section 2.2 in http://hbase.apache.org/book.html#quickstart in
working directory of hbase-1 branch.
Here is my hbase-site.xml :
<configuration>
<property>
<name>hbase.rootdir</name>
<value>file:////Users/tyu/tmp</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/Users/tyu/tmp/zk</value>
</property>
</configuration>
I then typed 'bin/start-hbase.sh'
jps command shows HMaster process.
bq. zookeeper is never launched by hbase from the output of jps -l.
See the following in item 5 of 2.2:
In standalone mode HBase runs all daemons within this single JVM, i.e. the
HMaster, a single HRegionServer, and the ZooKeeper daemon.
Can you tell us the version of HBase you run with ?
From io.prediction.data.storage.StorageClientException , it seems you have
your own build.
Cheers
On Sat, Mar 21, 2015 at 12:43 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> I’m trying to run the standalone HBase with the Zookeeper that it
> launches, on a Mac
>
> I’ve carefully gone through the quickstart and get the error below. I’ve
> also done the following things to try to resolve this.
> 1) According to the Hbase quickstart the dataDir is supposed to not exist
> so Hbase won’t do a migration and so I’ve tried with an empty one and a
> non-existent dataDir, same error. Also the default is to use /tmp/… which
> is fine no specified hbase.zookeeper.property.dataDir too but no help.
> 2) HBASE_MANAGES_ZK was unset but is defaulted to true, setting it
> explicitly to true gives the same error.
> 3) Some suggestions tell you to remove any ipv6 references to localhost in
> /etc/hosts so I did that to no avail.
> 4) zookeeper is never launched by hbase from the output of jps -l.
>
> When I launch the HBase shell and run “help” is works but when I run
> “status” it throws and exception.
>
> [ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
> [ERROR] [ZooKeeperWatcher] hconnection-0x3bb25aa6, quorum=localhost:2181,
> baseZNode=/hbase Received unexpected KeeperException, re-throwing exception
> [WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
> [ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble:
> localhost). Please make sure that the configuration is pointing at the
> correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper, so
> if you have not configured HBase to use an external ZooKeeper, that means
> your HBase is not started or configured properly.
> [ERROR] [Storage$] Error initializing storage client for source HBASE
> [ERROR] [Storage$] Can't connect to ZooKeeper
> io.prediction.data.storage.StorageClientException: Data source HBASE was
> not properly initialized.
> at
> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
> at
> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
> at scala.Option.getOrElse(Option.scala:120)
> at
> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:181)
> at
> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:166)
> at
> io.prediction.data.storage.Storage$.getLEvents(Storage.scala:274)
> at
> io.prediction.data.storage.Storage$.verifyAllDataObjects(Storage.scala:240)
> at io.prediction.tools.console.Console$.status(Console.scala:968)
> at
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
> at
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:573)
> at scala.Option.map(Option.scala:145)
> at io.prediction.tools.console.Console$.main(Console.scala:573)
> at io.prediction.tools.console.Console.main(Console.scala)
>
> All the log output says is:
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/Users/pat/hbase/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/Users/pat/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
> http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
> [WARN] [NativeCodeLoader] Unable to load native-hadoop library for your
> platform... using builtin-java classes where applicable
> [INFO] [log] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
> via org.mortbay.log.Slf4jLog
> [INFO] [log] jetty-6.1.26
> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
> SelectChannelConnector@0.0.0.0>:61342
> [INFO] [log] jetty-6.1.26
> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
> SelectChannelConnector@0.0.0.0>:60010
> [FATAL] [HMaster] Unhandled exception. Starting shutdown.
> [INFO] [log] Stopped SelectChannelConnector@0.0.0.0 <mailto:
> SelectChannelConnector@0.0.0.0>:60010
Re: HBase standalone ZooKeeper error
Posted by Ted Yu <yu...@gmail.com>.
I followed section 2.2 in http://hbase.apache.org/book.html#quickstart in
working directory of hbase-1 branch.
Here is my hbase-site.xml :
<configuration>
<property>
<name>hbase.rootdir</name>
<value>file:////Users/tyu/tmp</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/Users/tyu/tmp/zk</value>
</property>
</configuration>
I then typed 'bin/start-hbase.sh'
jps command shows HMaster process.
bq. zookeeper is never launched by hbase from the output of jps -l.
See the following in item 5 of 2.2:
In standalone mode HBase runs all daemons within this single JVM, i.e. the
HMaster, a single HRegionServer, and the ZooKeeper daemon.
Can you tell us the version of HBase you run with ?
>From io.prediction.data.storage.StorageClientException , it seems you have
your own build.
Cheers
On Sat, Mar 21, 2015 at 12:43 PM, Pat Ferrel <pa...@occamsmachete.com> wrote:
> I’m trying to run the standalone HBase with the Zookeeper that it
> launches, on a Mac
>
> I’ve carefully gone through the quickstart and get the error below. I’ve
> also done the following things to try to resolve this.
> 1) According to the Hbase quickstart the dataDir is supposed to not exist
> so Hbase won’t do a migration and so I’ve tried with an empty one and a
> non-existent dataDir, same error. Also the default is to use /tmp/… which
> is fine no specified hbase.zookeeper.property.dataDir too but no help.
> 2) HBASE_MANAGES_ZK was unset but is defaulted to true, setting it
> explicitly to true gives the same error.
> 3) Some suggestions tell you to remove any ipv6 references to localhost in
> /etc/hosts so I did that to no avail.
> 4) zookeeper is never launched by hbase from the output of jps -l.
>
> When I launch the HBase shell and run “help” is works but when I run
> “status” it throws and exception.
>
> [ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
> [ERROR] [ZooKeeperWatcher] hconnection-0x3bb25aa6, quorum=localhost:2181,
> baseZNode=/hbase Received unexpected KeeperException, re-throwing exception
> [WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
> [ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble:
> localhost). Please make sure that the configuration is pointing at the
> correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper, so
> if you have not configured HBase to use an external ZooKeeper, that means
> your HBase is not started or configured properly.
> [ERROR] [Storage$] Error initializing storage client for source HBASE
> [ERROR] [Storage$] Can't connect to ZooKeeper
> io.prediction.data.storage.StorageClientException: Data source HBASE was
> not properly initialized.
> at
> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
> at
> io.prediction.data.storage.Storage$$anonfun$9.apply(Storage.scala:182)
> at scala.Option.getOrElse(Option.scala:120)
> at
> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:181)
> at
> io.prediction.data.storage.Storage$.getDataObject(Storage.scala:166)
> at
> io.prediction.data.storage.Storage$.getLEvents(Storage.scala:274)
> at
> io.prediction.data.storage.Storage$.verifyAllDataObjects(Storage.scala:240)
> at io.prediction.tools.console.Console$.status(Console.scala:968)
> at
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:611)
> at
> io.prediction.tools.console.Console$$anonfun$main$1.apply(Console.scala:573)
> at scala.Option.map(Option.scala:145)
> at io.prediction.tools.console.Console$.main(Console.scala:573)
> at io.prediction.tools.console.Console.main(Console.scala)
>
> All the log output says is:
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/Users/pat/hbase/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/Users/pat/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings <
> http://www.slf4j.org/codes.html#multiple_bindings> for an explanation.
> [WARN] [NativeCodeLoader] Unable to load native-hadoop library for your
> platform... using builtin-java classes where applicable
> [INFO] [log] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
> via org.mortbay.log.Slf4jLog
> [INFO] [log] jetty-6.1.26
> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
> SelectChannelConnector@0.0.0.0>:61342
> [INFO] [log] jetty-6.1.26
> [INFO] [log] Started SelectChannelConnector@0.0.0.0 <mailto:
> SelectChannelConnector@0.0.0.0>:60010
> [FATAL] [HMaster] Unhandled exception. Starting shutdown.
> [INFO] [log] Stopped SelectChannelConnector@0.0.0.0 <mailto:
> SelectChannelConnector@0.0.0.0>:60010