You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Mikhail Bautin <mb...@gmail.com> on 2009/07/25 00:52:51 UTC
Problems setting up HBase 0.19.3 locally
Hello Everyone,
I've been trying to set up a local instance of HBase using instructions from
http://wiki.apache.org/hadoop/Hbase/10Minutes. I've redefined hbase.rootdir
to point to an empty local filesystem directory. When I try to start HBase,
I get the following:
$ ./start-hbase.sh
starting master, logging to
/home/mbautin/test/hbase/hbase-0.19.3/bin/../logs/hbase-mbautin-master-localhost.out
WARNING! File system needs to be upgraded. Run the '${HBASE_HOME}/bin/hbase
migrate' script.
localhost: starting regionserver, logging to
/home/mbautin/test/hbase/hbase-0.19.3/bin/../logs/hbase-mbautin-regionserver-localhost.out
and the master does not start, leaving the following message in the log:
2009-07-24 18:47:21,820 ERROR org.apache.hadoop.hbase.master.HMaster: Can
not start master
org.apache.hadoop.hbase.util.FileSystemVersionException: File system needs
to be upgraded. Run the '${HBASE_HOME}/bin/hbase migrate' script.
at
org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:129)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:212)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:156)
at
org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:96)
at
org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:78)
at org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1013)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1057)
However, when I run "hbase migrate upgrade", I get
$ ./hbase migrate upgrade
09/07/24 18:49:30 INFO util.Migrate: Verifying that file system is
available..
09/07/24 18:49:30 INFO util.Migrate: Verifying that HBase is not
running....Trys ten times to connect to running master
09/07/24 18:49:32 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 0 time(s).
09/07/24 18:49:33 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 1 time(s).
09/07/24 18:49:34 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 2 time(s).
09/07/24 18:49:35 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 3 time(s).
09/07/24 18:49:36 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 4 time(s).
09/07/24 18:49:37 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 5 time(s).
09/07/24 18:49:38 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 6 time(s).
09/07/24 18:49:39 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 7 time(s).
09/07/24 18:49:40 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 8 time(s).
09/07/24 18:49:41 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 9 time(s).
09/07/24 18:49:41 INFO util.Migrate: Starting upgrade
09/07/24 18:49:41 FATAL util.Migrate: Upgrade failed
java.io.IOException: File system version file hbase.version does not exist.
No upgrade possible. See
http://wiki.apache.org/hadoop/Hbase/HowToMigratefor more information.
at org.apache.hadoop.hbase.util.Migrate.run(Migrate.java:175)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.hbase.util.Migrate.main(Migrate.java:357)
which is reasonable, because the rootdir is empty. Please let me know how to
initiailize the HBase data directory correctly before starting HBase locally
for the first time.
Thanks,
Mikhail
Re: Problems setting up HBase 0.19.3 locally
Posted by Mikhail Bautin <mb...@gmail.com>.
Hi Ron,
Thanks a lot! Your suggestion worked. Apparently, HBase does initialize
its rootdir automatically if it does not exist, whether running locally or
on top of Hadoop.
Regard,
Mikhail
On Fri, Jul 24, 2009 at 7:05 PM, Taylor, Ronald C <ro...@pnl.gov>wrote:
>
> Hi Mikhail,
>
> I'm just another Hbase novice, but got one piece of info that may be
> helpful: I know when you name your rootdir and you are running on top of
> Hadoop, you are supposed to let Hbase itself actually do the creation of
> that directory within HDFS upon startup - you don't create it beforehand
> manually. So - maybe the same thing holds true when you are running on
> your local file system, and not Hadoop? That is, maybe you need to name
> a non-existent directory that will get automatically created. Otherwise
> the problem may be that Hbase always thinks a migration needs to be
> done.
> Ron
>
> ___________________________________________
> Ronald Taylor, Ph.D.
> Computational Biology & Bioinformatics Group
> Pacific Northwest National Laboratory
> 902 Battelle Boulevard
> P.O. Box 999, MSIN K7-90
> Richland, WA 99352 USA
> Office: 509-372-6568
> Email: ronald.taylor@pnl.gov
> www.pnl.gov
>
> -----Original Message-----
> From: Mikhail Bautin [mailto:mbautin@gmail.com]
> Sent: Friday, July 24, 2009 3:53 PM
> To: hbase-user@hadoop.apache.org
> Subject: Problems setting up HBase 0.19.3 locally
>
> Hello Everyone,
>
> I've been trying to set up a local instance of HBase using instructions
> from http://wiki.apache.org/hadoop/Hbase/10Minutes. I've redefined
> hbase.rootdir to point to an empty local filesystem directory. When I
> try to start HBase, I get the following:
>
> $ ./start-hbase.sh
> starting master, logging to
> /home/mbautin/test/hbase/hbase-0.19.3/bin/../logs/hbase-mbautin-master-l
> ocalhost.out
> WARNING! File system needs to be upgraded. Run the
> '${HBASE_HOME}/bin/hbase migrate' script.
> localhost: starting regionserver, logging to
> /home/mbautin/test/hbase/hbase-0.19.3/bin/../logs/hbase-mbautin-regionse
> rver-localhost.out
>
> and the master does not start, leaving the following message in the log:
>
> 2009-07-24 18:47:21,820 ERROR org.apache.hadoop.hbase.master.HMaster:
> Can not start master
> org.apache.hadoop.hbase.util.FileSystemVersionException: File system
> needs to be upgraded. Run the '${HBASE_HOME}/bin/hbase migrate' script.
> at
> org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:129)
> at
> org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:212)
> at
> org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:156)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:
> 96)
> at
> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:
> 78)
> at
> org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1013)
> at
> org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1057)
>
> However, when I run "hbase migrate upgrade", I get
>
> $ ./hbase migrate upgrade
> 09/07/24 18:49:30 INFO util.Migrate: Verifying that file system is
> available..
> 09/07/24 18:49:30 INFO util.Migrate: Verifying that HBase is not
> running....Trys ten times to connect to running master
> 09/07/24 18:49:32 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 0 time(s).
> 09/07/24 18:49:33 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 1 time(s).
> 09/07/24 18:49:34 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 2 time(s).
> 09/07/24 18:49:35 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 3 time(s).
> 09/07/24 18:49:36 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 4 time(s).
> 09/07/24 18:49:37 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 5 time(s).
> 09/07/24 18:49:38 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 6 time(s).
> 09/07/24 18:49:39 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 7 time(s).
> 09/07/24 18:49:40 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 8 time(s).
> 09/07/24 18:49:41 INFO ipc.HBaseClass: Retrying connect to server:
> localhost/127.0.0.1:60000. Already tried 9 time(s).
> 09/07/24 18:49:41 INFO util.Migrate: Starting upgrade
> 09/07/24 18:49:41 FATAL util.Migrate: Upgrade failed
> java.io.IOException: File system version file hbase.version does not
> exist.
> No upgrade possible. See
> http://wiki.apache.org/hadoop/Hbase/HowToMigratefor more information.
> at org.apache.hadoop.hbase.util.Migrate.run(Migrate.java:175)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.hbase.util.Migrate.main(Migrate.java:357)
>
> which is reasonable, because the rootdir is empty. Please let me know
> how to initiailize the HBase data directory correctly before starting
> HBase locally for the first time.
>
> Thanks,
> Mikhail
>
RE: Problems setting up HBase 0.19.3 locally
Posted by "Taylor, Ronald C" <ro...@pnl.gov>.
Hi Mikhail,
I'm just another Hbase novice, but got one piece of info that may be
helpful: I know when you name your rootdir and you are running on top of
Hadoop, you are supposed to let Hbase itself actually do the creation of
that directory within HDFS upon startup - you don't create it beforehand
manually. So - maybe the same thing holds true when you are running on
your local file system, and not Hadoop? That is, maybe you need to name
a non-existent directory that will get automatically created. Otherwise
the problem may be that Hbase always thinks a migration needs to be
done.
Ron
___________________________________________
Ronald Taylor, Ph.D.
Computational Biology & Bioinformatics Group
Pacific Northwest National Laboratory
902 Battelle Boulevard
P.O. Box 999, MSIN K7-90
Richland, WA 99352 USA
Office: 509-372-6568
Email: ronald.taylor@pnl.gov
www.pnl.gov
-----Original Message-----
From: Mikhail Bautin [mailto:mbautin@gmail.com]
Sent: Friday, July 24, 2009 3:53 PM
To: hbase-user@hadoop.apache.org
Subject: Problems setting up HBase 0.19.3 locally
Hello Everyone,
I've been trying to set up a local instance of HBase using instructions
from http://wiki.apache.org/hadoop/Hbase/10Minutes. I've redefined
hbase.rootdir to point to an empty local filesystem directory. When I
try to start HBase, I get the following:
$ ./start-hbase.sh
starting master, logging to
/home/mbautin/test/hbase/hbase-0.19.3/bin/../logs/hbase-mbautin-master-l
ocalhost.out
WARNING! File system needs to be upgraded. Run the
'${HBASE_HOME}/bin/hbase migrate' script.
localhost: starting regionserver, logging to
/home/mbautin/test/hbase/hbase-0.19.3/bin/../logs/hbase-mbautin-regionse
rver-localhost.out
and the master does not start, leaving the following message in the log:
2009-07-24 18:47:21,820 ERROR org.apache.hadoop.hbase.master.HMaster:
Can not start master
org.apache.hadoop.hbase.util.FileSystemVersionException: File system
needs to be upgraded. Run the '${HBASE_HOME}/bin/hbase migrate' script.
at
org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:129)
at
org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:212)
at
org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:156)
at
org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:
96)
at
org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:
78)
at
org.apache.hadoop.hbase.master.HMaster.doMain(HMaster.java:1013)
at
org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1057)
However, when I run "hbase migrate upgrade", I get
$ ./hbase migrate upgrade
09/07/24 18:49:30 INFO util.Migrate: Verifying that file system is
available..
09/07/24 18:49:30 INFO util.Migrate: Verifying that HBase is not
running....Trys ten times to connect to running master
09/07/24 18:49:32 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 0 time(s).
09/07/24 18:49:33 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 1 time(s).
09/07/24 18:49:34 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 2 time(s).
09/07/24 18:49:35 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 3 time(s).
09/07/24 18:49:36 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 4 time(s).
09/07/24 18:49:37 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 5 time(s).
09/07/24 18:49:38 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 6 time(s).
09/07/24 18:49:39 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 7 time(s).
09/07/24 18:49:40 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 8 time(s).
09/07/24 18:49:41 INFO ipc.HBaseClass: Retrying connect to server:
localhost/127.0.0.1:60000. Already tried 9 time(s).
09/07/24 18:49:41 INFO util.Migrate: Starting upgrade
09/07/24 18:49:41 FATAL util.Migrate: Upgrade failed
java.io.IOException: File system version file hbase.version does not
exist.
No upgrade possible. See
http://wiki.apache.org/hadoop/Hbase/HowToMigratefor more information.
at org.apache.hadoop.hbase.util.Migrate.run(Migrate.java:175)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.hbase.util.Migrate.main(Migrate.java:357)
which is reasonable, because the rootdir is empty. Please let me know
how to initiailize the HBase data directory correctly before starting
HBase locally for the first time.
Thanks,
Mikhail