You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by charles du <ta...@gmail.com> on 2009/09/09 03:13:15 UTC
hbase and map/reduce hookup
Hi:
I installed hbase 0.19.3 and hadoop 0.19.1. I tried to run the BulkImport
example on http://wiki.apache.org/hadoop/Hbase/MapReduce, get the following
error.
"org.apache.hadoop.hbase.MasterNotRunningException: localhost:60000"
>From the error message, it looks like the hadoop looks at the wrong place
for the hbase configuration. I added paths to hbase-0.19.3.jar,
hbase-0.19.3-test.jar, hbase/conf to ""export HADOOP_CLASSPATH =" in
'hadoop-env.sh', populated the change to every hadoop machine, and restarted
hadoop.
Is there anything else I need do? btw: 'hbase shell' and my java program to
scan hbase works fine.
Thanks.
--
tp
Re: hbase and map/reduce hookup
Posted by charles du <ta...@gmail.com>.
Thanks a lot for your help.
I found the problem. I put "hbase/src/test" in the HADOOP_PATH before
"hbase/conf". And "hbase/src/test" happens to have a hbase-site.xml that got
picked by my map/reduce program. After I removed it, everything works fine
now. Thanks.
Regards
tp
On Wed, Sep 9, 2009 at 2:35 PM, stack <st...@duboce.net> wrote:
> Something is up. You don't have a zoo.cfg lying about the CLASSPATH by any
> chance, do you?
> St.Ack
>
> On Wed, Sep 9, 2009 at 2:25 PM, charles du <ta...@gmail.com> wrote:
>
> > Hi Stack:
> >
> > Thanks for the reply. Yes. I set the full-path to hbase/conf.
> >
> > Actually, I printed out all environmental variables in my map/reduce
> > program, and I can see HADOOP_PATH is set to the right place (to hbase
> jar,
> > and hbase conf directory)
> >
> > Just want to double check, if everything works fine, my map/reduce
> program
> > should look for <master_machine>:60000 instead of localhost:60000, right?
> >
> > Regards
> >
> > tp
> >
> > On Wed, Sep 9, 2009 at 6:45 AM, stack <st...@duboce.net> wrote:
> >
> > > On Tue, Sep 8, 2009 at 6:13 PM, charles du <ta...@gmail.com>
> wrote:
> > >
> > > > Hi:
> > > >
> > > > I installed hbase 0.19.3 and hadoop 0.19.1. I tried to run the
> > BulkImport
> > > > example on http://wiki.apache.org/hadoop/Hbase/MapReduce, get the
> > > > following
> > > > error.
> > > >
> > > > "org.apache.hadoop.hbase.MasterNotRunningException:
> > > localhost:60000"
> > > >
> > > > From the error message, it looks like the hadoop looks at the wrong
> > place
> > > > for the hbase configuration. I added paths to hbase-0.19.3.jar,
> > > > hbase-0.19.3-test.jar, hbase/conf to ""export HADOOP_CLASSPATH =" in
> > > > 'hadoop-env.sh', populated the change to every hadoop machine, and
> > > > restarted
> > > > hadoop.
> > > >
> > > >
> > > It looks like you are doing all the right stuff and I'd agree with your
> > > speculation, that its not finding the hbase configuration. You have
> set
> > > full paths to hbase/conf directory in HADOOP_CLASSPATH?
> > >
> > > St.Ack
> > >
> >
> >
> >
> > --
> > tp
> >
>
--
tp
Re: hbase and map/reduce hookup
Posted by stack <st...@duboce.net>.
Something is up. You don't have a zoo.cfg lying about the CLASSPATH by any
chance, do you?
St.Ack
On Wed, Sep 9, 2009 at 2:25 PM, charles du <ta...@gmail.com> wrote:
> Hi Stack:
>
> Thanks for the reply. Yes. I set the full-path to hbase/conf.
>
> Actually, I printed out all environmental variables in my map/reduce
> program, and I can see HADOOP_PATH is set to the right place (to hbase jar,
> and hbase conf directory)
>
> Just want to double check, if everything works fine, my map/reduce program
> should look for <master_machine>:60000 instead of localhost:60000, right?
>
> Regards
>
> tp
>
> On Wed, Sep 9, 2009 at 6:45 AM, stack <st...@duboce.net> wrote:
>
> > On Tue, Sep 8, 2009 at 6:13 PM, charles du <ta...@gmail.com> wrote:
> >
> > > Hi:
> > >
> > > I installed hbase 0.19.3 and hadoop 0.19.1. I tried to run the
> BulkImport
> > > example on http://wiki.apache.org/hadoop/Hbase/MapReduce, get the
> > > following
> > > error.
> > >
> > > "org.apache.hadoop.hbase.MasterNotRunningException:
> > localhost:60000"
> > >
> > > From the error message, it looks like the hadoop looks at the wrong
> place
> > > for the hbase configuration. I added paths to hbase-0.19.3.jar,
> > > hbase-0.19.3-test.jar, hbase/conf to ""export HADOOP_CLASSPATH =" in
> > > 'hadoop-env.sh', populated the change to every hadoop machine, and
> > > restarted
> > > hadoop.
> > >
> > >
> > It looks like you are doing all the right stuff and I'd agree with your
> > speculation, that its not finding the hbase configuration. You have set
> > full paths to hbase/conf directory in HADOOP_CLASSPATH?
> >
> > St.Ack
> >
>
>
>
> --
> tp
>
Re: hbase and map/reduce hookup
Posted by charles du <ta...@gmail.com>.
Hi Stack:
Thanks for the reply. Yes. I set the full-path to hbase/conf.
Actually, I printed out all environmental variables in my map/reduce
program, and I can see HADOOP_PATH is set to the right place (to hbase jar,
and hbase conf directory)
Just want to double check, if everything works fine, my map/reduce program
should look for <master_machine>:60000 instead of localhost:60000, right?
Regards
tp
On Wed, Sep 9, 2009 at 6:45 AM, stack <st...@duboce.net> wrote:
> On Tue, Sep 8, 2009 at 6:13 PM, charles du <ta...@gmail.com> wrote:
>
> > Hi:
> >
> > I installed hbase 0.19.3 and hadoop 0.19.1. I tried to run the BulkImport
> > example on http://wiki.apache.org/hadoop/Hbase/MapReduce, get the
> > following
> > error.
> >
> > "org.apache.hadoop.hbase.MasterNotRunningException:
> localhost:60000"
> >
> > From the error message, it looks like the hadoop looks at the wrong place
> > for the hbase configuration. I added paths to hbase-0.19.3.jar,
> > hbase-0.19.3-test.jar, hbase/conf to ""export HADOOP_CLASSPATH =" in
> > 'hadoop-env.sh', populated the change to every hadoop machine, and
> > restarted
> > hadoop.
> >
> >
> It looks like you are doing all the right stuff and I'd agree with your
> speculation, that its not finding the hbase configuration. You have set
> full paths to hbase/conf directory in HADOOP_CLASSPATH?
>
> St.Ack
>
--
tp
Re: hbase and map/reduce hookup
Posted by stack <st...@duboce.net>.
On Tue, Sep 8, 2009 at 6:13 PM, charles du <ta...@gmail.com> wrote:
> Hi:
>
> I installed hbase 0.19.3 and hadoop 0.19.1. I tried to run the BulkImport
> example on http://wiki.apache.org/hadoop/Hbase/MapReduce, get the
> following
> error.
>
> "org.apache.hadoop.hbase.MasterNotRunningException: localhost:60000"
>
> From the error message, it looks like the hadoop looks at the wrong place
> for the hbase configuration. I added paths to hbase-0.19.3.jar,
> hbase-0.19.3-test.jar, hbase/conf to ""export HADOOP_CLASSPATH =" in
> 'hadoop-env.sh', populated the change to every hadoop machine, and
> restarted
> hadoop.
>
>
It looks like you are doing all the right stuff and I'd agree with your
speculation, that its not finding the hbase configuration. You have set
full paths to hbase/conf directory in HADOOP_CLASSPATH?
St.Ack