You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Harold Lim <ro...@yahoo.com> on 2009/05/12 18:59:06 UTC
Hadoop file system + HBase
Hi All,
What is the ideal set up for HDFS and HBase?
Do I install my HBase regionservers on the same machines that have HDFS datanodes?
Or, is it better to separate all of them?
Thanks,
Harold
RE: Hadoop file system + HBase
Posted by Harold Lim <ro...@yahoo.com>.
Thanks for the tip.
-Harold
--- On Tue, 5/12/09, Jim Kellerman (POWERSET) <Ji...@microsoft.com> wrote:
> From: Jim Kellerman (POWERSET) <Ji...@microsoft.com>
> Subject: RE: Hadoop file system + HBase
> To: "hbase-user@hadoop.apache.org" <hb...@hadoop.apache.org>, "rold_50@yahoo.com" <ro...@yahoo.com>
> Date: Tuesday, May 12, 2009, 1:52 PM
> We usually run the namenode and the HBase master on the same
> machine.
>
> Caveat, any machine that is not at least a dual core will
> have problems
> running either Hadoop or HBase as both are very thread
> intensive.
>
> ---
> Jim Kellerman, Powerset (Live Search, Microsoft
> Corporation)
>
> > -----Original Message-----
> > From: Harold Lim [mailto:rold_50@yahoo.com]
> > Sent: Tuesday, May 12, 2009 10:28 AM
> > To: hbase-user@hadoop.apache.org; stack
> > Subject: Re: Hadoop file system + HBase
> >
> >
> > Great. Thanks.
> >
> > What about the HDFS NameNode and Hadoop Master? Do you
> separate them
> > or put them on the same machine?
> >
> >
> > -Harold
> >
> >
> > --- On Tue, 5/12/09, stack <st...@duboce.net>
> wrote:
> >
> > > From: stack <st...@duboce.net>
> > > Subject: Re: Hadoop file system + HBase
> > > To: hbase-user@hadoop.apache.org,
> rold_50@yahoo.com
> > > Date: Tuesday, May 12, 2009, 1:10 PM
> > > On Tue, May 12, 2009 at 9:59 AM, Harold Lim
> > > <ro...@yahoo.com> wrote:
> > >
> > > >
> > > > Do I install my HBase regionservers on the
> same
> > > machines that have HDFS
> > > > datanodes?
> > > >
> > >
> > >
> > > Run the regionserver beside the datanode; thats
> how most of
> > > us do it. You
> > > could separate them; there'd probably be
> little
> > > difference in performance
> > > (but I haven't measured of late).
> > > St.Ack
> >
> >
> >
RE: Hadoop file system + HBase
Posted by "Jim Kellerman (POWERSET)" <Ji...@microsoft.com>.
We usually run the namenode and the HBase master on the same machine.
Caveat, any machine that is not at least a dual core will have problems
running either Hadoop or HBase as both are very thread intensive.
---
Jim Kellerman, Powerset (Live Search, Microsoft Corporation)
> -----Original Message-----
> From: Harold Lim [mailto:rold_50@yahoo.com]
> Sent: Tuesday, May 12, 2009 10:28 AM
> To: hbase-user@hadoop.apache.org; stack
> Subject: Re: Hadoop file system + HBase
>
>
> Great. Thanks.
>
> What about the HDFS NameNode and Hadoop Master? Do you separate them
> or put them on the same machine?
>
>
> -Harold
>
>
> --- On Tue, 5/12/09, stack <st...@duboce.net> wrote:
>
> > From: stack <st...@duboce.net>
> > Subject: Re: Hadoop file system + HBase
> > To: hbase-user@hadoop.apache.org, rold_50@yahoo.com
> > Date: Tuesday, May 12, 2009, 1:10 PM
> > On Tue, May 12, 2009 at 9:59 AM, Harold Lim
> > <ro...@yahoo.com> wrote:
> >
> > >
> > > Do I install my HBase regionservers on the same
> > machines that have HDFS
> > > datanodes?
> > >
> >
> >
> > Run the regionserver beside the datanode; thats how most of
> > us do it. You
> > could separate them; there'd probably be little
> > difference in performance
> > (but I haven't measured of late).
> > St.Ack
>
>
>
Re: Hadoop file system + HBase
Posted by Harold Lim <ro...@yahoo.com>.
Great. Thanks.
What about the HDFS NameNode and Hadoop Master? Do you separate them or put them on the same machine?
-Harold
--- On Tue, 5/12/09, stack <st...@duboce.net> wrote:
> From: stack <st...@duboce.net>
> Subject: Re: Hadoop file system + HBase
> To: hbase-user@hadoop.apache.org, rold_50@yahoo.com
> Date: Tuesday, May 12, 2009, 1:10 PM
> On Tue, May 12, 2009 at 9:59 AM, Harold Lim
> <ro...@yahoo.com> wrote:
>
> >
> > Do I install my HBase regionservers on the same
> machines that have HDFS
> > datanodes?
> >
>
>
> Run the regionserver beside the datanode; thats how most of
> us do it. You
> could separate them; there'd probably be little
> difference in performance
> (but I haven't measured of late).
> St.Ack
Re: Hadoop file system + HBase
Posted by stack <st...@duboce.net>.
On Tue, May 12, 2009 at 9:59 AM, Harold Lim <ro...@yahoo.com> wrote:
>
> Do I install my HBase regionservers on the same machines that have HDFS
> datanodes?
>
Run the regionserver beside the datanode; thats how most of us do it. You
could separate them; there'd probably be little difference in performance
(but I haven't measured of late).
St.Ack