You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by edward choi <mp...@gmail.com> on 2011/03/08 06:42:20 UTC
Does HBase use spaces of HDFS?
Sorry for this totally newbie question.
I'm just wondering if HBase uses HDFS space.
I read it in the reference book that HBase table size increases
automatically as the table entry increases.
So I am guessing that HBase manages a separate storage other than HDFS. (But
then why does HBase operate on top of HDFS? Truly confusing...)
If HBase doesn't use HDFS space, I can designate only a single machine to be
a HDFS slave, and assign bunch of other machines to be HBase slaves.
But if HBase does use HDFS space, I'd have balance the ratio of HDFS and
HBase within my machines.
Could anyone give me a clear heads up?
Ed
Re: Does HBase use spaces of HDFS?
Posted by edward choi <mp...@gmail.com>.
Thanks for the info.
That link you referred me to was great!!
Thanks again :)
Ed
2011/3/8 Suraj Varma <sv...@gmail.com>
> In the standalone mode, HBase uses the local file system as its storage. In
> pseudo-distributed and fully-distributed modes, HBase uses HDFS as the
> storage.
> See http://hbase.apache.org/notsoquick.html for more details on the
> different modes.
>
> For details on storage, see
> http://www.larsgeorge.com/2009/10/hbase-architecture-101-storage.html
> --Suraj
>
> On Mon, Mar 7, 2011 at 9:42 PM, edward choi <mp...@gmail.com> wrote:
>
> > Sorry for this totally newbie question.
> >
> > I'm just wondering if HBase uses HDFS space.
> >
> > I read it in the reference book that HBase table size increases
> > automatically as the table entry increases.
> > So I am guessing that HBase manages a separate storage other than HDFS.
> > (But
> > then why does HBase operate on top of HDFS? Truly confusing...)
> >
> > If HBase doesn't use HDFS space, I can designate only a single machine to
> > be
> > a HDFS slave, and assign bunch of other machines to be HBase slaves.
> > But if HBase does use HDFS space, I'd have balance the ratio of HDFS and
> > HBase within my machines.
> >
> > Could anyone give me a clear heads up?
> >
> > Ed
> >
>
Re: Does HBase use spaces of HDFS?
Posted by Suraj Varma <sv...@gmail.com>.
In the standalone mode, HBase uses the local file system as its storage. In
pseudo-distributed and fully-distributed modes, HBase uses HDFS as the
storage.
See http://hbase.apache.org/notsoquick.html for more details on the
different modes.
For details on storage, see
http://www.larsgeorge.com/2009/10/hbase-architecture-101-storage.html
--Suraj
On Mon, Mar 7, 2011 at 9:42 PM, edward choi <mp...@gmail.com> wrote:
> Sorry for this totally newbie question.
>
> I'm just wondering if HBase uses HDFS space.
>
> I read it in the reference book that HBase table size increases
> automatically as the table entry increases.
> So I am guessing that HBase manages a separate storage other than HDFS.
> (But
> then why does HBase operate on top of HDFS? Truly confusing...)
>
> If HBase doesn't use HDFS space, I can designate only a single machine to
> be
> a HDFS slave, and assign bunch of other machines to be HBase slaves.
> But if HBase does use HDFS space, I'd have balance the ratio of HDFS and
> HBase within my machines.
>
> Could anyone give me a clear heads up?
>
> Ed
>