You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Mark Tse <Ma...@D2L.com> on 2015/03/16 20:26:50 UTC

Row Size on Disk

I am looking to see how often I will need to add RegionServers, etc. based on the amount of data entering HBase.

Is there a way to get the size on disk of a row or an average across all rows? I want the statistics from HBase because of compression, etc.

Thanks,
Mark

Re: Row Size on Disk

Posted by Nick Dimiduk <nd...@gmail.com>.
Maybe storefile metrics? I don't think so though... Patches welcome ;)

On Monday, March 16, 2015, Mikhail Antonov <ol...@gmail.com> wrote:

> I would think average row size ("row width"?) would be reported
> somewhere in metrics though?
>
> -Mikhail
>
> On Mon, Mar 16, 2015 at 9:41 PM, Nick Dimiduk <ndimiduk@gmail.com
> <javascript:;>> wrote:
> > Probably a combination of the RowCount job and 'hadoop fs -du' will get
> you
> > what you're after.
> >
> > On Monday, March 16, 2015, Mark Tse <Mark.Tse@d2l.com <javascript:;>>
> wrote:
> >
> >> I am looking to see how often I will need to add RegionServers, etc.
> based
> >> on the amount of data entering HBase.
> >>
> >> Is there a way to get the size on disk of a row or an average across all
> >> rows? I want the statistics from HBase because of compression, etc.
> >>
> >> Thanks,
> >> Mark
> >>
>
>
>
> --
> Thanks,
> Michael Antonov
>

Re: Row Size on Disk

Posted by Mikhail Antonov <ol...@gmail.com>.
I would think average row size ("row width"?) would be reported
somewhere in metrics though?

-Mikhail

On Mon, Mar 16, 2015 at 9:41 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> Probably a combination of the RowCount job and 'hadoop fs -du' will get you
> what you're after.
>
> On Monday, March 16, 2015, Mark Tse <Ma...@d2l.com> wrote:
>
>> I am looking to see how often I will need to add RegionServers, etc. based
>> on the amount of data entering HBase.
>>
>> Is there a way to get the size on disk of a row or an average across all
>> rows? I want the statistics from HBase because of compression, etc.
>>
>> Thanks,
>> Mark
>>



-- 
Thanks,
Michael Antonov

Re: Row Size on Disk

Posted by Nick Dimiduk <nd...@gmail.com>.
Probably a combination of the RowCount job and 'hadoop fs -du' will get you
what you're after.

On Monday, March 16, 2015, Mark Tse <Ma...@d2l.com> wrote:

> I am looking to see how often I will need to add RegionServers, etc. based
> on the amount of data entering HBase.
>
> Is there a way to get the size on disk of a row or an average across all
> rows? I want the statistics from HBase because of compression, etc.
>
> Thanks,
> Mark
>