You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by 冯宏华 <fe...@xiaomi.com> on 2014/03/03 12:51:28 UTC
答复: what is the default size of each Column family memstore....
128M
________________________________________
发件人: Upendra Yadav [upendra1024@gmail.com]
发送时间: 2014年3月3日 19:20
收件人: user@hbase.apache.org
主题: what is the default size of each Column family memstore....
Hi
what is the default size of each Column family memstore....
Re: 答复: what is the default size of each Column family memstore....
Posted by Upendra Yadav <up...@gmail.com>.
Thanks Ted Yu and Kevin for your links...
Now i understand the use of MSLAB.
Could you please help me what is the default size of each Data Block in
HFile.
I go through this link(
http://blog.cloudera.com/blog/2012/06/hbase-io-hfile-input-output/) to
understand HFile format. But have doubt : what is the size of each Data
Block> how it decided?
On Mon, Mar 3, 2014 at 10:37 PM, Kevin O'dell <ke...@cloudera.com>wrote:
> Upendra,
>
> Todd L wrote a great set of blogs that explains the problem and some
> solutions:
>
> http://blog.cloudera.com/blog/2011/02/avoiding-full-gcs-in-hbase-with-memstore-local-allocation-buffers-part-1/
>
>
> On Mon, Mar 3, 2014 at 12:00 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > See http://hbase.apache.org/book.html#gcpause
> >
> >
> > On Mon, Mar 3, 2014 at 8:06 AM, Upendra Yadav <up...@gmail.com>
> > wrote:
> >
> > > On this link(https://hbase.apache.org/book/regions.arch.html) i got :
> > >
> > > MSLAB requires 2mb per memstore (that's 2mb per family per region).
> > >
> > > what is MSLAB. Is this related to each Data block size inside HFile?
> > >
> > >
> > > On Mon, Mar 3, 2014 at 7:30 PM, Upendra Yadav <up...@gmail.com>
> > > wrote:
> > >
> > > > Thanks...
> > > >
> > > > So in HFile, each data Block size will be 128 MB(After Major
> > > > compaction.... if we have more than one block...)?
> > > >
> > > >
> > > > On Mon, Mar 3, 2014 at 5:21 PM, 冯宏华 <fe...@xiaomi.com> wrote:
> > > >
> > > >> 128M
> > > >> ________________________________________
> > > >> 发件人: Upendra Yadav [upendra1024@gmail.com]
> > > >> 发送时间: 2014年3月3日 19:20
> > > >> 收件人: user@hbase.apache.org
> > > >> 主题: what is the default size of each Column family memstore....
> > > >>
> > > >> Hi
> > > >>
> > > >> what is the default size of each Column family memstore....
> > > >>
> > > >
> > > >
> > >
> >
>
>
>
> --
> Kevin O'Dell
> Systems Engineer, Cloudera
>
Re: 答复: what is the default size of each Column family memstore....
Posted by Kevin O'dell <ke...@cloudera.com>.
Upendra,
Todd L wrote a great set of blogs that explains the problem and some
solutions:
http://blog.cloudera.com/blog/2011/02/avoiding-full-gcs-in-hbase-with-memstore-local-allocation-buffers-part-1/
On Mon, Mar 3, 2014 at 12:00 PM, Ted Yu <yu...@gmail.com> wrote:
> See http://hbase.apache.org/book.html#gcpause
>
>
> On Mon, Mar 3, 2014 at 8:06 AM, Upendra Yadav <up...@gmail.com>
> wrote:
>
> > On this link(https://hbase.apache.org/book/regions.arch.html) i got :
> >
> > MSLAB requires 2mb per memstore (that's 2mb per family per region).
> >
> > what is MSLAB. Is this related to each Data block size inside HFile?
> >
> >
> > On Mon, Mar 3, 2014 at 7:30 PM, Upendra Yadav <up...@gmail.com>
> > wrote:
> >
> > > Thanks...
> > >
> > > So in HFile, each data Block size will be 128 MB(After Major
> > > compaction.... if we have more than one block...)?
> > >
> > >
> > > On Mon, Mar 3, 2014 at 5:21 PM, 冯宏华 <fe...@xiaomi.com> wrote:
> > >
> > >> 128M
> > >> ________________________________________
> > >> 发件人: Upendra Yadav [upendra1024@gmail.com]
> > >> 发送时间: 2014年3月3日 19:20
> > >> 收件人: user@hbase.apache.org
> > >> 主题: what is the default size of each Column family memstore....
> > >>
> > >> Hi
> > >>
> > >> what is the default size of each Column family memstore....
> > >>
> > >
> > >
> >
>
--
Kevin O'Dell
Systems Engineer, Cloudera
Re: 答复: what is the default size of each Column family memstore....
Posted by Ted Yu <yu...@gmail.com>.
See http://hbase.apache.org/book.html#gcpause
On Mon, Mar 3, 2014 at 8:06 AM, Upendra Yadav <up...@gmail.com> wrote:
> On this link(https://hbase.apache.org/book/regions.arch.html) i got :
>
> MSLAB requires 2mb per memstore (that's 2mb per family per region).
>
> what is MSLAB. Is this related to each Data block size inside HFile?
>
>
> On Mon, Mar 3, 2014 at 7:30 PM, Upendra Yadav <up...@gmail.com>
> wrote:
>
> > Thanks...
> >
> > So in HFile, each data Block size will be 128 MB(After Major
> > compaction.... if we have more than one block...)?
> >
> >
> > On Mon, Mar 3, 2014 at 5:21 PM, 冯宏华 <fe...@xiaomi.com> wrote:
> >
> >> 128M
> >> ________________________________________
> >> 发件人: Upendra Yadav [upendra1024@gmail.com]
> >> 发送时间: 2014年3月3日 19:20
> >> 收件人: user@hbase.apache.org
> >> 主题: what is the default size of each Column family memstore....
> >>
> >> Hi
> >>
> >> what is the default size of each Column family memstore....
> >>
> >
> >
>
Re: 答复: what is the default size of each Column family memstore....
Posted by Upendra Yadav <up...@gmail.com>.
On this link(https://hbase.apache.org/book/regions.arch.html) i got :
MSLAB requires 2mb per memstore (that's 2mb per family per region).
what is MSLAB. Is this related to each Data block size inside HFile?
On Mon, Mar 3, 2014 at 7:30 PM, Upendra Yadav <up...@gmail.com> wrote:
> Thanks...
>
> So in HFile, each data Block size will be 128 MB(After Major
> compaction.... if we have more than one block...)?
>
>
> On Mon, Mar 3, 2014 at 5:21 PM, 冯宏华 <fe...@xiaomi.com> wrote:
>
>> 128M
>> ________________________________________
>> 发件人: Upendra Yadav [upendra1024@gmail.com]
>> 发送时间: 2014年3月3日 19:20
>> 收件人: user@hbase.apache.org
>> 主题: what is the default size of each Column family memstore....
>>
>> Hi
>>
>> what is the default size of each Column family memstore....
>>
>
>
Re: 答复: what is the default size of each Column family memstore....
Posted by Upendra Yadav <up...@gmail.com>.
Thanks...
So in HFile, each data Block size will be 128 MB(After Major compaction....
if we have more than one block...)?
On Mon, Mar 3, 2014 at 5:21 PM, 冯宏华 <fe...@xiaomi.com> wrote:
> 128M
> ________________________________________
> 发件人: Upendra Yadav [upendra1024@gmail.com]
> 发送时间: 2014年3月3日 19:20
> 收件人: user@hbase.apache.org
> 主题: what is the default size of each Column family memstore....
>
> Hi
>
> what is the default size of each Column family memstore....
>