You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Bryan Keller <br...@gmail.com> on 2012/02/18 00:48:56 UTC
Max region file size
Is the max region file size the size of the data uncompressed or the max size of the store file? I noticed my store files are ~2.1 gb though I have the max region size set to 4 gb. This is after a major compaction. Also, is the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs say 4 gb but I wanted to confirm that.
Re: Max region file size
Posted by Doug Meil <do...@explorysmedical.com>.
Bryan, if you're on 0.90.x the advice is to not go above 4gb regions. The
Hfilev2 format is in 0.92 which better supports larger regions.
On 2/18/12 5:31 PM, "Mikael Sitruk" <mi...@gmail.com> wrote:
>Hi Bryan
>The size is the size of the store file, if the size go above this you will
>have a region split. Regarding the size limit, as far I understand this is
>because of the HFile format, and in 0.92 is it about 20G.
>
>Mikael.S
>
>On Sat, Feb 18, 2012 at 2:21 AM, Bryan Keller <br...@gmail.com> wrote:
>
>> Actually, I had pre-created too many regions so most were only half
>>full,
>> I had a couple of regions that were 4gb.
>>
>> On Feb 17, 2012, at 3:48 PM, Bryan Keller wrote:
>>
>> > Is the max region file size the size of the data uncompressed or the
>>max
>> size of the store file? I noticed my store files are ~2.1 gb though I
>>have
>> the max region size set to 4 gb. This is after a major compaction.
>>Also, is
>> the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs
>>say
>> 4 gb but I wanted to confirm that.
>>
>>
>
>
>--
>Mikael.S
Re: Max region file size
Posted by Mikael Sitruk <mi...@gmail.com>.
Hi Bryan
The size is the size of the store file, if the size go above this you will
have a region split. Regarding the size limit, as far I understand this is
because of the HFile format, and in 0.92 is it about 20G.
Mikael.S
On Sat, Feb 18, 2012 at 2:21 AM, Bryan Keller <br...@gmail.com> wrote:
> Actually, I had pre-created too many regions so most were only half full,
> I had a couple of regions that were 4gb.
>
> On Feb 17, 2012, at 3:48 PM, Bryan Keller wrote:
>
> > Is the max region file size the size of the data uncompressed or the max
> size of the store file? I noticed my store files are ~2.1 gb though I have
> the max region size set to 4 gb. This is after a major compaction. Also, is
> the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs say
> 4 gb but I wanted to confirm that.
>
>
--
Mikael.S
Re: Max region file size
Posted by Bryan Keller <br...@gmail.com>.
Actually, I had pre-created too many regions so most were only half full, I had a couple of regions that were 4gb.
On Feb 17, 2012, at 3:48 PM, Bryan Keller wrote:
> Is the max region file size the size of the data uncompressed or the max size of the store file? I noticed my store files are ~2.1 gb though I have the max region size set to 4 gb. This is after a major compaction. Also, is the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs say 4 gb but I wanted to confirm that.