You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Billy Pearson <sa...@pearsonwholesale.com> on 2009/06/05 08:24:51 UTC

blockcache always on?

I created a table with one column in my cluster and started putting data in 
to it I noticed that even with blockcache = false it still uses the block 
cache
Is this a know problem or is there plans to remove the option from the table 
create alter commands?

Billy



Re: blockcache always on?

Posted by Lars George <la...@worldlingo.com>.
Hi Billy,

Please see https://issues.apache.org/jira/browse/HBASE-1486

Let me know if it works for you and please +1 one it if it is OK.

Lars


Billy Pearson wrote:
> Good to know just testing out trunk and my biggest problem
> right now that keeps killing my import is heap oome's from
> compactions even with 1gb heap and 192gb region max file size
> but I thank there is an issue that will deal with this HBASE-1410
> We should probably bump that to a blocker as it will cause problems if 
> release this way
>
> Just trying to find all the bugs I can before we release 0.20
>
> Billy
>
>
>
>
>
>
> "stack" <st...@duboce.net> wrote in message 
> news:7c962aed0906051240v2c77df1ub0beccbe16059d06@mail.gmail.com...
>> On Fri, Jun 5, 2009 at 6:19 AM, Billy Pearson 
>> <sa...@pearsonwholesale.com>wrote:
>>
>>> My question is should it be using the blockcached always even when 
>>> its set
>>> false in the table?
>>
>>
>> No.  I filed an issue.  Lets fix for 0.20.0 (HBASE-1486).
>> Thanks Billy,
>> St.Ack
>>
>
>

Re: blockcache always on?

Posted by Billy Pearson <sa...@pearsonwholesale.com>.
Good to know just testing out trunk and my biggest problem
right now that keeps killing my import is heap oome's from
compactions even with 1gb heap and 192gb region max file size
but I thank there is an issue that will deal with this HBASE-1410
We should probably bump that to a blocker as it will cause problems if 
release this way

Just trying to find all the bugs I can before we release 0.20

Billy






"stack" <st...@duboce.net> wrote in message 
news:7c962aed0906051240v2c77df1ub0beccbe16059d06@mail.gmail.com...
> On Fri, Jun 5, 2009 at 6:19 AM, Billy Pearson 
> <sa...@pearsonwholesale.com>wrote:
>
>> My question is should it be using the blockcached always even when its 
>> set
>> false in the table?
>
>
> No.  I filed an issue.  Lets fix for 0.20.0 (HBASE-1486).
> Thanks Billy,
> St.Ack
> 



Re: blockcache always on?

Posted by stack <st...@duboce.net>.
On Fri, Jun 5, 2009 at 6:19 AM, Billy Pearson <sa...@pearsonwholesale.com>wrote:

> My question is should it be using the blockcached always even when its set
> false in the table?


No.  I filed an issue.  Lets fix for 0.20.0 (HBASE-1486).
Thanks Billy,
St.Ack

Re: blockcache always on?

Posted by Billy Pearson <sa...@pearsonwholesale.com>.
My question is should it be using the blockcached always even when its set 
false in the table?
example this is the column I created on my table
{NAME => 'data', VERSIONS => 1, COMPRESSION => 'GZ', BLOCKCACHE => false}

Then the blockcached is still used on this table should it?

Billy



"Ryan Rawson" <ry...@gmail.com> wrote in 
message news:78568af10906042346r66ff83b6uf17e672f973d48d1@mail.gmail.com...
> In 0.20 its a global setting right now.  We hope to support in memory 
> column
> families soon.
>
> What do you think the appropriate setting should be? My thought is to 
> avoid
> block cache on very large blocks and otherwise let the lru do its job.
>
> On Jun 4, 2009 11:25 PM, "Billy Pearson" 
> <sa...@pearsonwholesale.com> wrote:
>
> I created a table with one column in my cluster and started putting data 
> in
> to it I noticed that even with blockcache = false it still uses the block
> cache
> Is this a know problem or is there plans to remove the option from the 
> table
> create alter commands?
>
> Billy
> 



Re: blockcache always on?

Posted by Ryan Rawson <ry...@gmail.com>.
In 0.20 its a global setting right now.  We hope to support in memory column
families soon.

What do you think the appropriate setting should be? My thought is to avoid
block cache on very large blocks and otherwise let the lru do its job.

On Jun 4, 2009 11:25 PM, "Billy Pearson" <sa...@pearsonwholesale.com> wrote:

I created a table with one column in my cluster and started putting data in
to it I noticed that even with blockcache = false it still uses the block
cache
Is this a know problem or is there plans to remove the option from the table
create alter commands?

Billy