You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jonathan Gray (JIRA)" <ji...@apache.org> on 2010/11/30 21:44:16 UTC

[jira] Resolved: (HBASE-3287) Add option to cache blocks on hfile write and evict blocks on hfile close

     [ https://issues.apache.org/jira/browse/HBASE-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray resolved HBASE-3287.
----------------------------------

      Resolution: Fixed
    Release Note: Introduces two new configuration parameters: hbase.rs.cacheblocksonwrite (default: false) which will pre-cache all blocks of a file into the block cache as it is written, and hbase.rs.evictblocksonclose (default: true) which will evict all blocks of a file from the block cache when a file is closed on a RS.
    Hadoop Flags: [Reviewed]

Committed to trunk.  I'm going to be using this in prod atop 0.90 but since it's really a new feature I've left it out of 0.90 tree for now.

Filed HBASE-3288 to make this configurable at the family level (something I don't need yet but we should support eventually).

> Add option to cache blocks on hfile write and evict blocks on hfile close
> -------------------------------------------------------------------------
>
>                 Key: HBASE-3287
>                 URL: https://issues.apache.org/jira/browse/HBASE-3287
>             Project: HBase
>          Issue Type: Improvement
>          Components: io, regionserver
>    Affects Versions: 0.90.0
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>             Fix For: 0.92.0
>
>         Attachments: HBASE-3287-FINAL-trunk.patch
>
>
> This issue is about adding configuration options to add/remove from the block cache when creating/closing files.  For use cases with lots of flushing and compacting, this might be desirable to prevent cache misses and maximize the effective utilization of total block cache capacity.
> The first option, {{hbase.rs.cacheblocksonwrite}}, will make it so we pre-cache blocks as we are writing out new files.
> The second option, {{hbase.rs.evictblocksonclose}}, will make it so we evict blocks when files are closed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.