You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2008/06/23 15:50:45 UTC

[jira] Commented: (HBASE-700) hbase.io.index.interval need be configuratable in column family

    [ https://issues.apache.org/jira/browse/HBASE-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607230#action_12607230 ] 

Andrew Purtell commented on HBASE-700:
--------------------------------------

This could be rolled in to HBASE-42. Are there other candidates for column family metadata that would be useful and meaningful to add to HTableDescriptor? 

> hbase.io.index.interval need be configuratable in column family 
> ----------------------------------------------------------------
>
>                 Key: HBASE-700
>                 URL: https://issues.apache.org/jira/browse/HBASE-700
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>    Affects Versions: 0.1.2
>            Reporter: LN
>            Priority: Minor
>
> setting parameter hbase.io.index.interval to smaller can improve hbase reading performance significantly, esp. in large value size column families. however, small hbase.io.index.interval cause more memory usage, because all index will read into memory when loading a mapfile.
> in my test env, i set hbase.io.index.interval to 1, after inserting about 3M samll size records to a table(about 1.5G in hadoop file), the regionserver throws OOME.  then i found total size of  map file index  is 350M.  however, i can't adjust  hbase.io.index.interval to a larger one, like 32, because other big cell size tables need it be 1.
> so, i think make hbase.io.index.interval a column family property should be very important for performance tuning. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.