You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2008/08/13 02:39:44 UTC

[jira] Assigned: (HBASE-775) max mapfiles to compact at one time

     [ https://issues.apache.org/jira/browse/HBASE-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack reassigned HBASE-775:
---------------------------

    Assignee: Billy Pearson

Billy, you think that you could have a go at this one?  Doesn't look too hard.  Add a new configuration into hbase-default.xml named something like hbase.hstore.compaction.max  In the HStore constructor, you would read its setting and save it off to a data member.   See 'hbase.hstore.compactionThreshold' for an example.  Then you'd add something around line #785 in HStore where you'd only compact the hbase.hstore.compaction.max amount.

Also, checkout HBASE-64.  So much has changed since that issue was originally filed but there are a load of your ideas in there about how we should do compactions.  Perhaps distill out the good stuff into new, more pointed issues?

> max mapfiles to compact at one time
> -----------------------------------
>
>                 Key: HBASE-775
>                 URL: https://issues.apache.org/jira/browse/HBASE-775
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Billy Pearson
>            Assignee: Billy Pearson
>            Priority: Blocker
>             Fix For: 0.3.0
>
>
> Currently we compact all map files with no upper limit this could cause a regionserver to OOME if the compaction get behind and the number of mapfiles build up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.