You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jonathan Gray (JIRA)" <ji...@apache.org> on 2010/09/30 00:50:33 UTC
[jira] Created: (HBASE-3050) Limit maximum number of files to
include in a major compaction
Limit maximum number of files to include in a major compaction
--------------------------------------------------------------
Key: HBASE-3050
URL: https://issues.apache.org/jira/browse/HBASE-3050
Project: HBase
Issue Type: New Feature
Reporter: Jonathan Gray
Assignee: Jonathan Gray
Priority: Minor
Fix For: 0.90.0
We had a situation where we had massively overrun compactions during a load tests.
A single store ended up with something like 200 store files. This table also had large values, like 1MB+. A major compaction came in for the region and we OOME'd.
It would be useful to have a maximum number of files to include during a major compaction as a just-in-case measure if we do manage to get this many files in there. Can make it so 0 means infinite so there will be no change in default behavior.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-3050) Limit maximum number of files to
include in a major compaction
Posted by "Jonathan Gray (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Gray updated HBASE-3050:
---------------------------------
Fix Version/s: (was: 0.90.0)
0.92.0
Going to work on this in two weeks or so, punting to 0.92 anyways.
> Limit maximum number of files to include in a major compaction
> --------------------------------------------------------------
>
> Key: HBASE-3050
> URL: https://issues.apache.org/jira/browse/HBASE-3050
> Project: HBase
> Issue Type: New Feature
> Reporter: Jonathan Gray
> Assignee: Jonathan Gray
> Priority: Minor
> Fix For: 0.92.0
>
>
> We had a situation where we had massively overrun compactions during a load tests.
> A single store ended up with something like 200 store files. This table also had large values, like 1MB+. A major compaction came in for the region and we OOME'd.
> It would be useful to have a maximum number of files to include during a major compaction as a just-in-case measure if we do manage to get this many files in there. Can make it so 0 means infinite so there will be no change in default behavior.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.