[jira] Commented: (HBASE-3209) New Compaction Heuristic

["Nicolas Spiegelberg (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12930332#action_12930332 ] 

Nicolas Spiegelberg commented on HBASE-3209:
--------------------------------------------

Results from our cluster:

Multiput Latency: 25 ms => 3 ms avg
Sync Latency:  12 ms => 1.5 ms avg
Compaction Queue: 3 => 0.08 avg
Compaction Time: now 1-30 sec  (note: our compaction time ods chart is off, looked manually at logs)

Read Latency: 6 ms => 9 ms
Files / Store: 2 => 2.6

Note that the minor Read drop can be fixed by setting compactionThreshold from 3 to 2.  We just didn't need the improvement

> New Compaction Heuristic
> ------------------------
>
>                 Key: HBASE-3209
>                 URL: https://issues.apache.org/jira/browse/HBASE-3209
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Nicolas Spiegelberg
>            Assignee: Nicolas Spiegelberg
>
> We have a whole bunch of compaction awesome in our internal 0.89 branch.  Porting this to 0.90:
> 1) don't unconditionally compact 4 files. have a min threshold
> 2) intelligently upgrade minors to majors
> 3) new compaction algo (derived in HBASE-2462 )

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.