You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Jonathan Gray (JIRA)" <ji...@apache.org> on 2009/08/13 00:54:14 UTC

[jira] Updated: (HBASE-1521) Optimize codepath for minor compactions

     [ https://issues.apache.org/jira/browse/HBASE-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray updated HBASE-1521:
---------------------------------

    Affects Version/s: 0.21.0
        Fix Version/s:     (was: 0.20.1)
                       0.21.0

Let's revisit for 0.21, seems to be consensus on leaving it for now.

> Optimize codepath for minor compactions
> ---------------------------------------
>
>                 Key: HBASE-1521
>                 URL: https://issues.apache.org/jira/browse/HBASE-1521
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.20.0, 0.21.0
>            Reporter: Jonathan Gray
>             Fix For: 0.21.0
>
>
> There are some additional optimizations in the specialized StoreScanner and also in HFile for minor compactions.  For example, there is some KV disassembling and sanity checking in HFile even though in a minor compaction these checks have already been run during the flush.
> Another area to discuss is whether we should actually process deletes during minor compactions.  It's not especially expensive (ScanDeleteTracker is quite simple) but it requires looking at both the row and the qualifier value of every single KV.  Removing this would drop our axiom that "Deletes only apply to later storefiles", which is used during Get processing to have more efficient delete handling.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.