[jira] [Comment Edited] (HBASE-18165) Predicate based deletion during major compactions

["Andrew Purtell (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037650#comment-16037650 ] 

Andrew Purtell edited comment on HBASE-18165 at 6/5/17 9:43 PM:
----------------------------------------------------------------

bq.  We've long toyed with the idea of trying to push column custom logic into compaction via a coprocessor. However, a well defined but simpler interface, similar to Filter would make it much easier to do.

Filters or other transformations that run at compaction time are essentially the Accumulo Iterators idea. We've had this proposed in other contexts. I guess I have the same question now as then, why not implement support for Accumulo-style Iterators? Something like https://github.com/carlaustin/hbase-accumulo-iterators (Warning: Do not use directly, not correctly licensed!)


was (Author: apurtell):
Filters or other transformations that run at compaction time are essentially the Accumulo Iterators idea. We've had this proposed in other contexts. I guess I have the same question now as then, why not implement support for Accumulo-style Iterators? Something like https://github.com/carlaustin/hbase-accumulo-iterators (Warning: Do not use directly, not correctly licensed!)

> Predicate based deletion during major compactions
> -------------------------------------------------
>
>                 Key: HBASE-18165
>                 URL: https://issues.apache.org/jira/browse/HBASE-18165
>             Project: HBase
>          Issue Type: Brainstorming
>            Reporter: Lars Hofhansl
>
> In many cases it is expensive to place a delete per version, column, or family.
> HBase should have way to specify a predicate and remove all Cells matching the predicate during the next compactions (major and minor).
> Nothing more concrete. The tricky part would be to know when it is safe to remove the predicate, i.e. when we can be sure that all Cells matching the predicate actually have been removed.
> Could potentially use HBASE-12859 for that.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)