[jira] [Commented] (OMID-148) Use Bloomfilter to maintain and ship conflict sets

["Lars Hofhansl (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OMID-148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842366#comment-16842366 ] 

Lars Hofhansl commented on OMID-148:
------------------------------------

I played around with HBase's built-in bloom filters and they are easy to use standalone. (Not sure you want to take a hard dependency in the TSO and the general client in HBase, though).

Of course testing two bloom filter for intersection is actually not as trivial as I thought. There's a mechanism here: [https://en.wikipedia.org/wiki/Bloom_filter]. One could build the intersection of two BFs and test whether it's empty. But it gets more and more fuzzy, so not sure this is as viable as I thought.

 

> Use Bloomfilter to maintain and ship conflict sets
> --------------------------------------------------
>
>                 Key: OMID-148
>                 URL: https://issues.apache.org/jira/browse/OMID-148
>             Project: Apache Omid
>          Issue Type: Wish
>            Reporter: Lars Hofhansl
>            Priority: Major
>
> *Brainstorming:*
> Can we use Bloomfilters maintained on the client to maintain the conflict set (instead of a list of rows/columns).
> I suppose the risk of false positive becomes higher the larger the transaction is, but we can do some math on that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)