You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Peter Davis (JIRA)" <ji...@apache.org> on 2018/01/11 23:18:00 UTC

[jira] [Commented] (KAFKA-4850) RocksDb cannot use Bloom Filters

    [ https://issues.apache.org/jira/browse/KAFKA-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323184#comment-16323184 ] 

Peter Davis commented on KAFKA-4850:
------------------------------------

Request: RocksDB memory usage (off Java heap) is already hard to fathom and can be substantial, and [the documentation|https://github.com/facebook/rocksdb/wiki/RocksDB-Bloom-Filter#memory-usage] is anything but clear.  If adding bloom filters affects memory usage, can the impact please be documented?

> RocksDb cannot use Bloom Filters
> --------------------------------
>
>                 Key: KAFKA-4850
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4850
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>    Affects Versions: 0.10.2.0
>            Reporter: Eno Thereska
>            Assignee: Bharat Viswanadham
>             Fix For: 1.1.0
>
>
> Bloom Filters would speed up RocksDb lookups. However they currently do not work in RocksDb 5.0.2. This has been fixed in trunk, but we'll have to wait until that is released and tested. 
> Then we can add the line in RocksDbStore.java in openDb:
> tableConfig.setFilter(new BloomFilter(10));



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)