You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2020/03/12 19:18:00 UTC

[jira] [Commented] (KAFKA-9168) Integrate JNI direct buffer support to RocksDBStore

    [ https://issues.apache.org/jira/browse/KAFKA-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058193#comment-17058193 ] 

Sophie Blee-Goldman commented on KAFKA-9168:
--------------------------------------------

Thanks [~sagarrao], marking this as a blocker for 3.0 since we unfortunately need to wait for the next major release before bumping the major version of rocksdb (they made a number of breaking changes that Streams users are unfortunately exposed to).

That said, this patch has the potential for some pretty significant performance improvements in addition to opening the door for other desirable features that aren't available to RocksJava users. Definitely one of the stronger motivations to consider a workaround that allows upgrading without introducing breaking changes to user code...

> Integrate JNI direct buffer support to RocksDBStore
> ---------------------------------------------------
>
>                 Key: KAFKA-9168
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9168
>             Project: Kafka
>          Issue Type: Task
>          Components: streams
>            Reporter: Sagar Rao
>            Priority: Blocker
>              Labels: perfomance
>             Fix For: 3.0.0
>
>
> There has been a PR created on rocksdb Java client to support direct ByteBuffers in Java. We can look at integrating it whenever it gets merged. 
> Link to PR: [https://github.com/facebook/rocksdb/pull/2283]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)