[jira] [Commented] (KAFKA-18462) Upgrade RocksDB dependency from 9.7.3 to something newer

["Kuan Po Tseng (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-18462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953981#comment-17953981 ] 

Kuan Po Tseng commented on KAFKA-18462:
---------------------------------------

Quick note: In the latest RocksDB release (v10.2.1), the following two options have been removed:
 * {{random_access_max_buffer_size}}
[https://github.com/facebook/rocksdb/commit/d4bd67fb0972bcf654f9d63bdabc39001a8208b7]

 * {{max_write_buffer_size_to_maintain}}
[https://github.com/facebook/rocksdb/commit/5e10baa412d06492c7ec4a4ded0949f6981c94e5]

We'll need to remove those options in [RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapter.java|https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapter.java]
I’ve run the Streams integration tests and everything looks good so far. Currently running the end-to-end tests—fingers crossed everything goes smoothly.

> Upgrade RocksDB dependency from 9.7.3 to something newer
> --------------------------------------------------------
>
>                 Key: KAFKA-18462
>                 URL: https://issues.apache.org/jira/browse/KAFKA-18462
>             Project: Kafka
>          Issue Type: Task
>          Components: streams
>    Affects Versions: 4.0.0
>            Reporter: Matthias J. Sax
>            Assignee: Kuan Po Tseng
>            Priority: Blocker
>             Fix For: 4.1.0
>
>
> We did upgrade RocksDB to 9.7.3 with 4.0 release, but there is already newer RocksDB releases (not available yet for us to use with 4.0 release).
> We should re-evaluate if we can upgrade to a newer RocksDB version with 4.1.
> When we close this ticket, we should also create a new BLOCKER ticket for a future release as a reminder, so we ensure we upgrade RocksDB regularly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)