You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Guozhang Wang (Jira)" <ji...@apache.org> on 2019/09/02 03:48:00 UTC

[jira] [Created] (KAFKA-8854) Optimize bulk loading of RocksDB during state restoration of Streams

Guozhang Wang created KAFKA-8854:
------------------------------------

             Summary: Optimize bulk loading of RocksDB during state restoration of Streams
                 Key: KAFKA-8854
                 URL: https://issues.apache.org/jira/browse/KAFKA-8854
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Guozhang Wang


We've done some optimizations of RocksDB bulk loading in the past, but there are more spaces to explore, some reference: https://www.rockset.com/blog/optimizing-bulk-load-in-rocksdb/

Reducing the RocksDB restoration is the key to improve availability of tasks of Kafka Streams



--
This message was sent by Atlassian Jira
(v8.3.2#803003)