You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2016/04/07 01:09:25 UTC

[jira] [Created] (KAFKA-3522) Consider adding version information into rocksDB storage format

Guozhang Wang created KAFKA-3522:
------------------------------------

             Summary: Consider adding version information into rocksDB storage format
                 Key: KAFKA-3522
                 URL: https://issues.apache.org/jira/browse/KAFKA-3522
             Project: Kafka
          Issue Type: Bug
          Components: kafka streams
            Reporter: Guozhang Wang
             Fix For: 0.10.1.0


Kafka Streams does not introduce any modifications to the data format in the underlying Kafka protocol, but it does use RocksDB for persistent state storage, and currently its data format is fixed and hard-coded. We want to consider the evolution path in the future we we change the data format, and hence having some version info stored along with the storage file / directory would be useful.

And this information could be even out of the storage file; for example, we can just use a small "version indicator" file in the rocksdb directory for this purposes. Thoughts? [~enothereska] [~jkreps]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)