You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Jon Bates (JIRA)" <ji...@apache.org> on 2018/11/05 11:26:00 UTC

[jira] [Created] (KAFKA-7591) Changelog retention period doesn't synchronise with window-store size

Jon Bates created KAFKA-7591:
--------------------------------

             Summary: Changelog retention period doesn't synchronise with window-store size
                 Key: KAFKA-7591
                 URL: https://issues.apache.org/jira/browse/KAFKA-7591
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Jon Bates


When a new windowed state store is created, the associated changelog topic's `retention.ms` value is set to `window-size + CHANGELOG_ADDITIONAL_RETENTION_MS`
h3. Expected Behaviour

If the window-size is updated, the changelog topic's `retention.ms` config should be updated to reflect the new size
h3. Actual Behaviour

The changelog-topic's `retention.ms` setting is not amended, resulting in possible loss of data upon application restart

 

n.b. Although it is easy to update changelog topic config, I logged this as `major` due to the potential for data-loss for any user of Kafka-Streams who may not be intimately aware of the relationship between a windowed store and the changelog config



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)