[jira] [Created] (KAFKA-7424) State stores restoring from changelog topic not the source topic

["James Hay (JIRA)" <ji...@apache.org>]

James Hay created KAFKA-7424:
--------------------------------

             Summary: State stores restoring from changelog topic not the source topic
                 Key: KAFKA-7424
                 URL: https://issues.apache.org/jira/browse/KAFKA-7424
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 1.1.1
            Reporter: James Hay


Hi,

 

I've recently attempted to upgrade a streams application form 1.1 to 1.1.1 and I noticed a drop in the number of messages being restored in our state stores.

It appears that there is a change in 1.1.1 which causes our state stores to be restored from the changelog topic as opposed to version 1.1 where the stores are restored from the source topic.  In our application this causes an issue as we switched to StreamsBuilder from KStreamBuilder  in the middle of the applications lifetime and so the changelog doesn't represent a full history of the source topic.

Has this switch been introduced intentionally? Is there a way to configure our application to use 1.1.1 and still use the source stream to restore state stores? Any recommendations on getting our changelog in sync with the source?

 

Thanks

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)