You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Alex Good (JIRA)" <ji...@apache.org> on 2017/11/08 23:31:00 UTC

[jira] [Created] (KAFKA-6190) GlobalKTable never finishes restoring when consuming transactional messages

Alex Good created KAFKA-6190:
--------------------------------

             Summary: GlobalKTable never finishes restoring when consuming transactional messages
                 Key: KAFKA-6190
                 URL: https://issues.apache.org/jira/browse/KAFKA-6190
             Project: Kafka
          Issue Type: Bug
          Components: clients
         Environment: Linux
            Reporter: Alex Good


When creating a GlobalKTable from a topic that contains messages that were produced in a transaction the GlobalStreamThread never finishes restoring the table. This appears to be because the `GlobalStateManagerImpl#restoreState` method fails to take into account the transaction markers in it's calculation of it's offset when reading messages and so never reaches the high watermark for the topic it is restoring.

To demonstrate the issue produce a few messages in a transaction to a topic, then attempt to restore a GlobalKTable from that topic, the store will never complete restoring.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)