[jira] [Created] (KAFKA-13753) Log cleaner should transaction metadata in index until corresponding marker is removed

["Jason Gustafson (Jira)" <ji...@apache.org>]

Jason Gustafson created KAFKA-13753:
---------------------------------------

             Summary: Log cleaner should transaction metadata in index until corresponding marker is removed
                 Key: KAFKA-13753
                 URL: https://issues.apache.org/jira/browse/KAFKA-13753
             Project: Kafka
          Issue Type: Bug
            Reporter: Jason Gustafson
            Assignee: Jason Gustafson


Currently the log cleaner will remove aborted transactions from the index as soon as it detects that the data from the transaction is gone. It does not wait until the corresponding marker has also been removed. Although it is extremely unlikely, it seems possible today that a Fetch might fail to return the aborted transaction metadata correctly if a log cleaning occurs concurrently. This is because the collection of aborted transactions is only done after the reading data from the log. It would be safer to preserve the aborted transaction metadata in the index until the marker is also removed.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)