[jira] [Created] (KAFKA-10282) Log metrics are removed if a log is deleted and re-created quickly enough

["Bob Barrett (Jira)" <ji...@apache.org>]

Bob Barrett created KAFKA-10282:
-----------------------------------

             Summary: Log metrics are removed if a log is deleted and re-created quickly enough
                 Key: KAFKA-10282
                 URL: https://issues.apache.org/jira/browse/KAFKA-10282
             Project: Kafka
          Issue Type: Bug
          Components: log
    Affects Versions: 2.6.0
            Reporter: Bob Barrett
            Assignee: Bob Barrett
             Fix For: 2.7.0, 2.6.1


When we delete a local log, we mark it for asynchronous deletion by renaming it with a `.delete` extension, and then wait `LogConfig.FileDeleteDelayMs` milliseconds before actually deleting the files on disk. We don't remove the Log metrics from the metrics registry until the actual deletion takes place. If we recreate a log of the same topic partition (for example, if we reassign the partition away from the broker and quickly reassign it back), the metrics are registered when the new log is created, but then unregistered when the async deletion of the original log takes place. This leaves us with a partition that is not reporting any Log metrics (size, offsets, number of segments, etc).

To fix this, the LogManager should check when creating new logs to see if a log for the same topic partition is marked for deletion, and if so, signal to that log not to unregister its metrics when it is deleted.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)