You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Adem Efe Gencer (Jira)" <ji...@apache.org> on 2020/01/07 02:44:00 UTC

[jira] [Created] (KAFKA-9373) Improve shutdown performance via lazy accessing the offset and time indices.

Adem Efe Gencer created KAFKA-9373:
--------------------------------------

             Summary: Improve shutdown performance via lazy accessing the offset and time indices.
                 Key: KAFKA-9373
                 URL: https://issues.apache.org/jira/browse/KAFKA-9373
             Project: Kafka
          Issue Type: Bug
          Components: log
    Affects Versions: 2.3.1, 2.4.0, 2.3.0
            Reporter: Adem Efe Gencer
            Assignee: Adem Efe Gencer
             Fix For: 2.3.1, 2.4.0, 2.3.0


KAFKA-7283 enabled lazy mmap on index files by initializing indices on-demand rather than performing costly disk/memory operations when creating all indices on broker startup. This helped reducing the startup time of brokers. However, segment indices are still created on closing segments, regardless of whether they need to be closed or not.
 
Ideally we should:
 * Improve shutdown performance via lazy accessing the offset and time indices.
 * Eliminate redundant disk accesses and memory mapped operations while deleting or renaming files that back segment indices.
 * Prevent illegal accesses to underlying indices of a closed segment, which would lead to memory leaks due to recreation of the underlying memory mapped objects.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)