[jira] [Created] (KAFKA-13487) Create a topic partition directory based on the size of the directory

["Gongwenzhou (Jira)" <ji...@apache.org>]

Gongwenzhou created KAFKA-13487:
-----------------------------------

             Summary: Create a topic partition directory based on the size of the directory
                 Key: KAFKA-13487
                 URL: https://issues.apache.org/jira/browse/KAFKA-13487
             Project: Kafka
          Issue Type: Sub-task
          Components: log
            Reporter: Gongwenzhou


In the current multi-directory scenario of `log.dirs`, logManager determines which base directory the new partition directory should be in according to the number of subdirectories in each base directory. However, in the actual production environment, the file size generated by each subject partition is different. As a result, the disk usage of the base directory is unbalanced.
We can provide a configuration to determine the strategy of logManager to create a new partition directory, as follows:
Broker-level configuration items:{*}log.directory.select.strategy{*}, there are two values: *partition* and *size*
*partition:* Sort by the number of directories under each base directory (log.dirs) (the current version of the new partition creation strategy)
*size:* Sort by the size of each directory (log.dirs), the smallest directory has the highest allocation right



--
This message was sent by Atlassian Jira
(v8.20.1#820001)