You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "haiyangyu (JIRA)" <ji...@apache.org> on 2018/11/30 07:41:00 UTC

[jira] [Created] (KAFKA-7690) Change disk allocation policy for multiple partitions on a broker when topic is created

haiyangyu created KAFKA-7690:
--------------------------------

             Summary: Change disk allocation policy for multiple partitions on a broker when topic is created
                 Key: KAFKA-7690
                 URL: https://issues.apache.org/jira/browse/KAFKA-7690
             Project: Kafka
          Issue Type: Improvement
    Affects Versions: 2.0.0, 1.0.0, 0.10.2.0
            Reporter: haiyangyu


h3. *Background*

if target topic partitions lager than broker size when create a topic or add partition, one broker will be assigned more than one partition. if current all disk is not balance, such as one disk has one partition and the other one has four partitions due to topic delete or others, the mutil partitions will be all allocated in the first disk, and if the target topic has a large flow, it is easily to fill up the disk io.
h3. *Improvement strategy*

when mutil ** partition is going to be allocated on a broker, the strategy is as follow:

1、calculate the target topic partition count and total partition count on each disk.

topic count

2、sorted by the target topic partition count wich ascending order, if the target topic partition count is equal, sorted by the total partitions on each disk.
h3. *Example*



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)