You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "chenshangan (JIRA)" <ji...@apache.org> on 2015/04/24 09:37:39 UTC
[jira] [Issue Comment Deleted] (KAFKA-2106) Partition balance tool
between borkers
[ https://issues.apache.org/jira/browse/KAFKA-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
chenshangan updated KAFKA-2106:
-------------------------------
Comment: was deleted
(was: Topics in the cluster can be divided into two categories:
1. nPartitions > nBrokersBeforeExpand
2. nPartitions < nBrokersBeforeExpand
when adding new brokers into cluster:
in case 1, partitions should be reassigned and spread over as many brokers as possible.
in case 2, calculate nPartitions in each broker and sort them, partitions should be moved from larger broker to smaller one
Finally, nPartitions will almost evenly spread over all brokers.
)
> Partition balance tool between borkers
> --------------------------------------
>
> Key: KAFKA-2106
> URL: https://issues.apache.org/jira/browse/KAFKA-2106
> Project: Kafka
> Issue Type: New Feature
> Components: admin
> Affects Versions: 0.8.3
> Reporter: chenshangan
>
> The default partition assignment algorithm can work well in a static kafka cluster(number of brokers seldom change). Actually, in production env, number of brokers is always increasing according to the business data. When new brokers added to the cluster, it's better to provide a tool that can help to move existing data to new brokers. Currently, users need to choose topic or partitions manually and use the Reassign Partitions Tool (kafka-reassign-partitions.sh) to achieve the goal. It's a time-consuming task when there's a lot of topics in the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)