You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Mikhail Dubrovin <mi...@gmail.com> on 2022/09/26 19:30:21 UTC

Mirror Maker: copy data from source cluster to target with different number of partitions

We have a cluster with topics that contain many partitions.
We are going to decrease the number of partitions and looking for any
solution.
I
t would be very useful to make it with MirrorMaker 2 but as we can see, it
doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g.
source cluster has topic-1 with 10 partitions, but the target cluster
should have the same topic with 4 partitions. If the topic on the target
server is already created with 4 partitions, MM2 will add the missing 6
partitions.

Stackoverflow question:
https://stackoverflow.com/questions/71548540/mirrormaker-2-different-partition-count

Could you please give some advice on how to do it?

Thank you,
Mikhail