You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Steven Schlansker (JIRA)" <ji...@apache.org> on 2017/05/02 18:02:04 UTC

[jira] [Commented] (KAFKA-1313) Support adding replicas to existing topic partitions via kafka-topics tool without manually setting broker assignments

    [ https://issues.apache.org/jira/browse/KAFKA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993414#comment-15993414 ] 

Steven Schlansker commented on KAFKA-1313:
------------------------------------------

I started using Kafka Streams recently.  I did not know to configure the {{replication.factor}} tuneable and so now all of my automatically generated topics have the wrong replication factor.  I tried to update via {{kafka-topics.sh}} and obviously ended up here.  I understand why this got deprioritized, but consider now that in addition to an administrator creating topics (where they have an opportunity to set replication factor right), Kafka Streams creates topics behind your back and you may not realize your replication factor is wrong until you have a lot of existing data.

I can obviously fix it up by hand as outlined above but this is a pretty big wart and seems that it should be well worth fixing.

> Support adding replicas to existing topic partitions via kafka-topics tool without manually setting broker assignments
> ----------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-1313
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1313
>             Project: Kafka
>          Issue Type: New Feature
>          Components: tools
>    Affects Versions: 0.8.0
>            Reporter: Marc Labbe
>            Assignee: Sreepathi Prasanna
>              Labels: newbie++
>
> There is currently no easy way to add replicas to an existing topic partitions.
> For example, topic create-test has been created with ReplicationFactor=1: 
> Topic:create-test  PartitionCount:3    ReplicationFactor:1 Configs:
>     Topic: create-test Partition: 0    Leader: 1   Replicas: 1 Isr: 1
>     Topic: create-test Partition: 1    Leader: 2   Replicas: 2 Isr: 2
>     Topic: create-test Partition: 2    Leader: 3   Replicas: 3 Isr: 3
> I would like to increase the ReplicationFactor=2 (or more) so it shows up like this instead.
> Topic:create-test  PartitionCount:3    ReplicationFactor:2 Configs:
>     Topic: create-test Partition: 0    Leader: 1   Replicas: 1,2 Isr: 1,2
>     Topic: create-test Partition: 1    Leader: 2   Replicas: 2,3 Isr: 2,3
>     Topic: create-test Partition: 2    Leader: 3   Replicas: 3,1 Isr: 3,1
> Use cases for this:
> - adding brokers and thus increase fault tolerance
> - fixing human errors for topics created with wrong values



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)