You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jiangjie Qin (JIRA)" <ji...@apache.org> on 2016/09/15 21:43:20 UTC

[jira] [Commented] (KAFKA-1464) Add a throttling option to the Kafka replication tool

    [ https://issues.apache.org/jira/browse/KAFKA-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494596#comment-15494596 ] 

Jiangjie Qin commented on KAFKA-1464:
-------------------------------------

It seems the PR title did not start with "KAFKA-1464" so the PR link is not updated. Anyway, the PR link is https://github.com/apache/kafka/pull/1776

> Add a throttling option to the Kafka replication tool
> -----------------------------------------------------
>
>                 Key: KAFKA-1464
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1464
>             Project: Kafka
>          Issue Type: New Feature
>          Components: replication
>    Affects Versions: 0.8.0
>            Reporter: mjuarez
>            Assignee: Ben Stopford
>            Priority: Minor
>              Labels: replication, replication-tools
>             Fix For: 0.10.1.0
>
>
> When performing replication on new nodes of a Kafka cluster, the replication process will use all available resources to replicate as fast as possible.  This causes performance issues (mostly disk IO and sometimes network bandwidth) when doing this in a production environment, in which you're trying to serve downstream applications, at the same time you're performing maintenance on the Kafka cluster.
> An option to throttle the replication to a specific rate (in either MB/s or activities/second) would help production systems to better handle maintenance tasks while still serving downstream applications.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)