RE: Re:[DISCUSS] KIP-1009: Add Broker-level Throttle Configurations

[Harry Fallows <ha...@protonmail.com.INVALID>]

Hi Ria,

I think this KIP will be a great addition! My current use case for replication throttling is during broker recovery after data loss; in this situation we would want to throttle the replication of all topics to avoid impacting producer/consumer traffic, which would be much easier with broker-level throttle toggling.

In case you haven't seen, I also raised a KIP (KIP-1051) to allow replication throttle rate to be applied statically. I'm not sure if that's also useful for you. Additionally, I have fixed the bug you mentioned in KIP-1009 (https://issues.apache.org/jira/browse/KAFKA-10190), which allows the throttle rate to be applied across all brokers.

Kind regards,
Harry

On 2023/11/21 20:26:37 "Ria Pradeep (BLOOMBERG/ 919 3RD A)" wrote:
> Hi All,
> 
> (I sent the previous email prematurely, apologies)
> 
> I'd like to start a discussion on KIP-1009: Add Broker-level Throttle 
> Configurations - https://cwiki.apache.org/confluence/display/KAFKA/KIP-1009%3A+Add+Broker-level+Throttle+Configurations
> 
> At a high level, this KIP adds dynamic broker level configurations to throttle out of sync replication. Currently, replication throttles can be configured at a topic level, but not for the broker as a whole.
> 
> I’m looking forward to hearing any suggestions or thoughts on this KIP!
> 
> Thanks,
> Ria
> 
> 
> From: dev@kafka.apache.org At: 11/21/23 15:17:15 UTC-5:00To:  dev@kafka.apache.org
> Subject: [DISCUSS] KIP-1009: Add Broker-level Throttle Configurations
> 
> Hi All,
> 
> I'd like to start a discussion on KIP-1009: Add Broker-level Throttle 
> Configurations.
> 
>