[jira] [Comment Edited] (KAFKA-15231) Add ability to pause/resume Remote Log Manager tasks

["Satish Duggana (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748406#comment-17748406 ] 

Satish Duggana edited comment on KAFKA-15231 at 7/28/23 4:48 AM:
-----------------------------------------------------------------

There can be scenarios where you want to control more on remote read/write operations. One way to control respective read and write throughputs is to set respective quotas. This will be addressed with https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas which is in Draft state.


was (Author: satish.duggana):
There can be scenarios where you want to control more on remote read/write operations. One way to control respective read and write throughputs is to set respective quotas. This will be addressed with https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas

> Add ability to pause/resume Remote Log Manager tasks 
> -----------------------------------------------------
>
>                 Key: KAFKA-15231
>                 URL: https://issues.apache.org/jira/browse/KAFKA-15231
>             Project: Kafka
>          Issue Type: Improvement
>          Components: core
>            Reporter: Jorge Esteban Quilcate Otoya
>            Priority: Major
>              Labels: tiered-storage
>
> Once Tiered Storage is enabled, there may be situations where needed to pause uploading tasks to a remote-tier. e.g. remote storage maintenance, troubleshooting, etc.
> An RSM implementation may not be able to do this by itself without throwing exceptions, polluting the logs, etc.
> Could we consider adding this ability to the Tiered Storage framework? Remote Log Manager seems like a good candidate place for this; though I'm wondering on how to expose it.
> Would be interested to hear if this sounds like a good idea, and what options we have to include these.
> We have been considering extending RLM tasks with a pause flag, and having an MBean to switch them on demand. Another option may be to extend the Kafka protocol to expose this – but seems much moved involved.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)