You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Spacrocket (Jira)" <ji...@apache.org> on 2024/10/06 20:41:00 UTC
[jira] [Commented] (KAFKA-17627) ConfigProvider TTLs do not restart Tasks
[ https://issues.apache.org/jira/browse/KAFKA-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887235#comment-17887235 ]
Spacrocket commented on KAFKA-17627:
------------------------------------
I checked how to implement this and I think the code just requires swapping restartConnector with restartConnectorAndTasks method that has a parameter delayMs.
I implemented part of it but before PR I still need to write and repair tests and finish TODO: mentioned in the commit. I will post it here just in case my approach is totally incorrect. [https://github.com/apache/kafka/commit/c8d688b8afb01dc9f865a3ffaa6e55e13609e13b]
I am not really sure whether in standalone mode this is also required but I think it wouldn't hurt and should keep the implementation easier to read.
Task description mentions:
_Instead, when secrets for a task include a TTL, the task should be restarted directly._ Why should connector be skipped when it's a part that communicates with sink/source?
> ConfigProvider TTLs do not restart Tasks
> ----------------------------------------
>
> Key: KAFKA-17627
> URL: https://issues.apache.org/jira/browse/KAFKA-17627
> Project: Kafka
> Issue Type: Bug
> Components: connect
> Affects Versions: 2.0.0
> Reporter: Greg Harris
> Assignee: Spacrocket
> Priority: Major
> Labels: newbie
>
> The ConfigProvider interface allows for implementations to provide configurations with an accompanying Time To Live, a lifetime that the returned value is valid for. Callers which receive a TTL should periodically call the ConfigProvider to refresh and receive any updated value.
> The WorkerConfigTransformer is responsible for accepting TTLs from ConfigProviders, and scheduling restarts for connectors to force them to refresh their externalized configurations.
> Since the introduction of the ConfigProvider interface in 2.0.0, when the WorkerConfigTransformer processes task configurations, it schedules a restart of the connector, which may or may not be present on the running machine. Instead, when secrets for a task include a TTL, the task should be restarted directly.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)