[jira] [Created] (KAFKA-10333) Provide an API to retrieve Kafka Connect task configurations

["Mickael Maison (Jira)" <ji...@apache.org>]

Mickael Maison created KAFKA-10333:
--------------------------------------

             Summary: Provide an API to retrieve Kafka Connect task configurations
                 Key: KAFKA-10333
                 URL: https://issues.apache.org/jira/browse/KAFKA-10333
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
            Reporter: Mickael Maison
            Assignee: Mickael Maison


Kafka Connect exposes an API to retrieve configurations from connectors.

Connectors are responsible for creating tasks. When doing so, they have to build configurations for individual tasks. In some case, the configuration can be passed as is to tasks but in some others, the configuration is mutated to make tasks do specific work.

For example with MirrorSourceConnector, the connector configuration has a field "topics" which is a list of topics and patterns to mirror. When the connector builds task configurations, it resolves the list of topic names and patterns to exact partitions and spread the partitions over all the tasks.

It would be useful to identify the exact configuration each task is given.

For MM2, it would allow identifying the partitions that matched the topics field. I would also help understanding the impact when a task fails



--
This message was sent by Atlassian Jira
(v8.3.4#803005)