You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Allen Tang (JIRA)" <ji...@apache.org> on 2018/05/09 22:14:00 UTC

[jira] [Created] (KAFKA-6890) Add connector level configurability for producer/consumer client configs

Allen Tang created KAFKA-6890:
---------------------------------

             Summary: Add connector level configurability for producer/consumer client configs
                 Key: KAFKA-6890
                 URL: https://issues.apache.org/jira/browse/KAFKA-6890
             Project: Kafka
          Issue Type: New Feature
          Components: KafkaConnect
            Reporter: Allen Tang


Right now, each source connector and sink connector inherit their client configurations from the worker properties. Within the worker properties, any configuration that has a prefix of "producer." or "consumer." are applied to all source connectors and sink connectors respectively.

We should also provide connector-level overrides whereby connector properties that are prefixed with "producer." and "consumer." are used to feed into the producer and consumer clients embedded within source and sink connectors respectively. The prefixes will be removed via a String#substring() call, and the remainder of the configuration key will be used as the client configuration key. The value is fed directly to the client as the configuration value. If there were client configurations defined at the worker level, they are overriden by the connector-level client configurations.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)