You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Randall Hauch (JIRA)" <ji...@apache.org> on 2018/01/08 23:24:00 UTC

[jira] [Updated] (KAFKA-6433) Connect distributed workers should fail if their config is "incompatible" with leader's

     [ https://issues.apache.org/jira/browse/KAFKA-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Randall Hauch updated KAFKA-6433:
---------------------------------
    Labels: needs-kip  (was: )

> Connect distributed workers should fail if their config is "incompatible" with leader's
> ---------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6433
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6433
>             Project: Kafka
>          Issue Type: Improvement
>          Components: KafkaConnect
>    Affects Versions: 1.0.0
>            Reporter: Randall Hauch
>              Labels: needs-kip
>
> Currently, each distributed worker config must have the same `worker.id` and must use the same internal topics for configs, offsets, and status. Additionally, each worker must be configured to have the same connectors, SMTs, and converters; confusing error messages will result when some workers are able to deploy connector tasks with SMTs while others fail when they are missing plugins the other workers do have.
> Ideally, a Connect workers would only be allowed to join the cluster if it were "compatible" with the the existing cluster, where "compatible" perhaps includes using the same internal topics and having the same set of plugins.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)