You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Randall Hauch (JIRA)" <ji...@apache.org> on 2017/11/14 18:15:01 UTC

[jira] [Created] (KAFKA-6208) Reduce startup time for Kafka Connect workers

Randall Hauch created KAFKA-6208:
------------------------------------

             Summary: Reduce startup time for Kafka Connect workers
                 Key: KAFKA-6208
                 URL: https://issues.apache.org/jira/browse/KAFKA-6208
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
    Affects Versions: 1.0.0
            Reporter: Randall Hauch


Kafka Connect startup times are excessive with a handful of connectors on the plugin path or classpath. We should not be scanning three times (once for connectors, once for SMTs, and once for converters), and hopefully we can avoid scanning directories that are clearly not plugin directories. 

We should also consider using Java's Service Loader to quickly identify connectors. The latter would require a KIP and would require time to for connectors to migrate, but we could be smarter about only scanning plugin directories that need to be scanned.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)