You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Randall Hauch (JIRA)" <ji...@apache.org> on 2017/06/14 21:54:00 UTC

[jira] [Created] (KAFKA-5451) Kafka Connect should scan classpath asynchronously

Randall Hauch created KAFKA-5451:
------------------------------------

             Summary: Kafka Connect should scan classpath asynchronously
                 Key: KAFKA-5451
                 URL: https://issues.apache.org/jira/browse/KAFKA-5451
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
    Affects Versions: 0.11.0.0
            Reporter: Randall Hauch
            Assignee: Randall Hauch
             Fix For: 0.11.1.0


When Kafka Connect workers start up, they scan the classpath and module paths for connectors, transformations, and converters. This takes anywhere from 15-30sec or longer depending upon how many JARs are included. Currently, this scanning is done synchronously during startup of the Kafka Connect workers, even though the workers may not need the result of the scan.

The scanning logic should be asynchronous and should only block any components that require the result of the scan. This will improve startup time of the workers.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)