You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Richard Ney <ka...@gmail.com> on 2020/05/17 22:30:08 UTC

Question on Kafka Connect

I'm looking at deploying Kafka Connect for a simple export cluster. I'm
trying to understand how the connectors are loaded. Are the connectors
getting deployed through a process "fork" and they are monitored via the
Kafka Connect workers. Or is the connector just instantiated inside a Kafka
worker inside a protected namespace in the JVM?

-Richard

Re: Question on Kafka Connect

Posted by Ivan Yurchenko <iv...@gmail.com>.

Hi Richard,

Connectors [1] and tasks [2] are instantiated inside worker processes.

[1]
https://github.com/apache/kafka/blob/7746301c2643e0037bff3bcb84c41d512937e4c9/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java#L252
[2]
https://github.com/apache/kafka/blob/7746301c2643e0037bff3bcb84c41d512937e4c9/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java#L432

Ivan


On Mon, 18 May 2020 at 01:30, Richard Ney <ka...@gmail.com> wrote:

> I'm looking at deploying Kafka Connect for a simple export cluster. I'm
> trying to understand how the connectors are loaded. Are the connectors
> getting deployed through a process "fork" and they are monitored via the
> Kafka Connect workers. Or is the connector just instantiated inside a Kafka
> worker inside a protected namespace in the JVM?
>
> -Richard
>