You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Greg Harris (Jira)" <ji...@apache.org> on 2024/02/21 00:45:00 UTC

[jira] [Resolved] (KAFKA-6675) Connect workers should log plugin path and available plugins more clearly

     [ https://issues.apache.org/jira/browse/KAFKA-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Greg Harris resolved KAFKA-6675.
--------------------------------
    Fix Version/s: 3.6.0
         Assignee: Greg Harris  (was: Valeria Vasylieva)
       Resolution: Fixed

This was incorporated into the bin/connect-plugin-path.sh list command, as specified in KIP-898: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-898%3A+Modernize+Connect+plugin+discovery] . This can be used offline without starting the connect worker or loading any live configurations.

> Connect workers should log plugin path and available plugins more clearly
> -------------------------------------------------------------------------
>
>                 Key: KAFKA-6675
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6675
>             Project: Kafka
>          Issue Type: Improvement
>          Components: connect
>    Affects Versions: 0.11.0.1
>            Reporter: Randall Hauch
>            Assignee: Greg Harris
>            Priority: Minor
>             Fix For: 3.6.0
>
>
> Users struggle with setting the plugin path and properly installing plugins. If users get any of this wrong, they get strange errors only after they run the worker and attempt to deploy connectors or use transformations. 
> The Connect worker should more obviously output the plugin path directories and the available plugins. For example, if the {{plugin.path}} were:
> {code}
> plugin.path=/usr/local/share/java,/usr/local/plugins
> {code}
> then the worker might output something like the following information in the log:
> {noformat}
> Looking for plugins on classpath and inside plugin.path directories:
>   /usr/local/share/java
>   /usr/local/plugins
>  
> Source Connector(s):
>   FileStreamSource  (org.apache.kafka.connect.file.FileStreamSourceConnector)       @ classpath
>   FileStreamSink    (org.apache.kafka.connect.file.FileStreamSinkConnector)         @ classpath
>   JdbcSource        (io.confluent.connect.jdbc.JdbcSourceConnector)                 @ /usr/local/share/java/kafka-connect-jdbc
>   MySql             (io.debezium.connector.mysql.MySqlConnector)                    @ /usr/local/plugins/debezium-connector-mysql
> Converter(s):
>   JsonConverter         (org.apache.kafka.connect.json.JsonConverter)               @ classpath
>   ByteArrayConverter    (org.apache.kafka.connect.converters.ByteArrayConverter)    @ classpath
>   SimpleHeaderConverter (org.apache.kafka.connect.converters.SimpleHeaderConverter) @ classpath
>   AvroConverter         (io.confluent.connect.avro.AvroConverter)                   @ /usr/local/share/java/kafka-serde-tools
> Transformation(s):
>   InsertField       (org.apache.kafka.connect.transforms.InsertField)               @ classpath
>   ReplaceField      (org.apache.kafka.connect.transforms.ReplaceField)              @ classpath
>   MaskField         (org.apache.kafka.connect.transforms.MaskField)                 @ classpath
>   ValueToKey        (org.apache.kafka.connect.transforms.ValueToKey)                @ classpath
>   HoistField        (org.apache.kafka.connect.transforms.HoistField)                @ classpath
>   ExtractField      (org.apache.kafka.connect.transforms.ExtractField)              @ classpath
>   SetSchemaMetadata (org.apache.kafka.connect.transforms.SetSchemaMetadata)         @ classpath
>   RegexRouter       (org.apache.kafka.connect.transforms.RegexRouter)               @ classpath
>   TimestampRouter   (org.apache.kafka.connect.transforms.TimestampRouter)           @ classpath
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)