You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by "dezka (via GitHub)" <gi...@apache.org> on 2023/06/16 16:32:23 UTC

[GitHub] [camel-kafka-connector] dezka opened a new issue, #1536: NoClassDefFoundError when using S3 source connector with STS jar.

dezka opened a new issue, #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536

   Version 3.18.2 of the connector, Kafka Connect 2.8, Java 11, Kafka 2.8.
   
   config:
   
   ```
   {
     "connector.class": "org.apache.camel.kafkaconnector.awss3source.CamelAwss3sourceSourceConnector",
     "camel.kamelet.aws-s3-source.deleteAfterRead": "true",
     "camel.kamelet.aws-s3-source.bucketNameOrArn": "mybucket",
     "topics": "mytopic",
     "tasks.max": "1",
     "name": "s3-source-test",
     "camel.kamelet.aws-s3-source.prefix": "test/",
     "camel.kamelet.aws-s3-source.useDefaultCredentialsProvider": "true",
     "camel.kamelet.aws-s3-source.region": "us-east-1"
   }
   ```
   
   I am intending to use the Web Identity Token method of authing into AWS. The token file is present on the Kafka Connect instances and I am currently using it with other connectors. However I seem to be missing another JAR dependency here and I can't figure out which one.
   
   Files:
   
   ```
   LICENSE.txt                                         camel-core-processor-3.18.2.jar                     http-client-spi-2.17.250.jar                        netty-codec-http-4.1.79.Final.jar
   NOTICE.txt                                          camel-core-reifier-3.18.2.jar                       httpclient-4.5.13.jar                               netty-codec-http2-4.1.79.Final.jar
   README.adoc                                         camel-direct-3.18.2.jar                             httpcore-4.4.15.jar                                 netty-common-4.1.79.Final.jar
   annotations-13.0.jar                                camel-dsl-support-3.18.2.jar                        jackson-annotations-2.13.3.jar                      netty-handler-4.1.79.Final.jar
   annotations-2.17.223.jar                            camel-health-3.18.2.jar                             jackson-core-2.13.3.jar                             netty-nio-client-2.17.250.jar
   apache-client-2.17.250.jar                          camel-kafka-3.18.2.jar                              jackson-databind-2.13.3.jar                         netty-resolver-4.1.79.Final.jar
   apicurio-registry-common-1.3.2.Final.jar            camel-kafka-connector-3.18.2.jar                    jackson-dataformat-avro-2.13.3.jar                  netty-transport-4.1.79.Final.jar
   apicurio-registry-rest-client-1.3.2.Final.jar       camel-kamelet-3.18.2.jar                            jackson-datatype-jdk8-2.10.2.jar                    netty-transport-classes-epoll-4.1.79.Final.jar
   apicurio-registry-utils-converter-1.3.2.Final.jar   camel-main-3.18.2.jar                               jakarta.activation-1.2.2.jar                        netty-transport-native-unix-common-4.1.79.Final.jar
   apicurio-registry-utils-serde-1.3.2.Final.jar       camel-management-api-3.18.2.jar                     jakarta.activation-api-1.2.2.jar                    okhttp-3.14.9.jar
   arns-2.17.250.jar                                   camel-seda-3.18.2.jar                               jakarta.xml.bind-api-2.3.3.jar                      okio-1.17.2.jar
   auth-2.17.250.jar                                   camel-support-3.18.2.jar                            javax.annotation-api-1.3.2.jar                      profiles-2.17.250.jar
   avro-1.11.0.jar                                     camel-util-3.18.2.jar                               jaxb-core-2.3.0.jar                                 protobuf-java-3.13.0.jar
   aws-core-2.17.250.jar                               camel-xml-io-util-3.18.2.jar                        jaxb-impl-2.3.3.jar                                 protocol-core-2.17.250.jar
   aws-query-protocol-2.17.250.jar                     camel-xml-jaxb-3.18.2.jar                           jboss-jaxrs-api_2.1_spec-2.0.1.Final.jar            reactive-streams-1.0.3.jar
   aws-xml-protocol-2.17.250.jar                       camel-xml-jaxp-3.18.2.jar                           jctools-core-3.3.0.jar                              regions-2.17.250.jar
   camel-api-3.18.2.jar                                camel-yaml-dsl-3.18.2.jar                           json-utils-2.17.250.jar                             retrofit-2.9.0.jar
   camel-aws-s3-source-kafka-connector-3.18.2.jar      camel-yaml-dsl-common-3.18.2.jar                    kotlin-reflect-1.3.20.jar                           s3-2.17.250.jar
   camel-aws2-s3-3.18.2.jar                            camel-yaml-dsl-deserializers-3.18.2.jar             kotlin-stdlib-1.3.20.jar                            sdk-core-2.17.250.jar
   camel-base-3.18.2.jar                               commons-codec-1.15.jar                              kotlin-stdlib-common-1.3.20.jar                     snakeyaml-engine-2.3.jar
   camel-base-engine-3.18.2.jar                        commons-compress-1.21.jar                           medeia-validator-core-1.1.1.jar                     sts-2.17.250.jar
   camel-bean-3.18.2.jar                               commons-logging-1.2.jar                             medeia-validator-jackson-1.1.1.jar                  third-party-jackson-core-2.17.250.jar
   camel-core-engine-3.18.2.jar                        connect-json-2.6.0.jar                              metrics-spi-2.17.250.jar                            utils-2.17.223.jar
   camel-core-languages-3.18.2.jar                     converter-jackson-2.9.0.jar                         netty-buffer-4.1.79.Final.jar
   camel-core-model-3.18.2.jar                         eventstream-1.0.1.jar                               netty-codec-4.1.79.Final.jar
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] dezka closed issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "dezka (via GitHub)" <gi...@apache.org>.
dezka closed issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.
URL: https://github.com/apache/camel-kafka-connector/issues/1536


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] dezka commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "dezka (via GitHub)" <gi...@apache.org>.
dezka commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1595116979

   Cool. Thanks for all the help!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] oscerd commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1594971170

   There should have been something wrong with 3.18.2, because utils is misaligned with the other jars. Try with 3.20.3, where they are all aligned to 2.18.40


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] dezka commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "dezka (via GitHub)" <gi...@apache.org>.
dezka commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1595029104

   👍 thanks. Using 3.20.3 works for me. Is this a problem that only presented itself because I'm trying to use the STS jar? Or did 3.18.2 already have this issue?
   
   Is 3.20.3 production ready?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] oscerd commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1594956729

   What is the class missing? NoClassDefFoundError is the exception, what is the message?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] dezka commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "dezka (via GitHub)" <gi...@apache.org>.
dezka commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1594957775

   Sorry, missed it on the OP, updated it to include the exception.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] oscerd commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1595037119

   I think so. It should be related to sts.
   
   This project is mostly followed by volunteers. It's just a release with a good level of trust


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] oscerd commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1594965600

   The error is this one:
   
   utils-2.17.223.jar
   
   The StaleValueBehavior is not present in 2.17.223: https://javadoc.io/doc/software.amazon.awssdk/utils/2.17.223/software/amazon/awssdk/utils/cache/CachedSupplier.html
   
   But it's present in 2.17.250: https://javadoc.io/doc/software.amazon.awssdk/utils/2.17.250/software/amazon/awssdk/utils/cache/CachedSupplier.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [camel-kafka-connector] oscerd commented on issue #1536: NoClassDefFoundError when using S3 source connector with STS jar.

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1536:
URL: https://github.com/apache/camel-kafka-connector/issues/1536#issuecomment-1594975883

   or alternatively you should remove the 2.17.233 version of utils jar and use 2.17.250


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org