You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by GitBox <gi...@apache.org> on 2022/04/28 16:05:30 UTC
[GitHub] [camel-kafka-connector] jethomaspanw opened a new issue, #1361: Issue setting up camel-google-storage-source-kafka-connector
jethomaspanw opened a new issue, #1361:
URL: https://github.com/apache/camel-kafka-connector/issues/1361
I'm attempting to set up a [google storage source connector](https://camel.apache.org/camel-kafka-connector/1.0.x/reference/connectors/camel-google-storage-source-kafka-source-connector.html) but am running into an error. As far as I can tell, I've set up the configuration correctly (there are very few options for this connector), so I'm hoping that I can get some advice on how to debug this error.
Helm Chart Yaml
```
apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnector
metadata:
name: {{ .Values.name }}
namespace: {{ .Values.namespace }}
labels:
# The strimzi.io/cluster label identifies the KafkaConnect instance
# in which to create this connector. That KafkaConnect instance
# must have the strimzi.io/use-connector-resources annotation
# set to true.
strimzi.io/cluster: {{ .Values.kafkaConnect.name }}
spec:
class: org.apache.camel.kafkaconnector.googlestoragesource.CamelGooglestoragesourceSourceConnector
tasksMax: {{ .Values.tasksMax }}
config:
topics: {{ .Values.topics }}
camel.kamelet.google-storage-source.bucketNameOrArn: {{ .Values.bucketName }}
camel.kamelet.google-storage-source.serviceAccountKey: {{ .Values.saKey }}
camel.kamelet.google-storage-source.deleteAfterRead: {{ .Values.deleteAfterRead }}
```
Values.yaml
```
# Default values for google-storage-source-connector.
# This is a YAML-formatted file.
# Declare variables to be passed into your templates.
# the connector name
name: google-storage-source
namespace: kafka-namespace
kafkaConnect:
# the Kafka Connect cluster name
name: my-connect-cluster
tasksMax: 2
topics: gsc
bucketName: XXXX
saKey: ${file:/opt/kafka/external-configuration/google-storage-source-secret/google-storage-source-secret.properties:serviceAccountKey64}
deleteAfterRead: false
```
StackTrace
```
org.apache.kafka.connect.errors.ConnectException: Failed to create and start Camel context
at org.apache.camel.kafkaconnector.CamelSourceTask.start(CamelSourceTask.java:175)
at org.apache.kafka.connect.runtime.WorkerSourceTask.initializeAndStart(WorkerSourceTask.java:225)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:186)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:243)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.IllegalStateException: Unable to compute endpoint uri. Reason: uri factory for schema `null` not found
at org.apache.camel.kafkaconnector.utils.TaskHelper.buildUrl(TaskHelper.java:60)
at org.apache.camel.kafkaconnector.CamelSourceTask.start(CamelSourceTask.java:142)
... 8 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] valdar commented on issue #1361: Issue setting up camel-google-storage-source-kafka-connector
Posted by GitBox <gi...@apache.org>.
valdar commented on issue #1361:
URL: https://github.com/apache/camel-kafka-connector/issues/1361#issuecomment-1114341062
What camel kafka connect version are you using?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Issue setting up camel-google-storage-source-kafka-connector [camel-kafka-connector]
Posted by "oscerd (via GitHub) via commits" <co...@camel.apache.org>.
oscerd commented on issue #1361:
URL: https://github.com/apache/camel-kafka-connector/issues/1361#issuecomment-6632243885
Sorry for the late follow-up. The line numbers in your stack trace (`CamelSourceTask.java:142` calling `TaskHelper.buildUrl`, and `CamelSourceTask.java:175`) match the 0.11.5 `camel-kafka-connector` core rather than 1.0.x: Kamelet-based connectors do not set a component scheme, and only the 0.11.x core still tries to build an endpoint URI from it, which fails with exactly this `schema null` error. That usually means an older camel-kafka-connector jar was loaded from the same plugin path, so make sure each connector package is unpacked into its own directory under `plugin.path` and that versions are not mixed. The same connector class and options (`bucketNameOrArn`, the base64-encoded `serviceAccountKey`, `deleteAfterRead`) still exist in 4.22.x: https://camel.apache.org/camel-kafka-connector/next/reference/connectors/camel-google-storage-source-kafka-source-connector.html. Closing this as answered; if it still fails on 4.22.x with a clean plugin path, please open a new issue with
the version, configuration and stack trace.
---
_Claude Code on behalf of Andrea Cosentino_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Issue setting up camel-google-storage-source-kafka-connector [camel-kafka-connector]
Posted by "oscerd (via GitHub) via commits" <co...@camel.apache.org>.
oscerd closed issue #1361: Issue setting up camel-google-storage-source-kafka-connector
URL: https://github.com/apache/camel-kafka-connector/issues/1361
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org