You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by GitBox <gi...@apache.org> on 2020/10/22 12:11:16 UTC
[GitHub] [camel-kafka-connector] orpiske opened a new issue #629: Couchbase fails due to incorrect URI format
orpiske opened a new issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629
When trying couchbase with the given configuration, the connector fails complaining that the URL format is invalid:
```2020-10-22 14:08:06,300 [SinkConnector-0] ERROR org.apache.camel.processor.errorhandler.DefaultErrorHandler - Failed delivery for (MessageId: E1DBFDB5E174861-0000000000000000 on ExchangeId: E1DBFDB5E174861-0000000000000000). Exhausted after delivery attempt: 1 caught: org.apache.camel.ResolveEndpointFailedException: Failed to resolve endpoint: couchbase://http:my-redacted-host:8091?bucket=testBucket85&password=xxxxxx due to: Invalid URI. Format must be of the form couchbase:http[s]://hostname[:port]/bucket?[options...]```
The configuration used for this test was:
```
connector.class=org.apache.camel.kafkaconnector.couchbase.CamelCouchbaseSinkConnector
camel.sink.path.port=32816
topics=org.apache.camel.kafkaconnector.couchbase.sink.CamelSinkCouchbaseITCase
tasks.max=1
camel.sink.endpoint.bucket=testBucket
camel.sink.path.protocol=http
camel.sink.endpoint.password=password
camel.sink.path.hostname=localhost
camel.sink.endpoint.username=Administrator
name=CamelCouchbaseSinkConnector
value.converter=org.apache.kafka.connect.storage.StringConverter
key.converter=org.apache.kafka.connect.storage.StringConverter
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] oscerd commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-727889680
The only point possible is at CouchBaseEndpoint level, there a constructor raising that exception message.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-727842488
@oscerd I gave it a try with Couchbase and 3.7. The URL formatting via `camel.sink.url` is OK now.
However, when using only properties, our code is still formatting the URL incorrectly.
```2020-11-16 10:07:10,748 [SinkConnector-0] ERROR org.apache.camel.processor.errorhandler.DefaultErrorHandler - Failed delivery for (MessageId: 2073D9C11D9CFB0-0000000000000000 on ExchangeId: 2073D9C11D9CFB0-0000000000000000). Exhausted after delivery attempt: 1 caught: org.apache.camel.ResolveEndpointFailedException: Failed to resolve endpoint: couchbase://http:localhost:32858?bucket=testBucket20&password=xxxxxx due to: Invalid URI. Format must be of the form couchbase:http[s]://hostname[:port]?[options...]```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-788775475
This should do the trick: https://github.com/apache/camel/pull/5156/files
Thanks to @tadayosi, who found a similar problem on Netty and led me to the root cause of the problem on Couchbase.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] oscerd commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-714456913
I'll move camel-master to 3.7 soon
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-812478893
@valdar we're good to go. I re-enabled 2 other tests that started working well w/ 3.9. This one, though, is still flaky (failing 1 out of 10 times on Linux).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-812464547
> This should be fixed both in `0.7.3` and `0.9.0` (out today).
> @orpiske is there anything left on our part left to do? like eneablening/adding itests?
@valdar I am double checking if we need to re-enable any additional test besides the MongoDB source one. I'll share an update in a couple of minutes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] valdar commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
valdar commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-812463130
This should be fixed both in `0.7.3` and `0.9.0` (out today).
@orpiske is there anything left on our part left to do? like eneablening/adding itests?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-727844301
It does seem that the CKC gets the URL correctly, though:
```2020-11-16 10:07:10,621 [SinkConnector-0] INFO org.apache.camel.kafkaconnector.utils.CamelKafkaConnectMain - Creating Camel route from(direct:start)
2020-11-16 10:07:10,621 [SinkConnector-0] INFO org.apache.camel.kafkaconnector.utils.CamelKafkaConnectMain - .to(couchbase:http:localhost:32858?bucket=testBucket20&password=RAW(password)&username=RAW(Administrator))```
So, it's seems like it's somewhere else (maybe in the component code itself).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] valdar commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
valdar commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-812516218
Ok so I marked as flaky test, leave it open and assigned to yourself @orpiske feel free to close it when/if you think it is done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-714454565
@oscerd that was quick! Thanks Andrea.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske edited a comment on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske edited a comment on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-727844301
It does seem that the CKC gets the URL correctly, though:
```
2020-11-16 10:07:10,621 [SinkConnector-0] INFO org.apache.camel.kafkaconnector.utils.CamelKafkaConnectMain - Creating Camel route from(direct:start)
2020-11-16 10:07:10,621 [SinkConnector-0] INFO org.apache.camel.kafkaconnector.utils.CamelKafkaConnectMain - .to(couchbase:http:localhost:32858?bucket=testBucket20&password=RAW(password)&username=RAW(Administrator))
```
So, it's seems like it's somewhere else (maybe in the component code itself).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] oscerd commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-714454069
I worked on this here https://github.com/apache/camel/commit/46e23d1b7fa324f3a5ad2edf8d53e061262012ff#diff-118ec4ad74df487260d52308cd40005080748272e546997dda6d23d91890ecbe
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-745262229
This issue still persists and the connector cannot, yet, work with Couchbase when using the properties.
I took some time to debug the problem and this is the stack trace and where it is messing up with the URL:
```
normalizeUri:785, AbstractCamelContext (org.apache.camel.impl.engine) -----> this is adding a // on the couchbase URI and rendering it invalid
prepareRecipient:269, SendDynamicProcessor (org.apache.camel.processor)
process:144, SendDynamicProcessor (org.apache.camel.processor)
run:395, RedeliveryErrorHandler$SimpleTask (org.apache.camel.processor.errorhandler)
schedule:148, DefaultReactiveExecutor$Worker (org.apache.camel.impl.engine)
scheduleMain:60, DefaultReactiveExecutor (org.apache.camel.impl.engine)
process:147, Pipeline (org.apache.camel.processor)
process:312, CamelInternalProcessor (org.apache.camel.impl.engine)
process:84, DirectProducer (org.apache.camel.component.direct)
process:218, SharedCamelInternalProcessor (org.apache.camel.impl.engine)
process:112, SharedCamelInternalProcessor$1 (org.apache.camel.impl.engine)
process:83, DefaultAsyncProcessorAwaitManager (org.apache.camel.impl.engine)
process:109, SharedCamelInternalProcessor (org.apache.camel.impl.engine)
send:189, DefaultProducerCache (org.apache.camel.support.cache)
send:176, DefaultProducerTemplate (org.apache.camel.impl.engine)
send:148, DefaultProducerTemplate (org.apache.camel.impl.engine)
put:175, CamelSinkTask (org.apache.camel.kafkaconnector)
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] oscerd commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-779924918
Is this done with 3.8.0 @orpiske ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] orpiske commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
orpiske commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-779928647
> Is this done with 3.8.0 @orpiske ?
No, this is still ongoing. I'll continue investigating this one next week.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [camel-kafka-connector] oscerd commented on issue #629: Couchbase fails due to incorrect URI format
Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #629:
URL: https://github.com/apache/camel-kafka-connector/issues/629#issuecomment-727852804
Probably is in the component. I'll have a look
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org