You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by GitBox <gi...@apache.org> on 2021/06/28 13:00:42 UTC

[GitHub] [camel-kafka-connector] ohadpinch opened a new issue #1228: Is it possible to attach Custom Processor to existing Connector?

ohadpinch opened a new issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228


   I have a project in which I want to use CamelHTTPSinkConnector and to be able to log the HTTP response and send it via dedicated Kafka topic.
   
   I thought it can be done by attaching custom Processor, but I don't know how.
   
   Thanks,
   Ohad Pinchevsky


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869678401


   Thanks,  What if I also want to send the HTTP response to Kafka topic?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869670790


   If you need to add a processor step, it makes sense to use plain Camel and not camel-kafka-connector.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-904066700


   I have added kafka producer and returned the result manually.
   I worked with exchange.out obj and checked for failures.
   
   On Mon, Aug 23, 2021, 21:09 Andrea Cosentino ***@***.***>
   wrote:
   
   > Did you manage to find a solution?
   >
   > —
   > You are receiving this because you modified the open/close state.
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-903996573>,
   > or unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AEWS4MJIRQ6HUM3FX23THC3T6KFEXANCNFSM47N5PGVQ>
   > .
   > Triage notifications on the go with GitHub Mobile for iOS
   > <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
   > or Android
   > <https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email>
   > .
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869663993


   Do you mean a custom Camel processor? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869673294






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869688118


   Do you mean you want to do something like this?
   
   Consume a record from a kafka topic -> send the record content to an http endpoint -> capture the http response -> send to a different topic?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869695809


   Thanks, I'll check it out


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch closed issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch closed issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869673294


   So, if not using Processor, is there other way to add business logic (such as logging) to existing camel-kafka-connector?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869756888


   Thanks, I see it handles errors, how can I get the response in success cases? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869663993






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869743141


   https://kafka.apache.org/documentation/#connect
   
   It's a connect connect. Search for errant record reporter.
   
   There is also documentation on the confluent website.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869724974


   Can you please redirect me to Camel documentation for reporter feature?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869690846


   Exactly


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869759145


   I don't think there is a way with plain Kafka. My suggestion is to move to plain camel if you need to inspect the response


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869694817


   I don't think there is a possibility to do this, once you sent the request to the http endpoint you're not able to access the response anymore, this is because of how kafka connect works. 
   
   Even using an SMT won't help, because it would kick in before the sink connector and not after.
   
   Maybe you can use the kafka connect reporter feature, to check successful and failing http requests and redirect them to differen t topics.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-903996573


   Did you manage to find a solution?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] ohadpinch commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
ohadpinch commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869774250


   I need to think about it, It might an architecture constraint to use Kafka Connect.
   I might need to create new connector if no other way. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869675849


   Try to use
   
   https://camel.apache.org/camel-kafka-connector/latest/user-guide/basic-configuration.html
   
   camel.sink.contentLogLevel


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [camel-kafka-connector] oscerd commented on issue #1228: Is it possible to attach Custom Processor to existing Connector?

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #1228:
URL: https://github.com/apache/camel-kafka-connector/issues/1228#issuecomment-869746339


   And this example too
   https://github.com/apache/camel-kafka-connector-examples/tree/main/other-examples/error-handling-sink


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org