You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by GitBox <gi...@apache.org> on 2020/07/02 11:56:22 UTC

[GitHub] [camel-kafka-connector] akhileshacc opened a new issue #313: How to break messages when ingesting into kafka

akhileshacc opened a new issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313


   I wanted to break messages before sending to kafka endpoint.
   
   Is it possible to do with processors ?
   
   I am trying to send S3 files data to kafka using s3 and kafka components.
   
   ```from("aws-s3://bucketname?args=....")
   .to("kafka:test1?brokers=localhost:9092")```
   
   How do i break messages before sending to kafka ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [camel-kafka-connector] akhileshacc commented on issue #313: How to break messages when ingesting into kafka

Posted by GitBox <gi...@apache.org>.
akhileshacc commented on issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313#issuecomment-653339101


   Thanks for the help.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [camel-kafka-connector] akhileshacc commented on issue #313: How to break messages when ingesting into kafka

Posted by GitBox <gi...@apache.org>.
akhileshacc commented on issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313#issuecomment-652964072


   1. If text file has 10mb data, can i pick 10 records with 1mb of data and then store it.
   2. Sure will do so.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [camel-kafka-connector] oscerd commented on issue #313: How to break messages when ingesting into kafka

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313#issuecomment-652969145


   By the way, it's better to discuss this on the mailing list to avoid confusion.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [camel-kafka-connector] oscerd closed issue #313: How to break messages when ingesting into kafka

Posted by GitBox <gi...@apache.org>.
oscerd closed issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [camel-kafka-connector] oscerd commented on issue #313: How to break messages when ingesting into kafka

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313#issuecomment-652967884


   You can implement a processor. Each S3ObjectInputStream can be read and you can read the data for example 1 Mb


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [camel-kafka-connector] oscerd commented on issue #313: How to break messages when ingesting into kafka

Posted by GitBox <gi...@apache.org>.
oscerd commented on issue #313:
URL: https://github.com/apache/camel-kafka-connector/issues/313#issuecomment-652963199


   Hello.
   
   1. What do you mean with break messages?
   2. This is the issue tracker for camel-kafka-connector, but you're using camel. You should ask on the camel users mailing list or dev mailing list: https://camel.apache.org/community/mailing-list/ and ask there.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org