You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@camel.apache.org by "AishD3 (via GitHub)" <gi...@apache.org> on 2024/03/11 09:50:12 UTC

[I] Kafka Events batching [camel-kafka-connector]

AishD3 opened a new issue, #1605:
URL: https://github.com/apache/camel-kafka-connector/issues/1605

   Hi @oscerd , we would like batch some amount of kafka records while a file is created in data lake . We are using below configs in Kafka Connect for that , but batching is not working , is it correct and am I missing something. 
   
       camel.aggregation.size: 5
       camel.aggregation.timeout: 5000


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Kafka Events batching [camel-kafka-connector]

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1605:
URL: https://github.com/apache/camel-kafka-connector/issues/1605#issuecomment-1988027816

   You need to add a bean because otherwise Camel don't know how to aggregate.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Kafka Events batching [camel-kafka-connector]

Posted by "oscerd (via GitHub)" <gi...@apache.org>.
oscerd commented on issue #1605:
URL: https://github.com/apache/camel-kafka-connector/issues/1605#issuecomment-1988012362

   https://camel.apache.org/camel-kafka-connector/4.0.x/user-guide/aggregation.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Kafka Events batching [camel-kafka-connector]

Posted by "AishD3 (via GitHub)" <gi...@apache.org>.
AishD3 commented on issue #1605:
URL: https://github.com/apache/camel-kafka-connector/issues/1605#issuecomment-1988061703

   Thanks a lot its working


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Kafka Events batching [camel-kafka-connector]

Posted by "AishD3 (via GitHub)" <gi...@apache.org>.
AishD3 commented on issue #1605:
URL: https://github.com/apache/camel-kafka-connector/issues/1605#issuecomment-1988026288

   @oscerd Yes we referred to this , but do we need to add camel.beans.aggregate=#class:org.apache.camel.kafkaconnector.aggregator.StringAggregator 
   
   as well , or only 
   
   camel.aggregation.size: 5
   camel.aggregation.timeout: 5000
   
   is enough


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@camel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org