You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@camel.apache.org by "Claus Ibsen (Jira)" <ji...@apache.org> on 2021/01/20 09:45:00 UTC

[jira] [Created] (CAMEL-16064) camel-vertx-kafka - Add batching consumer

Claus Ibsen created CAMEL-16064:
-----------------------------------

             Summary: camel-vertx-kafka - Add batching consumer
                 Key: CAMEL-16064
                 URL: https://issues.apache.org/jira/browse/CAMEL-16064
             Project: Camel
          Issue Type: New Feature
          Components: camel-kafka
            Reporter: Claus Ibsen
             Fix For: 3.x


It would be good to make camel-vertx-kafka consumer able to batch together N messages via aggregation strategy as a single outgoing exchange. The batch should support group size, and timeout.

Something that was in the sjms-batch component.

The batching should use the same KafkaConsumer instance and defer the commit till the batching has been done. This requires manual offset commit by the consumer.

The use-case has been discussed on the chat at
https://camel.zulipchat.com/#narrow/stream/257298-camel/topic/kafka.20and.20batching



--
This message was sent by Atlassian Jira
(v8.3.4#803005)