[jira] [Updated] (CAMEL-16064) camel-kafka - Add batching consumer

["Claus Ibsen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CAMEL-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Claus Ibsen updated CAMEL-16064:
--------------------------------
    Fix Version/s:     (was: 3.12.0)
                   3.13.0

> camel-kafka - Add batching consumer
> -----------------------------------
>
>                 Key: CAMEL-16064
>                 URL: https://issues.apache.org/jira/browse/CAMEL-16064
>             Project: Camel
>          Issue Type: New Feature
>          Components: camel-kafka
>            Reporter: Claus Ibsen
>            Priority: Major
>             Fix For: 3.13.0
>
>
> It would be good to make camel-kafka and camel-vertx-kafka consumer able to batch together N messages via aggregation strategy as a single outgoing exchange. The batch should support group size, and timeout.
> Something that was in the sjms-batch component.
> The batching should use the same KafkaConsumer instance and defer the commit till the batching has been done. This requires manual offset commit by the consumer.
> The use-case has been discussed on the chat at
> https://camel.zulipchat.com/#narrow/stream/257298-camel/topic/kafka.20and.20batching



--
This message was sent by Atlassian Jira
(v8.3.4#803005)