You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Otavio Rodolfo Piske (Jira)" <ji...@apache.org> on 2021/10/07 14:13:00 UTC

[jira] [Commented] (CAMEL-17051) Need the ability to pause kafka consumer

    [ https://issues.apache.org/jira/browse/CAMEL-17051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17425579#comment-17425579 ] 

Otavio Rodolfo Piske commented on CAMEL-17051:
----------------------------------------------

At first sight there may be a small overlap in the restart/resume part of this ticket, which could be covered on the SPI to be introduced by CAMEL-15562. Therefore, I am marking it as related - but subject to further analysis.

> Need the ability to pause kafka consumer
> ----------------------------------------
>
>                 Key: CAMEL-17051
>                 URL: https://issues.apache.org/jira/browse/CAMEL-17051
>             Project: Camel
>          Issue Type: New Feature
>          Components: camel-kafka
>    Affects Versions: 3.12.0
>            Reporter: Zachariah Young
>            Priority: Major
>             Fix For: Future
>
>
> When handling transient errors that have exhausted retry limits, sometimes pausing the Kafka consumer is the best way to handle an outage.  A great example of this would be the Facebook outage that happen this week.
> One might suggest that stopping the consumer work would for this use case.  This would of course work but would require a manual restart.  Also, you want to try to avoid a rebalance of the consumer.
> I would like to see a new strategy be created that would allow for pause and resume to be configured.
> Ideally, the resume could be configured based on a health check.
>  
> Example code: [https://github.com/jeanlouisboudart/retriable-consumer/blob/master/consumer/src/main/java/com/sample/InfiniteRetriesConsumer.java]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)