You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@camel.apache.org by "yogananth mahalingam (JIRA)" <ji...@apache.org> on 2015/04/15 02:05:59 UTC

[jira] [Commented] (CAMEL-8085) Add handling of offset in case of auto commit is disabled to prevent data loss

    [ https://issues.apache.org/jira/browse/CAMEL-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495179#comment-14495179 ] 

yogananth mahalingam commented on CAMEL-8085:
---------------------------------------------

I am observing one issue with the implementation.

For the last batch of messages that is getting processed, offset is not getting commited to ZK.
Can you handle this scenario as well?

> Add handling of offset in case of auto commit is disabled to prevent data loss
> ------------------------------------------------------------------------------
>
>                 Key: CAMEL-8085
>                 URL: https://issues.apache.org/jira/browse/CAMEL-8085
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-kafka
>    Affects Versions: 2.14.0
>            Reporter: Ivan Vasyliev
>            Assignee: Willem Jiang
>            Priority: Minor
>             Fix For: 2.15.0
>
>
> In order to prevent data loss kafka client allows to manually handle consumer offset.
> According to this lady:
> http://ingest.tips/2014/10/12/kafka-high-level-consumer-frequently-missing-pieces/
> Kafka consumer "commitOffset" is committing offset for each consumer and for all streams of this consumer. 
> I've made changes in camel-kafka in order to support handling of offset in case of auto-commit option is disabled.
> https://github.com/apache/camel/pull/342



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)