You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/12/30 18:14:49 UTC
[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka
Consumer if checkpointing is disabled
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075216#comment-15075216 ]
ASF GitHub Bot commented on FLINK-2974:
---------------------------------------
Github user filipefigcorreia commented on the pull request:
https://github.com/apache/flink/pull/1341#issuecomment-168036891
Do these changes mean that now it is not possible to have flink always read from the beginning of a Kafka topic if needed?
> Add periodic offset commit to Kafka Consumer if checkpointing is disabled
> -------------------------------------------------------------------------
>
> Key: FLINK-2974
> URL: https://issues.apache.org/jira/browse/FLINK-2974
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Robert Metzger
> Assignee: Robert Metzger
> Fix For: 1.0.0, 0.10.1
>
>
> Flink only writes the offsets from the consumer into ZK if checkpointing is enabled.
> We should have a similar feature to Kafka's autocommit in our consumer.
> Issue reported by user: http://stackoverflow.com/questions/33501574/flink-kafka-why-am-i-losing-messages
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)