You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by Arun Balan <ar...@gmail.com> on 2016/05/12 23:18:30 UTC

flink Kafka connector

Hi, I am trying to use the flink-kafka-connector and I notice that every time I restart my application it re-reads the last message on the kafka topic. So if the latest offset on the topic is 10, then when the application is restarted, kafka will re-read message 10. Why is this the behavior? I would assume that the last message has already been read and offset committed. I require that messages that are already processed from the topic not be reprocessed. Any insight would be helpful.

Thanks
Arun Balan