You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org> on 2017/05/13 12:48:04 UTC

[jira] [Commented] (FLINK-6062) Re-read a Kafka topic at the reception of an event

    [ https://issues.apache.org/jira/browse/FLINK-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009323#comment-16009323 ] 

Tzu-Li (Gordon) Tai commented on FLINK-6062:
--------------------------------------------

The Kafka connector now allows setting to start reading at the most earliest event, independently of any committed offsets.
However, you'll have to restart the job to do that.

I wonder if the case you mentioned here can be simply done be restarting the job with the start position appropriately set.
What do you think [~jpreisner]?

> Re-read a Kafka topic at the reception of an event
> --------------------------------------------------
>
>                 Key: FLINK-6062
>                 URL: https://issues.apache.org/jira/browse/FLINK-6062
>             Project: Flink
>          Issue Type: New Feature
>          Components: DataStream API, Kafka Connector
>    Affects Versions: 1.2.0
>            Reporter: Julien Preisner
>
> This new feature consist that to re-read a Kafka topic at the reception of an event.
> Example of use case : a job deserializes messages from Kafka topic and does calculations. When a special event happens (from another Kafka topic for example), I want to reset my calculations and re-read the topic Kafka.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)