You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Sriharsha Chintalapani (JIRA)" <ji...@apache.org> on 2015/09/08 15:51:46 UTC

[jira] [Updated] (STORM-1017) If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.

     [ https://issues.apache.org/jira/browse/STORM-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sriharsha Chintalapani updated STORM-1017:
------------------------------------------
    Assignee: Priyank Shah  (was: Sriharsha Chintalapani)

> If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.
> --------------------------------------------------------------------------------------
>
>                 Key: STORM-1017
>                 URL: https://issues.apache.org/jira/browse/STORM-1017
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: storm-kafka
>            Reporter: Renkai Ge
>            Assignee: Priyank Shah
>
> when ignoreZkOffsets set true and startOffsetTime = kafka.api.OffsetRequest.EarliestTime().
> workers running -> topology shutdown by user and restart -> workers will read from earliest time again
> workers running -> one of workers shutdown by accident and supervisor restart the worker -> what offset will the restarted worker read from?
> More details on https://github.com/apache/storm/pull/493#issuecomment-135783234
> It will cause a lot of unwanted duplicated messages in some scenes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)