You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@apex.apache.org by "devendra tagare (JIRA)" <ji...@apache.org> on 2016/08/12 22:32:21 UTC

[jira] [Assigned] (APEXMALHAR-2187) Kafka Input Operator supports retry for loading initial offset

     [ https://issues.apache.org/jira/browse/APEXMALHAR-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

devendra tagare reassigned APEXMALHAR-2187:
-------------------------------------------

    Assignee: devendra tagare  (was: Sandesh)

> Kafka Input Operator supports retry for loading initial offset
> --------------------------------------------------------------
>
>                 Key: APEXMALHAR-2187
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2187
>             Project: Apache Apex Malhar
>          Issue Type: New Feature
>            Reporter: Sunil
>            Assignee: devendra tagare
>
> Kafka input operator loads initial consumer offset from Kafka/Zookeeper and if it doesn't exist falls back to earliest or latest based on configuration. In the current implementation the offset load method doesn't retry and in the event like timeout can reset the consumer offset. This can result in data loss or duplicates. 
> Kafka input operator should have an attribute for retrying the initial offset loading instead of falling over to reset on first attempt. 
>       



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)