[jira] [Comment Edited] (APEXMALHAR-2419) KafkaSinglePortExactlyOnceOutputOperator fails on recovery

["Sandesh (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878951#comment-15878951 ] 

Sandesh edited comment on APEXMALHAR-2419 at 2/22/17 6:46 PM:
--------------------------------------------------------------

Largest completed window is moving only after a committed call on WindowDataManager but the expected behavior is, Largest completed Window is the last saved Window ID. Current behaviour breaks not only this operator but also all the operators that use WindowData Manager for recovery.


was (Author: sandesh):
Largest completed window is moving only after a committed call on WindowDataManager but the expected behavior is, Largest completed Window is the last saved Window ID. Current behaviour breaks not only this operator but also all the operators that use this operator.

> KafkaSinglePortExactlyOnceOutputOperator fails on recovery
> ----------------------------------------------------------
>
>                 Key: APEXMALHAR-2419
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2419
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Munagala V. Ramanath
>            Assignee: Sandesh
>
> The KafkaSinglePortExactlyOnceOutputOperator fails on recovery with the message: "Violates Exactly once. Not all the tuples received after operator reset."
> This is because of this check in endWindow():
> {code}
>    if (!partialWindowTuples.isEmpty() && windowId > windowDataManager.getLargestCompletedWindow()) {
>       throw new RuntimeException("Violates Exactly once. Not all the tuples received after operator reset.");
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)