You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Cameron Lee (Jira)" <ji...@apache.org> on 2019/10/17 17:10:00 UTC
[jira] [Assigned] (SAMZA-2303) Exclude side inputs when handling
end-of-stream and watermarks for high-level
[ https://issues.apache.org/jira/browse/SAMZA-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cameron Lee reassigned SAMZA-2303:
----------------------------------
Assignee: (was: Cameron Lee)
> Exclude side inputs when handling end-of-stream and watermarks for high-level
> -----------------------------------------------------------------------------
>
> Key: SAMZA-2303
> URL: https://issues.apache.org/jira/browse/SAMZA-2303
> Project: Samza
> Issue Type: Bug
> Reporter: Cameron Lee
> Priority: Major
>
> OperatorImplGraph builds EndOfStreamStates and WatermarkStates objects with all of the input SSPs from the job model. That includes side-input SSPs. However, high-level operator tasks aren't given messages from side-input SSPs, so high-level operators should not need to include handling for end-of-stream and watermarks.
> The result of this issue is that end-of-stream and watermark handling tries to include side-inputs but never updates those states, which can result in not exiting properly (end-of-stream) and not correctly calculating watermarks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)