You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2016/04/11 20:25:25 UTC
[jira] [Created] (BEAM-188) Merging WindowFn + GBK + Write =>
InvalidWindows throws UnsupportedOperationException
Kenneth Knowles created BEAM-188:
------------------------------------
Summary: Merging WindowFn + GBK + Write => InvalidWindows throws UnsupportedOperationException
Key: BEAM-188
URL: https://issues.apache.org/jira/browse/BEAM-188
Project: Beam
Issue Type: Bug
Components: sdk-java-core
Reporter: Kenneth Knowles
Assignee: Kenneth Knowles
The {{Write}} transform performs {{outputWithTimestamp(..., Instant.now())}} in the {{finishBundle}} of one of the encapsulated {{ParDo}} transforms. This action causes the {{WindowFn}} to be invoked to assign a window to the output value. But a merging {{WindowFn}} such as {{Sessions}} will be replaced by {{InvalidWindows}} at the GBK where merging is performed, so this is destined to crash.
It is almost certain that the window is not relevant, so we can quickly fix this by just windowing into the global window earlier and using vanilla {{output(...)}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)