You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Jan Lukavský (JIRA)" <ji...@apache.org> on 2019/07/19 10:49:00 UTC
[jira] [Created] (BEAM-7785) DirectRunner: watermarks are updated
asynchronously from bundle processing
Jan Lukavský created BEAM-7785:
----------------------------------
Summary: DirectRunner: watermarks are updated asynchronously from bundle processing
Key: BEAM-7785
URL: https://issues.apache.org/jira/browse/BEAM-7785
Project: Beam
Issue Type: Bug
Components: runner-direct
Affects Versions: 2.13.0
Reporter: Jan Lukavský
Assignee: Jan Lukavský
Fix For: 2.15.0
Watermarks are updated in QuiescenceDriver (by calling fireTimers, which calls forceRefresh()) on WatermarkManager. This results in creating timer bundles, that are then processed asynchronously as DirectTransformExecutor. Because of that, watermarks (input watermarks mostly) might be updated while bundle is being processed. That violates assumption, that bundle processing should be atomical (with identical external conditions during processing of whole bundle).
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)