You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Jan Lukavský (JIRA)" <ji...@apache.org> on 2019/07/19 10:49:00 UTC

[jira] [Created] (BEAM-7785) DirectRunner: watermarks are updated asynchronously from bundle processing

Jan Lukavský created BEAM-7785:
----------------------------------

             Summary: DirectRunner: watermarks are updated asynchronously from bundle processing
                 Key: BEAM-7785
                 URL: https://issues.apache.org/jira/browse/BEAM-7785
             Project: Beam
          Issue Type: Bug
          Components: runner-direct
    Affects Versions: 2.13.0
            Reporter: Jan Lukavský
            Assignee: Jan Lukavský
             Fix For: 2.15.0


Watermarks are updated in QuiescenceDriver (by calling fireTimers, which calls forceRefresh()) on WatermarkManager. This results in creating timer bundles, that are then processed asynchronously as DirectTransformExecutor. Because of that, watermarks (input watermarks mostly) might be updated while bundle is being processed. That violates assumption, that bundle processing should be atomical (with identical external conditions during processing of whole bundle).



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)