You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "David Neth (Jira)" <ji...@apache.org> on 2020/04/28 06:37:00 UTC

[jira] [Created] (BEAM-9838) Watermark not advancing on splittable DoFns in Flink

David Neth created BEAM-9838:
--------------------------------

             Summary: Watermark not advancing on splittable DoFns in Flink
                 Key: BEAM-9838
                 URL: https://issues.apache.org/jira/browse/BEAM-9838
             Project: Beam
          Issue Type: Bug
          Components: runner-flink
    Affects Versions: 2.19.0, 2.18.0, 2.20.0
            Reporter: David Neth


The Flink runner doesn't seem to be advancing the offset for splittable DoFns.  Using a non-splittable DoFn results in the watermark advancing, as does using the direct runner.

 

I started a conversation on the mailing list that has more detail:

[https://lists.apache.org/thread.html/r36977395be0998caf75496b70c767b73be6844564efef5a15931d248%40%3Cuser.beam.apache.org%3E]

 

This behavior has been observed on beam 2.18, 2.19 and 2.20 and Flink 1.8.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)