You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Maximilian Michels (Jira)" <ji...@apache.org> on 2020/08/14 17:42:00 UTC

[jira] [Updated] (BEAM-10691) FlinkRunner: pipeline slows down due to slow output timetamp queue

     [ https://issues.apache.org/jira/browse/BEAM-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maximilian Michels updated BEAM-10691:
--------------------------------------
    Summary: FlinkRunner: pipeline slows down due to slow output timetamp queue   (was: FlinkRunner: pipeline might get stuck due to timer watermark hold not being released)

> FlinkRunner: pipeline slows down due to slow output timetamp queue 
> -------------------------------------------------------------------
>
>                 Key: BEAM-10691
>                 URL: https://issues.apache.org/jira/browse/BEAM-10691
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>    Affects Versions: 2.23.0, 2.24.0
>            Reporter: Jan Lukavský
>            Assignee: Jan Lukavský
>            Priority: P1
>             Fix For: 2.25.0
>
>          Time Spent: 7h 10m
>  Remaining Estimate: 0h
>
> Pipeline might stop progressing watermark in certain cases due to timer output timestamp not being released from FlinkTimerInternals#outputTimestampQueue. The pipeline has to be restarted from checkpoint to reload the cache and free watermark hold.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)