You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Roman Khachatryan (Jira)" <ji...@apache.org> on 2022/08/15 17:28:00 UTC

[jira] [Created] (FLINK-28976) Changelog 1st materialization delayed unneccesarily

Roman Khachatryan created FLINK-28976:
-----------------------------------------

             Summary: Changelog 1st materialization delayed unneccesarily
                 Key: FLINK-28976
                 URL: https://issues.apache.org/jira/browse/FLINK-28976
             Project: Flink
          Issue Type: Bug
          Components: Runtime / State Backends
    Affects Versions: 1.15.1, 1.16.0
            Reporter: Roman Khachatryan
            Assignee: Roman Khachatryan
             Fix For: 1.16.0, 1.15.2


In PeriodicMaterializationManager.start(), the 1st materialization is scheduled with a delay: materialization_interval + random_offset 

Here, random_offset is added to avoid thundering herd problem.
The next materialization will be scheduled with a delay of only materialization_interval.

That means that the 1st materialization will have to compact up to 2 times more state changes than the subsequent ones. 

Which in turn can cause FLINK--26590 or other problems.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)