You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Shammon (Jira)" <ji...@apache.org> on 2021/12/15 11:58:00 UTC

[jira] [Created] (FLINK-25329) Improvement of disk operations in flink session cluster for jobs

Shammon created FLINK-25329:
-------------------------------

             Summary: Improvement of disk operations in flink session cluster for jobs
                 Key: FLINK-25329
                 URL: https://issues.apache.org/jira/browse/FLINK-25329
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.13.3, 1.12.5, 1.14.0
            Reporter: Shammon


Flink session cluster uses files to store info of jobs after they reach termination with `FileExecutionGraphInfoStore`, each job will generate one file. When the cluster executes many small jobs concurrently, there will be many disk related operations, which will

1> Increase the CPU usage of `Dispatcher`
2> Decrease the performance of the jobs in the cluster.

We hope to improve the disk operations in `FileExecutionGraphInfoStore` to increase the performance of session cluster.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)