You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Gyula Fora (Jira)" <ji...@apache.org> on 2022/04/19 07:13:00 UTC

[jira] [Created] (FLINK-27303) Flink Operator will create a large amount of temp log config files

Gyula Fora created FLINK-27303:
----------------------------------

             Summary: Flink Operator will create a large amount of temp log config files
                 Key: FLINK-27303
                 URL: https://issues.apache.org/jira/browse/FLINK-27303
             Project: Flink
          Issue Type: Improvement
          Components: Kubernetes Operator
    Affects Versions: kubernetes-operator-1.0.0
            Reporter: Gyula Fora
             Fix For: kubernetes-operator-1.0.0


Now we use the configbuilder in multiple different places to generate the effective config including observer, reconciler, validator etc.

The effective config gerenration logic also creates temporary log config files (if spec logConfiguration is set) which would lead to 3-4 files generated in every reconcile loop for a given job. These files are not cleaned up until the operator restarts leading to a large amount of files.

I believe we should change the config generation logic and only apply the logconfig generation logic right before flink cluster submission as that is the only thing affected by it.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)