You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Christophe Bornet (Jira)" <ji...@apache.org> on 2023/06/05 17:09:00 UTC

[jira] [Created] (FLINK-32255) Pre-deployed idle Task Managers

Christophe Bornet created FLINK-32255:
-----------------------------------------

             Summary: Pre-deployed idle Task Managers
                 Key: FLINK-32255
                 URL: https://issues.apache.org/jira/browse/FLINK-32255
             Project: Flink
          Issue Type: New Feature
          Components: Kubernetes Operator
            Reporter: Christophe Bornet


In the kubernetes operator, it would be nice to have the possibility to define a number of pre-deployed spare Task Managers. The operator would ensure that there are always a number of ready-to-be-used TMs that can accept new incoming jobs.

The goal would be to reduce the startup time of jobs, especially in the session cluster mode.

See for inspiration  [https://www.decodable.co/blog/flink-deployments-at-decodable] -> Custom Flink Session Clusters for Preview Jobs: "To further reduce the preview response time, we also modified Flink to pre-deploy some idle TaskManagers. When a TaskManager is used, a new TaskManager is immediately created so there is always a pool of idle TaskManagers."



--
This message was sent by Atlassian Jira
(v8.20.10#820010)