You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Shammon (Jira)" <ji...@apache.org> on 2021/12/16 02:02:00 UTC
[jira] [Created] (FLINK-25334) Manage and share gateways of taskmanagers between jobs in session cluster
Shammon created FLINK-25334:
-------------------------------
Summary: Manage and share gateways of taskmanagers between jobs in session cluster
Key: FLINK-25334
URL: https://issues.apache.org/jira/browse/FLINK-25334
Project: Flink
Issue Type: Sub-task
Components: Runtime / Coordination
Affects Versions: 1.13.3, 1.12.4, 1.14.0
Reporter: Shammon
Flink session cluster launches a certain number of taskmanagers and they won't exit during the cluster running. When a job is submitted to the cluster, taskmanagers will offer slots to `JobMaster` with location info. Then `JobMaster` will get `InetAddress` from the location and connect the taskmanager. This cause some performance loss and it isn't necessary in session cluster.
It's better to manager the gateways of taskmanagers in JM and share them between jobs. When a taskmanager's gateway is exist and valid, the `JobMaster` can use it directly instead of creating a new one.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)