You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Salva (Jira)" <ji...@apache.org> on 2025/09/04 11:05:00 UTC

[jira] [Created] (FLINK-38323) Global Scale Factor Mode

Salva created FLINK-38323:
-----------------------------

             Summary: Global Scale Factor Mode
                 Key: FLINK-38323
                 URL: https://issues.apache.org/jira/browse/FLINK-38323
             Project: Flink
          Issue Type: New Feature
          Components: Autoscaler
    Affects Versions: 1.12.1
            Reporter: Salva
         Attachments: TMs - CPU Usage.png

As a user, I'd like to have an option to restrict to scaling decision altering the number of replicas. This could be achieved by using a global scale factor instead of individually adjusting the parallelism for the different operators. This would make the autoscaler work as when one adds/removes replicas by hand.

Some users have reported running an internal version of the autoscaler with the one major difference being that they let the whole pipeline (except for the sources/sinks) to have the same parallelism to avoid uneven task distribution. The change should be relatively simple, i.e., just run the algorithm per vertex, and take the max of them.

See the question/suggestion first posted [here|[https://lists.apache.org/thread/rf9fpr6cjnjjwl6rqhtbhfn380doghyl]].

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)