You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Maximilian Michels (Jira)" <ji...@apache.org> on 2023/12/07 14:51:00 UTC

[jira] [Created] (FLINK-33773) Add fairness to scaling decisions

Maximilian Michels created FLINK-33773:
------------------------------------------

             Summary: Add fairness to scaling decisions
                 Key: FLINK-33773
                 URL: https://issues.apache.org/jira/browse/FLINK-33773
             Project: Flink
          Issue Type: New Feature
          Components: Autoscaler, Deployment / Kubernetes
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
             Fix For: kubernetes-operator-1.8.0


The current scaling logic is inherently unfair. In a scenario of heavy backlog, whichever pipelines come first, they will end up taking most of the resources. Some kind of fairness should be introduced, for example:

* Cap the max number of resulting pods at a % of the cluster resources
* Allow scale up round-robin across all pipelines



--
This message was sent by Atlassian Jira
(v8.20.10#820010)