You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Maximilian Michels (Jira)" <ji...@apache.org> on 2023/12/07 14:51:00 UTC
[jira] [Created] (FLINK-33773) Add fairness to scaling decisions
Maximilian Michels created FLINK-33773:
------------------------------------------
Summary: Add fairness to scaling decisions
Key: FLINK-33773
URL: https://issues.apache.org/jira/browse/FLINK-33773
Project: Flink
Issue Type: New Feature
Components: Autoscaler, Deployment / Kubernetes
Reporter: Maximilian Michels
Assignee: Maximilian Michels
Fix For: kubernetes-operator-1.8.0
The current scaling logic is inherently unfair. In a scenario of heavy backlog, whichever pipelines come first, they will end up taking most of the resources. Some kind of fairness should be introduced, for example:
* Cap the max number of resulting pods at a % of the cluster resources
* Allow scale up round-robin across all pipelines
--
This message was sent by Atlassian Jira
(v8.20.10#820010)