You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Salva Alcántara <sa...@gmail.com> on 2025/03/14 15:04:29 UTC

Interplay between K8s VPA/HPA & Flink Operator (Auto-Scaling/Tuning)

Does Kubernetes Vertical Pod Autoscaling (VPA) play well with Flink & Flink
Kubernetes Operator? Is that recommended or should I instead use
Flink-specific, built-in mechanisms like Flink Autotuning. Same for HPA &
Flink Autoscaling.

Any guidance on this would be appreciated!

Salva

Re: Interplay between K8s VPA/HPA & Flink Operator (Auto-Scaling/Tuning)

Posted by Salva Alcántara <sa...@gmail.com>.
👍

Salva reacted via Gmail
<https://www.google.com/gmail/about/?utm_source=gmail-in-product&utm_medium=et&utm_campaign=emojireactionemail#app>

On Thu, Jun 5, 2025, 14:40 Gyula Fóra <gy...@gmail.com> wrote:

> Flink Autoscaling works based on processing capacity not directly on cpu.
> You cannot enable VPA/HPA together with the Flink Autoscaler.
>
> Gyula
>
> On Thu, Jun 5, 2025 at 2:27 PM Salva Alcántara <sa...@gmail.com>
> wrote:
>
>> From other threads like this:
>>
>> https://lists.apache.org/thread/zhfk8p4l46v3n367wwh2o2jmgfz6y2xb
>>
>> It seems that one should favour Flink Auto-Scaling/Tuning built-in
>> solutions over the more generic K8s HPA/VPA ones.
>>
>> It might still make sense to enable VPA for CPU Autotuning since Flink
>> Autotuning restricts to memory.
>>
>> Am I right? Please correct me if I'm wrong.
>>
>> Regards,
>>
>> Salva
>>
>

Re: Interplay between K8s VPA/HPA & Flink Operator (Auto-Scaling/Tuning)

Posted by Gyula Fóra <gy...@gmail.com>.
Flink Autoscaling works based on processing capacity not directly on cpu.
You cannot enable VPA/HPA together with the Flink Autoscaler.

Gyula

On Thu, Jun 5, 2025 at 2:27 PM Salva Alcántara <sa...@gmail.com>
wrote:

> From other threads like this:
>
> https://lists.apache.org/thread/zhfk8p4l46v3n367wwh2o2jmgfz6y2xb
>
> It seems that one should favour Flink Auto-Scaling/Tuning built-in
> solutions over the more generic K8s HPA/VPA ones.
>
> It might still make sense to enable VPA for CPU Autotuning since Flink
> Autotuning restricts to memory.
>
> Am I right? Please correct me if I'm wrong.
>
> Regards,
>
> Salva
>

Re: Interplay between K8s VPA/HPA & Flink Operator (Auto-Scaling/Tuning)

Posted by Salva Alcántara <sa...@gmail.com>.
From other threads like this:

https://lists.apache.org/thread/zhfk8p4l46v3n367wwh2o2jmgfz6y2xb

It seems that one should favour Flink Auto-Scaling/Tuning built-in
solutions over the more generic K8s HPA/VPA ones.

It might still make sense to enable VPA for CPU Autotuning since Flink
Autotuning restricts to memory.

Am I right? Please correct me if I'm wrong.

Regards,

Salva