You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Enric Ott <24...@qq.com> on 2024/06/25 01:51:40 UTC
flink kubernetes flink autoscale behavior
Hello,Community:
I’ve recently started using the Flink Kubernetes Operator,and I'd like to know if CPU and Job Parallelism autoscaling are supported without restarting the whole job,if it’s supported, please tell me how to configure and deploy it.
Thanks.
回复：Fail to pull image autoscaling
Posted by Enric Ott <24...@qq.com>.
Hello,Community:
Is there a reactive scheduling approach in flink which autoscales down reacting to input traffic flow reduction for deployment of flink on Kubernetes?
Thanks.
------------------ 原始邮件 ------------------
发件人: "Enric Ott" <243816978@qq.com>;
发送时间: 2024年6月28日(星期五) 上午10:26
收件人: "user"<user@flink.apache.org>;
抄送: "user"<user@flink.apache.org>;
主题: Fail to pull image autoscaling
Hi,Community:
I'm using flink-kubernetes-operator of version 1.6 to deploy flink auto scaling (https://github.com/apache/flink-kubernetes-operator/blob/main/examples/autoscaling/autoscaling.yaml) on K8S,but encountered the error fail to pull the image autoscaling-example,Could any one give me some clues to work this shit out ?
Thanks.
------------------ 原始邮件 ------------------
发件人: "Enric Ott" <243816978@qq.com>;
发送时间: 2024年6月25日(星期二) 下午3:28
收件人: "Rion Williams"<rionmonster@gmail.com>;
抄送: "user"<user@flink.apache.org>;
主题: 回复： flink kubernetes flink autoscale behavior
Thanks,Rion.I roughly understand.And I still want to know whether the deployment of Adaptive Scheduler relies on Kubernetes? Are there any cases of deploying Flink Adaptive Scheduler on bare metal machine?
Appreciated again.
------------------ 原始邮件 ------------------
发件人: "Rion Williams" <rionmonster@gmail.com>;
发送时间: 2024年6月25日(星期二) 中午1:31
收件人: "Enric Ott"<243816978@qq.com>;
抄送: "user"<user@flink.apache.org>;
主题: Re: flink kubernetes flink autoscale behavior
Hi Eric,
I believe you might be referring to use of the adaptive scheduler which should support these “in-place” scaling operations via:
jobmanager.scheduler: adaptive
You can see the documentation for Elastic Scaling here for additional details and configuration.
On Jun 24, 2024, at 11:56 PM, Enric Ott <243816978@qq.com> wrote:
Hello,Community:
I’ve recently started using the Flink Kubernetes Operator,and I'd like to know if CPU and Job Parallelism autoscaling are supported without restarting the whole job,if it’s supported, please tell me how to configure and deploy it.
Thanks.
Fail to pull image autoscaling
Posted by Enric Ott <24...@qq.com>.
Hi,Community:
I'm using flink-kubernetes-operator of version 1.6 to deploy flink auto scaling (https://github.com/apache/flink-kubernetes-operator/blob/main/examples/autoscaling/autoscaling.yaml) on K8S,but encountered the error fail to pull the image autoscaling-example,Could any one give me some clues to work this shit out ?
Thanks.
------------------ 原始邮件 ------------------
发件人: "Enric Ott" <243816978@qq.com>;
发送时间: 2024年6月25日(星期二) 下午3:28
收件人: "Rion Williams"<rionmonster@gmail.com>;
抄送: "user"<user@flink.apache.org>;
主题: 回复： flink kubernetes flink autoscale behavior
Thanks,Rion.I roughly understand.And I still want to know whether the deployment of Adaptive Scheduler relies on Kubernetes? Are there any cases of deploying Flink Adaptive Scheduler on bare metal machine?
Appreciated again.
------------------ 原始邮件 ------------------
发件人: "Rion Williams" <rionmonster@gmail.com>;
发送时间: 2024年6月25日(星期二) 中午1:31
收件人: "Enric Ott"<243816978@qq.com>;
抄送: "user"<user@flink.apache.org>;
主题: Re: flink kubernetes flink autoscale behavior
Hi Eric,
I believe you might be referring to use of the adaptive scheduler which should support these “in-place” scaling operations via:
jobmanager.scheduler: adaptive
You can see the documentation for Elastic Scaling here for additional details and configuration.
On Jun 24, 2024, at 11:56 PM, Enric Ott <243816978@qq.com> wrote:
Hello,Community:
I’ve recently started using the Flink Kubernetes Operator,and I'd like to know if CPU and Job Parallelism autoscaling are supported without restarting the whole job,if it’s supported, please tell me how to configure and deploy it.
Thanks.
回复： flink kubernetes flink autoscale behavior
Posted by Enric Ott <24...@qq.com>.
Thanks,Rion.I roughly understand.And I still want to know whether the deployment of Adaptive Scheduler relies on Kubernetes? Are there any cases of deploying Flink Adaptive Scheduler on bare metal machine?
Appreciated again.
------------------ 原始邮件 ------------------
发件人: "Rion Williams" <rionmonster@gmail.com>;
发送时间: 2024年6月25日(星期二) 中午1:31
收件人: "Enric Ott"<243816978@qq.com>;
抄送: "user"<user@flink.apache.org>;
主题: Re: flink kubernetes flink autoscale behavior
Hi Eric,
I believe you might be referring to use of the adaptive scheduler which should support these “in-place” scaling operations via:
jobmanager.scheduler: adaptive
You can see the documentation for Elastic Scaling here for additional details and configuration.
On Jun 24, 2024, at 11:56 PM, Enric Ott <243816978@qq.com> wrote:
Hello,Community:
I’ve recently started using the Flink Kubernetes Operator,and I'd like to know if CPU and Job Parallelism autoscaling are supported without restarting the whole job,if it’s supported, please tell me how to configure and deploy it.
Thanks.
Re: flink kubernetes flink autoscale behavior
Posted by Rion Williams <ri...@gmail.com>.
Hi Eric,
I believe you might be referring to use of the adaptive scheduler which should
support these “in-place” scaling operations via:
jobmanager.scheduler: adaptive
You can see [the documentation for Elastic Scaling
here](https://nightlies.apache.org/flink/flink-docs-
release-1.19/docs/deployment/elastic_scaling/#usage) for additional details
and configuration.
> On Jun 24, 2024, at 11:56 PM, Enric Ott <24...@qq.com> wrote:
>
>
>
>
> Hello,Community:
>
> I’ve recently started using the Flink Kubernetes Operator,and I'd like to
> know if CPU and Job Parallelism autoscaling are supported without restarting
> the whole job,if it’s supported, please tell me how to configure and deploy
> it.
>
> Thanks.