You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by weilongxing <we...@aicaigroup.com> on 2018/09/29 05:43:19 UTC

Flink standalone cluster load average is too high.

I am using flink 1.5.2 in standalone mode. The machine is 8 cores with 32GB memory. I set slots to 4 or 8. I set most jobs parallelism to 1. And each machine has jobs less than the slot number.

The load average is too high as the picture shows below. Each line presents load average 1 on one machine. CPU usage on each machine is 100%. 

All jobs are flink stream SQL. 

  

Can anybody help?


Thanks.

Re: Flink standalone cluster load average is too high.

Posted by weilongxing <we...@aicaigroup.com>.

It works. Thanks.



> 在 2018年9月29日，下午2:14，Congxian Qiu <qc...@gmail.com> 写道：
> 
> Hi
> In my opinion, you can use jstack to find what are the processes doing, If you still have problem after that, you could share the code or some demo code you are running.
> 
> weilongxing <weilongxing@aicaigroup.com <ma...@aicaigroup.com>> 于2018年9月29日周六 下午1:43写道：
> I am using flink 1.5.2 in standalone mode. The machine is 8 cores with 32GB memory. I set slots to 4 or 8. I set most jobs parallelism to 1. And each machine has jobs less than the slot number.
> 
> The load average is too high as the picture shows below. Each line presents load average 1 on one machine. CPU usage on each machine is 100%. 
> 
> All jobs are flink stream SQL. 
> 
>   
> 
> Can anybody help?
> 
> 
> Thanks.
> 
> 
> -- 
> Blog:http://www.klion26.com <http://www.klion26.com/>
> GTalk:qcx978132955
> 一切随心
> <PastedGraphic-16.png><PastedGraphic-16.png>

Re: Flink standalone cluster load average is too high.

Posted by Congxian Qiu <qc...@gmail.com>.

Hi
In my opinion, you can use jstack to find what are the processes doing, If
you still have problem after that, you could share the code or some demo
code you are running.

weilongxing <we...@aicaigroup.com> 于2018年9月29日周六 下午1:43写道：

> I am using flink 1.5.2 in standalone mode. The machine is 8 cores with
> 32GB memory. I set slots to 4 or 8. I set most jobs parallelism to 1. And
> each machine has jobs less than the slot number.
>
> The load average is too high as the picture shows below. Each line
> presents load average 1 on one machine. CPU usage on each machine is 100%.
>
> All jobs are flink stream SQL.
>
>
>
> Can anybody help?
>
>
> Thanks.
>


-- 
Blog:http://www.klion26.com
GTalk:qcx978132955
一切随心