You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Aitozi (Jira)" <ji...@apache.org> on 2021/09/02 07:01:00 UTC
[jira] [Created] (FLINK-24124) Use explicit pool size to construct
thread pool instead of Hardware.getNumberCPUCores()
Aitozi created FLINK-24124:
------------------------------
Summary: Use explicit pool size to construct thread pool instead of Hardware.getNumberCPUCores()
Key: FLINK-24124
URL: https://issues.apache.org/jira/browse/FLINK-24124
Project: Flink
Issue Type: Improvement
Components: Runtime / Coordination
Reporter: Aitozi
As described in the [comments|https://issues.apache.org/jira/browse/FLINK-21685?focusedCommentId=17303866&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17303866]. If we calculate the pool size based on hardware information in containerize environment, it will cause the value too small.
But there are some code still use the {{Hardware.getNumberCPUCores()}} as the thread pool size like in {{JobManagerSharedServices#scheduledExecutorService}} .
This pool will be used to do like :
* dispose checkpoint (which is a I/O work)
* connection to resourceManager
* ...
But we often only set one core for jobManger. This will lead to all the above action can only be executed one by one. So this ticket is meant to use explicit pool size to avoid these problems in containerize environment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)