You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "liupengcheng (Jira)" <ji...@apache.org> on 2020/02/03 02:29:00 UTC

[jira] [Created] (FLINK-15848) Support both fixed allocator and dynamic allocator in flink

liupengcheng created FLINK-15848:
------------------------------------

             Summary: Support both fixed allocator and dynamic allocator in flink
                 Key: FLINK-15848
                 URL: https://issues.apache.org/jira/browse/FLINK-15848
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Task
    Affects Versions: 1.10.0
            Reporter: liupengcheng


Currently, we removed static allocator and only support dynamic allocation in flink1.10, however, this allocator still has some drawbacks:
 # Can not allocate resources in a range, which means the resource usage is not under control, this has very bad effect in a shared resource cluster(e.g. Yarn), one big query or job may occupy all the resources and  cause other jobs block.
 # Not support static resource allocation. That means we can hardly do benchmark testing across engines(e.g. Spark). Also, in resource shared cluster(e.g. Yarn) that support over-allocation, it's hard to align the resources usage.

As discussed in FLINK-12362 ,  we should support both fixed allocator and dynamic allocator(dynamically allocating in a range) in flink.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)