You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Zhu Zhu (Jira)" <ji...@apache.org> on 2019/10/30 07:00:04 UTC

[jira] [Created] (FLINK-14566) Enable ResourceSpec to get/set whether managed memory is used

Zhu Zhu created FLINK-14566:
-------------------------------

             Summary: Enable ResourceSpec to get/set whether managed memory is used
                 Key: FLINK-14566
                 URL: https://issues.apache.org/jira/browse/FLINK-14566
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.10.0
            Reporter: Zhu Zhu
             Fix For: 1.10.0


To calculate managed memory fraction for an operator with UNKNOWN resources, we need to know whether the operator will use managed memory, according to FLINK-14062.

I'd propose to define special values of onHeapManagedMemory/offHeapManagedMemory 
in ResourceSpec(introduced in FLINK-14405) to distinguish whether managed memory is used. 
- onHeapManagedMemory==MemorySize.ZERO means on heap managed memory is used, while onHeapManagedMemory==null means not. 
- similar for off heap managed memory.

getters: isUsingManagedMemoryOnHeap()/isUsingManagedMemoryOffHeap()
setters: setUsingManagedMemoryOnHeap(boolean)/setUsingManagedMemoryOffHeap(boolean)
(setters are only allowed to invoke on UNKNOWN)

{{ResourceSpec#isKnown()}} should be added to replace existing UNKNOWN usages for equality checking.

cc [~ykt836] [~trohrmann] [~wuzang] [~azagrebin]




--
This message was sent by Atlassian Jira
(v8.3.4#803005)