You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Nico Kruber (JIRA)" <ji...@apache.org> on 2017/08/09 14:00:01 UTC

[jira] [Created] (FLINK-7400) off-heap limits set to conservatively in yarn

Nico Kruber created FLINK-7400:
----------------------------------

             Summary: off-heap limits set to conservatively in yarn
                 Key: FLINK-7400
                 URL: https://issues.apache.org/jira/browse/FLINK-7400
             Project: Flink
          Issue Type: Bug
          Components: YARN
    Affects Versions: 1.3.2, 1.3.1, 1.3.0
            Reporter: Nico Kruber
            Assignee: Nico Kruber


Inside {{ContaineredTaskManagerParameters}}, since FLINK-6217, the {{offHeapSize}} is set to the amount of memory Flink will use off-heap which will be set as the value for {{-XX:MaxDirectMemorySize}} in various cases. This does not account for any off-heap use by other components than Flink, e.g. RocksDB, other libraries, or the JVM itself.

We should add the {{cutoff}} from the {{CONTAINERIZED_HEAP_CUTOFF_RATIO}} configuration parameter to {{offHeapSize}} as implied by the description on what this parameter is there for.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)