You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Nico Kruber (JIRA)" <ji...@apache.org> on 2017/08/09 14:29:00 UTC

[jira] [Updated] (FLINK-7400) off-heap limits set to conservatively in yarn

     [ https://issues.apache.org/jira/browse/FLINK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nico Kruber updated FLINK-7400:
-------------------------------
    Component/s: Mesos
                 Cluster Management

> off-heap limits set to conservatively in yarn
> ---------------------------------------------
>
>                 Key: FLINK-7400
>                 URL: https://issues.apache.org/jira/browse/FLINK-7400
>             Project: Flink
>          Issue Type: Bug
>          Components: Cluster Management, Mesos, YARN
>    Affects Versions: 1.3.0, 1.3.1, 1.3.2
>            Reporter: Nico Kruber
>            Assignee: Nico Kruber
>
> Inside {{ContaineredTaskManagerParameters}}, since FLINK-6217, the {{offHeapSize}} is set to the amount of memory Flink will use off-heap which will be set as the value for {{-XX:MaxDirectMemorySize}} in various cases. This does not account for any off-heap use by other components than Flink, e.g. RocksDB, other libraries, or the JVM itself.
> We should add the {{cutoff}} from the {{CONTAINERIZED_HEAP_CUTOFF_RATIO}} configuration parameter to {{offHeapSize}} as implied by the description on what this parameter is there for.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)