You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Xintong Song (Jira)" <ji...@apache.org> on 2020/06/08 07:48:00 UTC

[jira] [Created] (FLINK-18175) Add human readable summary for configured and derived memory sizes.

Xintong Song created FLINK-18175:
------------------------------------

             Summary: Add human readable summary for configured and derived memory sizes.
                 Key: FLINK-18175
                 URL: https://issues.apache.org/jira/browse/FLINK-18175
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.10.1, 1.11.0
            Reporter: Xintong Song


FLIP-49 & FLIP-116 introduces sophisticated memory configurations for TaskManager and Master processes. Before the JVM processes are started, Flink derives the accurate sizes for all necessary components, based on both explicit user configurations and implicit defaults.

To make the configuration results (especially those implicitly derived) clear to users, it would be helpful to print them in the beginning of the process logs. Currently, we only have printed JVM parameters (TM & Master) dynamic memory configurations (TM only). They are incomplete (jvm overhead for both processes and off-heap memory for the master process are not presented) and unfriendly (in bytes).

Therefore, I propose to add a human readable summary at the beginning of process logs.

See also this [PR discussion|https://github.com/apache/flink/pull/11445#discussion_r435721169].



--
This message was sent by Atlassian Jira
(v8.3.4#803005)