You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Andrey Zagrebin (Jira)" <ji...@apache.org> on 2020/06/08 08:06:00 UTC
[jira] [Comment Edited] (FLINK-18156) Misleading error message if
derived JVM overhead is too small
[ https://issues.apache.org/jira/browse/FLINK-18156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17127990#comment-17127990 ]
Andrey Zagrebin edited comment on FLINK-18156 at 6/8/20, 8:05 AM:
------------------------------------------------------------------
In this case, we always considered that the overhead is derived as it is not explicitly set. It just turned to have to be fixed as restricted by other option values. We decided to fail fast in case any inconsistencies like this one in user configuration to be explicit about the contracts. The min/max range is a hard contract, only fractions are soft.
We can change a bit the error message to add hints about adjusting min/max or other memory components to pass the check. The user can at least do this consciously.
was (Author: azagrebin):
In this case, we always considered that the overhead is derived as it is not explicitly set. It just turned to have to be fixed as restricted by other option values. We decided to fail fast in case any inconsistencies like this one in user configuration to be explicit about the contracts. The min/max range is a hard contract, only fractions are soft.
> Misleading error message if derived JVM overhead is too small
> -------------------------------------------------------------
>
> Key: FLINK-18156
> URL: https://issues.apache.org/jira/browse/FLINK-18156
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.11.0
> Reporter: Chesnay Schepler
> Priority: Major
>
> The error message says that the derived size is lower then the configured overhead range, but now such property was configured by the user.
> {code}
> [] - Loading configuration property: jobmanager.memory.process.size, 2000m
> [] - Loading configuration property: jobmanager.memory.heap.size, 1500m
> Exception in thread "main" org.apache.flink.configuration.IllegalConfigurationException: Derived JVM Overhead size (116.000mb (121634816 bytes)) is not in configured JVM Overhead range [192.000mb (201326592 bytes), 1024.000mb (107374182$ at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.sanityCheckJvmOverhead(ProcessMemoryUtils.java:171)
> at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveJvmMetaspaceAndOverheadFromTotalFlinkMemory(ProcessMemoryUtils.java:148)
> at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithExplicitInternalMemory(ProcessMemoryUtils.java:86)
> at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:71)
> at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:76)
> at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:71)
> at org.apache.flink.runtime.util.bash.BashJavaUtils.getJmResourceParams(BashJavaUtils.java:92)
> at org.apache.flink.runtime.util.bash.BashJavaUtils.runCommand(BashJavaUtils.java:66)
> at org.apache.flink.runtime.util.bash.BashJavaUtils.main(BashJavaUtils.java:54)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)